2024-04-16T12:47:47.354 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T12:47:47.354 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --owner scheduled_leonidus@teuthology --name leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149 --verbose -- /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/orig.config.yaml 2024-04-16T12:47:47.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T12:47:47.507 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149 branch: wip-lusov-shared-log-segment description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7658149' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-shared-log-segment ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds debug zombie log segments: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-shared-log-segment sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2402 sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-shared-log-segment suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtca6e1dodxY/L0I7XQ5fFK8sZMH3qsYD4wbgQfPYFRr2+Rwqx99pj26svM2NknK6Hd7/LT8w2+vX1gzuP/hZw= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLI73+JI8kvs0vsDCgI+UPQh+ABXeZ64+J33eiEFv6wO5JJV2808YLTlAmPm4iKRLV8AQXiryDQCzCuiYhr0m0o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:36:42 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T12:47:47.508 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa; will attempt to use it 2024-04-16T12:47:47.508 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks 2024-04-16T12:47:47.509 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T12:47:47.510 INFO:teuthology.task.internal:Checking packages... 2024-04-16T12:47:47.533 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f' 2024-04-16T12:47:47.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T12:47:47.533 INFO:teuthology.packaging:ref: None 2024-04-16T12:47:47.533 INFO:teuthology.packaging:tag: None 2024-04-16T12:47:47.534 INFO:teuthology.packaging:branch: wip-lusov-shared-log-segment 2024-04-16T12:47:47.534 INFO:teuthology.packaging:sha1: c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T12:47:47.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-shared-log-segment 2024-04-16T12:47:47.678 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2868.gc3c87ed0 2024-04-16T12:47:47.680 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T12:47:47.688 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T12:47:47.688 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T12:47:47.693 INFO:teuthology.task.internal:Saving configuration 2024-04-16T12:47:47.710 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T12:47:47.715 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T12:47:47.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:59.424791', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtca6e1dodxY/L0I7XQ5fFK8sZMH3qsYD4wbgQfPYFRr2+Rwqx99pj26svM2NknK6Hd7/LT8w2+vX1gzuP/hZw='} 2024-04-16T12:47:47.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:59.426149', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLI73+JI8kvs0vsDCgI+UPQh+ABXeZ64+J33eiEFv6wO5JJV2808YLTlAmPm4iKRLV8AQXiryDQCzCuiYhr0m0o='} 2024-04-16T12:47:47.759 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T12:47:47.766 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-16T12:47:47.766 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-16T12:47:47.766 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T12:47:47.839 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4bcd7ca160>, signals=[15]) 2024-04-16T12:47:47.839 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T12:47:47.845 INFO:teuthology.task.internal:Opening connections... 2024-04-16T12:47:47.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T12:47:47.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:47.955 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T12:47:47.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:47:48.043 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T12:47:48.051 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-04-16T12:47:48.069 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-04-16T12:47:48.069 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-04-16T12:47:48.127 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:47:48.128 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:47:48.129 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:47:48.129 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-04-16T12:47:48.378 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-16T12:47:48.395 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-16T12:47:48.396 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T12:47:48.453 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-16T12:47:48.454 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T12:47:48.454 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T12:47:48.454 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T12:47:48.454 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-16T12:47:48.477 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T12:47:48.486 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T12:47:48.490 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T12:47:48.490 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:47:48.493 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-16T12:47:48.509 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T12:47:48.515 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T12:47:48.515 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:47:48.550 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-16T12:47:48.647 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T12:47:48.703 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T12:47:48.718 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-16T12:47:48.719 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-16T12:47:48.719 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-16T12:47:48.719 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:47:48.719 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T12:47:48.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:47:48.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-16T12:47:48.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:47:48.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-16T12:47:49.067 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:47:49.067 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-16T12:47:49.067 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-04-16T12:47:49.074 DEBUG:teuthology.task.kernel:sha1 for client.1 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:47:49.074 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-16T12:47:49.074 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-16T12:47:49.085 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:47:49.085 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:47:49.085 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-16T12:47:49.086 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum upgrade -y linux-firmware 2024-04-16T12:47:49.092 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-361.el9.x86_64 2024-04-16T12:47:49.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:47:49.092 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-16T12:47:49.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-04-16T12:47:51.434 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.7 MB 00:00 2024-04-16T12:47:51.515 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.7 MB 00:00 2024-04-16T12:47:53.075 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2024-04-16T12:47:53.524 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2024-04-16T12:47:54.008 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T12:47:54.423 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T12:47:56.084 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-16T12:47:56.809 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-16T12:48:00.966 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-04-16T12:48:02.591 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-16T12:48:04.168 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.2 MB 00:04 2024-04-16T12:48:05.919 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-16T12:48:06.761 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-04-16T12:48:07.786 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 4.1 MB/s | 21 MB 00:05 2024-04-16T12:48:11.936 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-04-16T12:48:12.799 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-16T12:48:14.632 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-04-16T12:48:14.642 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-04-16T12:48:14.643 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 1 Package 2024-04-16T12:48:14.643 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:48:14.643 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 375 M 2024-04-16T12:48:14.643 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-04-16T12:48:15.248 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-16T12:48:15.256 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-16T12:48:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-16T12:48:15.256 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 1 Package 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 375 M 2024-04-16T12:48:15.257 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-16T12:48:34.397 INFO:teuthology.orchestra.run.smithi082.stdout:linux-firmware-20240219-143.el9.noarch.rpm 20 MB/s | 375 MB 00:19 2024-04-16T12:48:34.398 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:48:34.398 INFO:teuthology.orchestra.run.smithi082.stdout:Total 20 MB/s | 375 MB 00:19 2024-04-16T12:48:34.399 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-16T12:48:34.491 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-16T12:48:34.491 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-16T12:48:36.947 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-16T12:48:36.947 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-16T12:48:41.502 INFO:teuthology.orchestra.run.smithi067.stdout:linux-firmware-20240219-143.el9.noarch.rpm 14 MB/s | 375 MB 00:26 2024-04-16T12:48:41.503 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-04-16T12:48:41.504 INFO:teuthology.orchestra.run.smithi067.stdout:Total 14 MB/s | 375 MB 00:26 2024-04-16T12:48:41.504 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-04-16T12:48:41.614 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-04-16T12:48:41.615 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-04-16T12:48:43.424 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-16T12:48:43.664 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T12:48:43.745 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:44.109 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-04-16T12:48:44.109 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-04-16T12:48:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:44.891 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T12:48:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:45.306 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:48:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-16T12:48:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-16T12:48:45.307 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:48:45.307 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-16T12:48:45.585 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-16T12:48:45.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:48:45.740 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-16T12:48:45.741 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-16T12:48:45.743 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-04-16T12:48:50.444 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-04-16T12:48:50.726 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T12:48:50.821 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:51.728 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:51.728 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-16T12:48:52.122 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-16T12:48:52.122 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:48:52.122 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-04-16T12:48:52.123 INFO:teuthology.orchestra.run.smithi067.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-16T12:48:52.123 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:48:52.123 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-04-16T12:48:52.405 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-16T12:48:52.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-16T12:48:52.547 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-16T12:48:52.547 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-16T12:48:52.549 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi067.front.sepia.ceph.com to complete... 2024-04-16T12:50:38.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16 12:50:38 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-16T12:50:38.726 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-04-16 12:50:38-- 2024-04-16T12:50:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 1m 53s 2024-04-16T12:50:38.727 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 341M in 1m 52s (3.03 MB/s) 2024-04-16T12:50:38.730 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.1... 2024-04-16T12:50:38.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-16T12:50:40.790 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-04-16T12:50:40.848 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-04-16T12:50:40.930 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-04-16T12:50:48.964 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-16T12:50:57.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16 12:50:57 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-16T12:50:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:FINISHED --2024-04-16 12:50:57-- 2024-04-16T12:50:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:Total wall clock time: 2m 5s 2024-04-16T12:50:57.679 INFO:teuthology.orchestra.run.smithi067.stderr:Downloaded: 1 files, 341M in 2m 5s (2.74 MB/s) 2024-04-16T12:50:57.684 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-16T12:50:57.684 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-16T12:50:59.839 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying... ######################################## 2024-04-16T12:50:59.905 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing... ######################################## 2024-04-16T12:50:59.990 INFO:teuthology.orchestra.run.smithi067.stdout:Updating / installing... 2024-04-16T12:51:03.869 INFO:teuthology.orchestra.run.smithi082.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:51:08.268 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-16T12:51:23.490 INFO:teuthology.orchestra.run.smithi067.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T12:51:26.895 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-16T12:51:26.896 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-16T12:51:26.980 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-16T12:51:26.981 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-16T12:51:26.982 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-16T12:51:26.983 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-16T12:51:26.983 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-16T12:51:26.983 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-16T12:51:26.984 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-16T12:51:26.985 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-16T12:51:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-16T12:51:26.987 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-16T12:51:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-16T12:51:26.989 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-16T12:51:26.990 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-16T12:51:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-16T12:51:26.992 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-16T12:51:26.993 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-16T12:51:26.994 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-16T12:51:26.994 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-16T12:51:26.995 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-16T12:51:26.996 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-16T12:51:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-16T12:51:26.998 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-16T12:51:26.999 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-16T12:51:27.000 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-16T12:51:27.001 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-16T12:51:27.002 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-16T12:51:27.003 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-16T12:51:27.004 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-16T12:51:27.004 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-16T12:51:27.004 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-16T12:51:27.005 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-16T12:51:27.006 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-16T12:51:27.007 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-16T12:51:27.008 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-16T12:51:27.009 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-16T12:51:27.010 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-16T12:51:27.011 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-16T12:51:27.012 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-16T12:51:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-16T12:51:27.014 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-16T12:51:27.018 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-16T12:51:27.018 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-16T12:51:27.018 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-16T12:51:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-16T12:51:27.020 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-16T12:51:27.021 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-16T12:51:27.022 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-16T12:51:27.023 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-16T12:51:27.024 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-16T12:51:27.025 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-16T12:51:27.026 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-16T12:51:27.027 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-16T12:51:27.029 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-16T12:51:27.030 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-16T12:51:27.031 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-16T12:51:27.032 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-16T12:51:27.033 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-16T12:51:27.034 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-16T12:51:27.035 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-16T12:51:27.036 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-16T12:51:27.037 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-16T12:51:27.040 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-16T12:51:27.041 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-16T12:51:27.042 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-16T12:51:27.043 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-16T12:51:27.044 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-16T12:51:27.045 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-16T12:51:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-16T12:51:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-16T12:51:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-16T12:51:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-16T12:51:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-16T12:51:27.051 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-16T12:51:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-16T12:51:27.053 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-16T12:51:27.054 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-16T12:51:27.055 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-16T12:51:27.056 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-16T12:51:27.057 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-16T12:51:27.058 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-16T12:51:27.059 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-16T12:51:27.061 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-16T12:51:27.062 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-16T12:51:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-16T12:51:27.064 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-16T12:51:27.065 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-16T12:51:27.066 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-16T12:51:27.067 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-16T12:51:27.068 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-16T12:51:27.069 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-16T12:51:27.070 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-16T12:51:27.071 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-16T12:51:27.072 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-16T12:51:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-16T12:51:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-16T12:51:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-16T12:51:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-16T12:51:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-16T12:51:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-16T12:51:27.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-16T12:51:27.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-16T12:51:27.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-16T12:51:27.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-16T12:51:27.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-16T12:51:27.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-16T12:51:27.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-16T12:51:27.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-16T12:51:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-16T12:51:27.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-16T12:51:27.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-16T12:51:27.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-16T12:51:27.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-16T12:51:27.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-16T12:51:27.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-16T12:51:27.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-16T12:51:27.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-16T12:51:27.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-16T12:51:27.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-16T12:51:27.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-16T12:51:27.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-16T12:51:27.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-16T12:51:27.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-16T12:51:27.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-16T12:51:27.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-16T12:51:27.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-16T12:51:27.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-16T12:51:27.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-16T12:51:27.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-16T12:51:27.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-16T12:51:27.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-16T12:51:27.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-16T12:51:27.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-16T12:51:27.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-16T12:51:27.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-16T12:51:27.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-16T12:51:27.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-16T12:51:27.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-16T12:51:27.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-16T12:51:27.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-16T12:51:27.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-16T12:51:27.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-16T12:51:27.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-16T12:51:27.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-16T12:51:27.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-16T12:51:27.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-16T12:51:27.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-16T12:51:27.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-16T12:51:27.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-16T12:51:27.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-16T12:51:27.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-16T12:51:27.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-16T12:51:27.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-16T12:51:27.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-16T12:51:27.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-16T12:51:27.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-16T12:51:27.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-16T12:51:27.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-16T12:51:27.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-16T12:51:27.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-16T12:51:27.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-16T12:51:27.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-16T12:51:27.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-16T12:51:27.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-16T12:51:27.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-16T12:51:27.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-16T12:51:27.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-16T12:51:27.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-16T12:51:27.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-16T12:51:27.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-16T12:51:27.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-16T12:51:27.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-16T12:51:27.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-16T12:51:27.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-16T12:51:27.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-16T12:51:27.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-16T12:51:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-16T12:51:27.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-16T12:51:27.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-16T12:51:27.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-16T12:51:27.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-16T12:51:27.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-16T12:51:27.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-16T12:51:27.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-16T12:51:27.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-16T12:51:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-16T12:51:27.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-16T12:51:27.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-16T12:51:27.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-16T12:51:27.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-16T12:51:27.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-16T12:51:27.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-16T12:51:27.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-16T12:51:27.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-16T12:51:27.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-16T12:51:27.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-16T12:51:27.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-16T12:51:27.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-16T12:51:27.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-16T12:51:27.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-16T12:51:27.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-16T12:51:27.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-16T12:51:27.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-16T12:51:27.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-16T12:51:27.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-16T12:51:27.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-16T12:51:27.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-16T12:51:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-16T12:51:27.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-16T12:51:27.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-16T12:51:27.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-16T12:51:27.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-16T12:51:27.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-16T12:51:27.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-16T12:51:27.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-16T12:51:27.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-16T12:51:27.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-16T12:51:27.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-16T12:51:27.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-16T12:51:27.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-16T12:51:27.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-16T12:51:27.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-16T12:51:27.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-16T12:51:27.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-16T12:51:27.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-16T12:51:27.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-16T12:51:27.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-16T12:51:27.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-16T12:51:27.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T12:51:27.231 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:27.231 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-16T12:51:27.257 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-04-16T12:51:27.257 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T12:51:27.257 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-16T12:51:27.258 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:27.259 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-04-16T12:51:27.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-04-16T12:51:27.336 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:51:27.337 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:51:27.338 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-04-16T12:51:27.338 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T12:51:27.338 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:51:27.339 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:51:27.339 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:27.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-04-16T12:51:29.428 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:51:29.456 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-04-16T12:51:29.458 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-16T12:51:29.475 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.mqQy8xYZIW 2024-04-16T12:51:29.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mqQy8xYZIW 2024-04-16T12:51:29.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.mqQy8xYZIW 2024-04-16T12:51:29.698 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.mqQy8xYZIW is 6KB 2024-04-16T12:51:29.753 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.mqQy8xYZIW 2024-04-16T12:51:29.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:51:29.835 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:51:29.835 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:51:29.836 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:51:29.836 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-16T12:51:29.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:29.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-04-16T12:51:47.054 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-16T12:51:47.054 DEBUG:teuthology.orchestra.run.smithi067:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-16T12:51:47.156 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.156 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-16T12:51:47.157 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-16T12:51:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-16T12:51:47.159 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-16T12:51:47.160 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-16T12:51:47.161 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-16T12:51:47.162 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-16T12:51:47.163 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-16T12:51:47.164 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-16T12:51:47.165 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-16T12:51:47.166 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-16T12:51:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-16T12:51:47.168 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-16T12:51:47.169 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-16T12:51:47.170 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-16T12:51:47.171 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-16T12:51:47.172 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-16T12:51:47.173 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-16T12:51:47.175 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-16T12:51:47.175 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-16T12:51:47.175 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-16T12:51:47.175 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-16T12:51:47.176 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-16T12:51:47.177 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-16T12:51:47.178 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-16T12:51:47.179 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-16T12:51:47.180 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-16T12:51:47.181 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-16T12:51:47.182 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-16T12:51:47.183 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-16T12:51:47.184 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-16T12:51:47.185 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-16T12:51:47.186 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-16T12:51:47.187 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-16T12:51:47.188 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-16T12:51:47.189 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-16T12:51:47.201 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-16T12:51:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-16T12:51:47.203 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-16T12:51:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-16T12:51:47.205 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-16T12:51:47.206 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-16T12:51:47.207 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-16T12:51:47.208 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-16T12:51:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-16T12:51:47.210 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-16T12:51:47.211 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-16T12:51:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-16T12:51:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-16T12:51:47.214 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-16T12:51:47.215 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-16T12:51:47.216 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-16T12:51:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-16T12:51:47.218 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-16T12:51:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-16T12:51:47.220 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-16T12:51:47.221 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-16T12:51:47.222 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-16T12:51:47.223 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-16T12:51:47.224 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-16T12:51:47.225 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-16T12:51:47.225 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-16T12:51:47.225 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-16T12:51:47.226 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-16T12:51:47.227 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-16T12:51:47.228 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-16T12:51:47.229 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-16T12:51:47.230 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-16T12:51:47.231 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-16T12:51:47.232 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-16T12:51:47.233 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-16T12:51:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-16T12:51:47.235 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-16T12:51:47.236 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-16T12:51:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-16T12:51:47.238 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-16T12:51:47.239 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-16T12:51:47.240 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-16T12:51:47.241 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-16T12:51:47.242 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-16T12:51:47.242 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-16T12:51:47.242 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-16T12:51:47.243 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-16T12:51:47.244 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-16T12:51:47.245 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-16T12:51:47.246 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-16T12:51:47.247 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-16T12:51:47.248 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-16T12:51:47.249 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-16T12:51:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-16T12:51:47.251 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-16T12:51:47.252 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-16T12:51:47.253 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-16T12:51:47.254 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-16T12:51:47.255 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-16T12:51:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-16T12:51:47.257 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-16T12:51:47.258 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-16T12:51:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-16T12:51:47.260 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-16T12:51:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-16T12:51:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-16T12:51:47.263 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-16T12:51:47.263 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-16T12:51:47.263 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-16T12:51:47.263 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-16T12:51:47.264 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-16T12:51:47.265 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-16T12:51:47.266 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-16T12:51:47.267 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-16T12:51:47.268 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-16T12:51:47.269 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-16T12:51:47.270 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-16T12:51:47.271 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-16T12:51:47.272 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-16T12:51:47.273 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-16T12:51:47.274 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-16T12:51:47.275 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-16T12:51:47.276 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-16T12:51:47.277 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-16T12:51:47.278 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-16T12:51:47.279 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-16T12:51:47.280 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-16T12:51:47.281 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-16T12:51:47.282 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-16T12:51:47.283 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-16T12:51:47.284 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-16T12:51:47.285 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-16T12:51:47.286 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-16T12:51:47.287 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-16T12:51:47.288 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-16T12:51:47.289 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-16T12:51:47.290 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-16T12:51:47.291 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-16T12:51:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-16T12:51:47.293 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-16T12:51:47.294 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-16T12:51:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-16T12:51:47.296 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-16T12:51:47.297 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-16T12:51:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-16T12:51:47.299 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-16T12:51:47.300 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-16T12:51:47.301 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-16T12:51:47.302 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-16T12:51:47.303 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-16T12:51:47.304 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-16T12:51:47.305 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-16T12:51:47.306 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-16T12:51:47.307 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-16T12:51:47.308 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-16T12:51:47.309 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-16T12:51:47.310 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-16T12:51:47.314 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-16T12:51:47.314 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-16T12:51:47.314 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-16T12:51:47.314 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-16T12:51:47.314 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-16T12:51:47.315 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-16T12:51:47.316 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-16T12:51:47.317 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-16T12:51:47.318 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-16T12:51:47.319 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-16T12:51:47.320 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-16T12:51:47.321 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-16T12:51:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-16T12:51:47.323 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-16T12:51:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-16T12:51:47.325 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-16T12:51:47.326 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-16T12:51:47.327 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-16T12:51:47.328 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T12:51:47.332 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.332 DEBUG:teuthology.orchestra.run.smithi067:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-16T12:51:47.363 INFO:teuthology.orchestra.run.smithi067.stdout:postinstall scriptlet (using /bin/sh): 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout:for file in vmlinuz System.map config; do 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: fi 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout:done 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:47.364 INFO:teuthology.orchestra.run.smithi067.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.365 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2024-04-16T12:51:47.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.06 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 68.el9 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Group : Unspecified 2024-04-16T12:51:47.443 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 8264254 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : builder@centos.org 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T12:51:47.444 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T12:51:47.445 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2024-04-16T12:51:47.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T12:51:47.445 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T12:51:47.446 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T12:51:47.446 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:47.446 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T12:51:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-04-16T12:51:49.393 INFO:teuthology.orchestra.run.smithi067.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T12:51:49.429 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-04-16T12:51:49.431 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-04-16T12:51:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.1p9ql9VLVI 2024-04-16T12:51:49.449 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1p9ql9VLVI 2024-04-16T12:51:49.522 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.1p9ql9VLVI 2024-04-16T12:51:49.674 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.1p9ql9VLVI is 6KB 2024-04-16T12:51:49.723 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.1p9ql9VLVI 2024-04-16T12:51:49.743 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T12:51:49.807 INFO:teuthology.orchestra.run.smithi067.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T12:51:49.807 INFO:teuthology.orchestra.run.smithi067.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T12:51:49.807 INFO:teuthology.orchestra.run.smithi067.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T12:51:49.807 INFO:teuthology.orchestra.run.smithi067.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-16T12:51:49.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:51:49.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2024-04-16T12:52:00.002 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-16T12:52:00.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T12:52:00.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:52:19.999 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-16T12:52:20.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T12:52:20.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:52:34.463 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-16T12:52:43.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T12:52:43.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:52:54.687 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-16T12:53:01.857 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-16T12:53:03.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T12:53:03.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:13.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T12:53:13.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:15.839 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-16T12:53:16.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T12:53:16.438 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-16T12:53:16.439 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-16T12:53:16.481 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:53:16.482 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:53:16.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:53:16.482 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:53:17.483 DEBUG:teuthology.parallel:result is None 2024-04-16T12:53:22.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-16T12:53:34.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T12:53:34.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:37.153 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-04-16T12:53:52.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T12:53:52.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T12:53:52.640 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-04-16T12:53:53.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T12:53:53.174 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-16T12:53:53.174 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-04-16T12:53:53.211 INFO:teuthology.orchestra.run.smithi067.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:53:53.211 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-16T12:53:53.211 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T12:53:53.211 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T12:53:54.212 DEBUG:teuthology.parallel:result is None 2024-04-16T12:53:54.212 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T12:53:54.233 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T12:53:54.233 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:53:54.244 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T12:53:54.309 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T12:53:54.316 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T12:53:54.325 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T12:53:54.325 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:53:54.340 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T12:53:54.492 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T12:53:54.500 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T12:53:54.500 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:53:54.513 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T12:53:54.651 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:53:54.684 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:53:54.712 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:53:54.747 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T12:53:54.760 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T12:53:54.768 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T12:53:54.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:53:54.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T12:53:54.881 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T12:53:54.896 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T12:53:54.897 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:53:54.905 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T12:53:54.964 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:53:55.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:53:55.191 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:53:55.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:53:55.376 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T12:53:55.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:53:55.453 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:53:55.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T12:53:55.667 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:53:55.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T12:53:55.846 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T12:53:55.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T12:53:55.942 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-04-16T12:53:55.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-16T12:53:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:53:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T12:53:56.673 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T12:53:56.681 INFO:teuthology.task.internal:Starting timer... 2024-04-16T12:53:56.681 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T12:53:56.707 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T12:53:56.766 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T12:53:56.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-04-16T12:53:56.968 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-04-16T12:53:56.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-16T12:53:57.101 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-16T12:53:57.106 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T12:53:57.107 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-04-16T12:53:57.186 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-04-16T12:53:57.186 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-16T12:53:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-16T12:53:57.240 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2024-04-16T12:53:57.240 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:53:57.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:53:57.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T12:53:57.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T12:53:57.451 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T12:53:57.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:53:57.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-16T12:53:57.668 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T12:53:57.687 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T12:53:57.763 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T12:53:57.764 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T13:00:25.170 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2024-04-16T13:00:25.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T13:00:25.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T13:00:25.324 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-04-16T13:00:25.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-04-16T13:00:25.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T13:00:25.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T13:00:25.636 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-16T13:00:25.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-16T13:00:25.794 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T13:00:25.806 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T13:00:25.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T13:00:25.807 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T13:00:25.814 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T13:00:25.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T13:00:25.911 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T13:00:25.917 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T13:00:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T13:00:25.975 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T13:00:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-16T13:00:26.078 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-04-16T13:00:26.094 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-16T13:00:26.128 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-04-16T13:00:26.146 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T13:00:26.184 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T13:00:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T13:00:26.237 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T13:00:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.347 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.383 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.393 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:00:26.395 INFO:teuthology.run_tasks:Running task install... 2024-04-16T13:00:26.403 DEBUG:teuthology.task.install:project ceph 2024-04-16T13:00:26.403 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}} 2024-04-16T13:00:26.403 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'} 2024-04-16T13:00:26.403 INFO:teuthology.task.install:Using flavor: default 2024-04-16T13:00:26.408 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T13:00:26.409 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-16T13:00:26.409 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T13:00:26.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T13:00:26.412 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'tag': None, 'wait_for_package': False} 2024-04-16T13:00:26.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T13:00:26.557 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T13:00:26.557 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T13:00:26.638 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/ 2024-04-16T13:00:26.638 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2868.gc3c87ed0 2024-04-16T13:00:26.899 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T13:00:26.900 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:00:26.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T13:00:26.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-lusov-shared-log-segment/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T13:00:26.938 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:00:26.938 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T13:00:27.002 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T13:00:27.002 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T13:00:27.044 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-16T13:00:27.044 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T13:00:27.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T13:00:27.191 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T13:00:27.274 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T13:00:27.329 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T13:00:27.362 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-16T13:00:27.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-16T13:00:27.427 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-04-16T13:00:27.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-04-16T13:00:27.721 INFO:teuthology.orchestra.run.smithi082.stdout:74 files removed 2024-04-16T13:00:27.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T13:00:27.806 INFO:teuthology.orchestra.run.smithi067.stdout:74 files removed 2024-04-16T13:00:27.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-16T13:00:29.226 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 99 kB/s | 83 kB 00:00 2024-04-16T13:00:29.239 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 87 kB/s | 83 kB 00:00 2024-04-16T13:00:30.051 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 16 kB/s | 11 kB 00:00 2024-04-16T13:00:30.190 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 13 kB/s | 11 kB 00:00 2024-04-16T13:00:31.069 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2024-04-16T13:00:31.324 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 1.8 kB/s | 1.9 kB 00:01 2024-04-16T13:00:32.193 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 8.5 MB/s | 6.7 MB 00:00 2024-04-16T13:00:32.323 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-9 - AppStream 5.7 MB/s | 6.7 MB 00:01 2024-04-16T13:00:34.115 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-04-16T13:00:34.135 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2024-04-16T13:00:35.298 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-16T13:00:36.569 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.0 MB 00:02 2024-04-16T13:00:37.307 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-16T13:00:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-16T13:00:41.808 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-16T13:00:43.246 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-16T13:00:43.583 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-16T13:00:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-16T13:00:47.048 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-16T13:00:52.872 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 21 MB 00:09 2024-04-16T13:00:53.240 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-04-16T13:00:56.277 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T13:00:56.279 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T13:00:56.297 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T13:00:56.298 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T13:00:56.299 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T13:00:56.300 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T13:00:56.303 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T13:00:56.306 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T13:00:56.307 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T13:00:56.403 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-04-16T13:00:56.430 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================ 2024-04-16T13:00:56.430 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================ 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T13:00:56.431 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T13:00:56.432 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T13:00:56.433 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T13:00:56.434 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T13:00:56.435 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T13:00:56.436 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T13:00:56.437 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T13:00:56.438 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T13:00:56.439 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T13:00:56.440 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T13:00:56.441 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T13:00:56.442 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T13:00:56.443 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T13:00:56.444 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================================ 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:Install 150 Packages 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 24 Packages 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 228 M 2024-04-16T13:00:56.445 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-04-16T13:00:58.362 INFO:teuthology.orchestra.run.smithi067.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 10 kB/s | 6.6 kB 00:00 2024-04-16T13:00:58.791 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-16T13:01:00.541 INFO:teuthology.orchestra.run.smithi067.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 408 kB/s | 890 kB 00:02 2024-04-16T13:01:00.783 INFO:teuthology.orchestra.run.smithi067.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 602 kB/s | 145 kB 00:00 2024-04-16T13:01:01.806 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T13:01:01.808 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-16T13:01:01.828 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-16T13:01:01.829 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-16T13:01:01.830 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-16T13:01:01.832 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-16T13:01:01.834 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-16T13:01:01.838 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-16T13:01:01.839 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-16T13:01:01.924 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-16T13:01:01.946 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 6.6 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.4 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 890 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 145 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 1.5 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 142 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 3.5 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 7.4 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 49 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 10 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 49 M 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 264 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 762 k 2024-04-16T13:01:01.947 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 225 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 27 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 18 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 32 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 746 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 127 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-16T13:01:01.948 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 161 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 320 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 298 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 99 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 85 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 170 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-16T13:01:01.949 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.4 M 2024-04-16T13:01:01.950 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 3.1 M 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-16T13:01:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 21 M 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 34 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 2.4 M 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 249 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 4.7 M 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 17 M 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2868.gc3c87ed0.el9 ceph-noarch 16 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 25 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T13:01:01.952 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 163 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 500 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T13:01:01.953 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 5.2 M 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-16T13:01:01.954 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 45 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-2868.gc3c87ed0.el9 ceph 135 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T13:01:01.955 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T13:01:01.956 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T13:01:01.957 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T13:01:01.958 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T13:01:01.959 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout:Install 150 Packages 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 24 Packages 2024-04-16T13:01:01.960 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:01:01.961 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 228 M 2024-04-16T13:01:01.961 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-16T13:01:03.217 INFO:teuthology.orchestra.run.smithi067.stdout:(4/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 1.0 MB/s | 5.4 MB 00:05 2024-04-16T13:01:03.675 INFO:teuthology.orchestra.run.smithi067.stdout:(5/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 849 kB/s | 2.4 MB 00:02 2024-04-16T13:01:04.467 INFO:teuthology.orchestra.run.smithi082.stdout:(1/174): ceph-19.0.0-2868.gc3c87ed0.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-04-16T13:01:05.892 INFO:teuthology.orchestra.run.smithi067.stdout:(6/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 573 kB/s | 1.5 MB 00:02 2024-04-16T13:01:08.325 INFO:teuthology.orchestra.run.smithi082.stdout:(2/174): ceph-fuse-19.0.0-2868.gc3c87ed0.el9.x8 231 kB/s | 890 kB 00:03 2024-04-16T13:01:08.700 INFO:teuthology.orchestra.run.smithi082.stdout:(3/174): ceph-immutable-object-cache-19.0.0-286 387 kB/s | 145 kB 00:00 2024-04-16T13:01:09.243 INFO:teuthology.orchestra.run.smithi067.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 864 kB/s | 4.7 MB 00:05 2024-04-16T13:01:10.542 INFO:teuthology.orchestra.run.smithi082.stdout:(4/174): ceph-base-19.0.0-2868.gc3c87ed0.el9.x8 821 kB/s | 5.4 MB 00:06 2024-04-16T13:01:12.417 INFO:teuthology.orchestra.run.smithi082.stdout:(5/174): ceph-mds-19.0.0-2868.gc3c87ed0.el9.x86 661 kB/s | 2.4 MB 00:03 2024-04-16T13:01:12.576 INFO:teuthology.orchestra.run.smithi082.stdout:(6/174): ceph-mgr-19.0.0-2868.gc3c87ed0.el9.x86 754 kB/s | 1.5 MB 00:02 2024-04-16T13:01:18.209 INFO:teuthology.orchestra.run.smithi082.stdout:(7/174): ceph-mon-19.0.0-2868.gc3c87ed0.el9.x86 831 kB/s | 4.7 MB 00:05 2024-04-16T13:01:23.342 INFO:teuthology.orchestra.run.smithi067.stdout:(8/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x86 988 kB/s | 17 MB 00:17 2024-04-16T13:01:23.425 INFO:teuthology.orchestra.run.smithi067.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 305 kB/s | 25 kB 00:00 2024-04-16T13:01:27.699 INFO:teuthology.orchestra.run.smithi082.stdout:(8/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el9 1.1 MB/s | 10 MB 00:09 2024-04-16T13:01:27.790 INFO:teuthology.orchestra.run.smithi082.stdout:(9/174): ceph-selinux-19.0.0-2868.gc3c87ed0.el9 280 kB/s | 25 kB 00:00 2024-04-16T13:01:29.126 INFO:teuthology.orchestra.run.smithi067.stdout:(10/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 683 kB/s | 21 MB 00:31 2024-04-16T13:01:29.526 INFO:teuthology.orchestra.run.smithi067.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 564 kB/s | 225 kB 00:00 2024-04-16T13:01:29.651 INFO:teuthology.orchestra.run.smithi067.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 217 kB/s | 27 kB 00:00 2024-04-16T13:01:29.793 INFO:teuthology.orchestra.run.smithi067.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 225 kB/s | 32 kB 00:00 2024-04-16T13:01:30.801 INFO:teuthology.orchestra.run.smithi067.stdout:(14/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 741 kB/s | 746 kB 00:01 2024-04-16T13:01:31.043 INFO:teuthology.orchestra.run.smithi067.stdout:(15/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 678 kB/s | 163 kB 00:00 2024-04-16T13:01:31.427 INFO:teuthology.orchestra.run.smithi067.stdout:(16/174): ceph-radosgw-19.0.0-2868.gc3c87ed0.el 461 kB/s | 10 MB 00:22 2024-04-16T13:01:31.461 INFO:teuthology.orchestra.run.smithi067.stdout:(17/174): librados-devel-19.0.0-2868.gc3c87ed0. 304 kB/s | 127 kB 00:00 2024-04-16T13:01:32.469 INFO:teuthology.orchestra.run.smithi067.stdout:(18/174): libradosstriper1-19.0.0-2868.gc3c87ed 481 kB/s | 500 kB 00:01 2024-04-16T13:01:32.603 INFO:teuthology.orchestra.run.smithi067.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 341 kB/s | 45 kB 00:00 2024-04-16T13:01:32.953 INFO:teuthology.orchestra.run.smithi067.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 386 kB/s | 135 kB 00:00 2024-04-16T13:01:33.303 INFO:teuthology.orchestra.run.smithi067.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 462 kB/s | 161 kB 00:00 2024-04-16T13:01:33.854 INFO:teuthology.orchestra.run.smithi067.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 584 kB/s | 320 kB 00:00 2024-04-16T13:01:34.337 INFO:teuthology.orchestra.run.smithi067.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 618 kB/s | 298 kB 00:00 2024-04-16T13:01:34.554 INFO:teuthology.orchestra.run.smithi067.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 461 kB/s | 99 kB 00:00 2024-04-16T13:01:34.788 INFO:teuthology.orchestra.run.smithi067.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 366 kB/s | 85 kB 00:00 2024-04-16T13:01:40.079 INFO:teuthology.orchestra.run.smithi067.stdout:(26/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 598 kB/s | 3.1 MB 00:05 2024-04-16T13:01:40.329 INFO:teuthology.orchestra.run.smithi067.stdout:(27/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 604 kB/s | 5.2 MB 00:08 2024-04-16T13:01:40.413 INFO:teuthology.orchestra.run.smithi067.stdout:(28/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 513 kB/s | 170 kB 00:00 2024-04-16T13:01:40.430 INFO:teuthology.orchestra.run.smithi067.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2868.g 346 kB/s | 34 kB 00:00 2024-04-16T13:01:40.697 INFO:teuthology.orchestra.run.smithi067.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 503 kB/s | 142 kB 00:00 2024-04-16T13:01:41.221 INFO:teuthology.orchestra.run.smithi082.stdout:(10/174): ceph-common-19.0.0-2868.gc3c87ed0.el9 574 kB/s | 21 MB 00:37 2024-04-16T13:01:41.472 INFO:teuthology.orchestra.run.smithi082.stdout:(11/174): cephfs-mirror-19.0.0-2868.gc3c87ed0.e 902 kB/s | 225 kB 00:00 2024-04-16T13:01:41.580 INFO:teuthology.orchestra.run.smithi082.stdout:(12/174): cephfs-shell-19.0.0-2868.gc3c87ed0.el 251 kB/s | 27 kB 00:00 2024-04-16T13:01:41.672 INFO:teuthology.orchestra.run.smithi082.stdout:(13/174): libcephfs-devel-19.0.0-2868.gc3c87ed0 349 kB/s | 32 kB 00:00 2024-04-16T13:01:42.464 INFO:teuthology.orchestra.run.smithi082.stdout:(14/174): ceph-osd-19.0.0-2868.gc3c87ed0.el9.x8 577 kB/s | 17 MB 00:29 2024-04-16T13:01:42.514 INFO:teuthology.orchestra.run.smithi082.stdout:(15/174): libcephfs2-19.0.0-2868.gc3c87ed0.el9. 887 kB/s | 746 kB 00:00 2024-04-16T13:01:42.715 INFO:teuthology.orchestra.run.smithi082.stdout:(16/174): librados-devel-19.0.0-2868.gc3c87ed0. 637 kB/s | 127 kB 00:00 2024-04-16T13:01:42.840 INFO:teuthology.orchestra.run.smithi082.stdout:(17/174): libcephsqlite-19.0.0-2868.gc3c87ed0.e 436 kB/s | 163 kB 00:00 2024-04-16T13:01:43.573 INFO:teuthology.orchestra.run.smithi082.stdout:(18/174): libradosstriper1-19.0.0-2868.gc3c87ed 583 kB/s | 500 kB 00:00 2024-04-16T13:01:43.691 INFO:teuthology.orchestra.run.smithi082.stdout:(19/174): python3-ceph-argparse-19.0.0-2868.gc3 390 kB/s | 45 kB 00:00 2024-04-16T13:01:44.016 INFO:teuthology.orchestra.run.smithi082.stdout:(20/174): python3-ceph-common-19.0.0-2868.gc3c8 415 kB/s | 135 kB 00:00 2024-04-16T13:01:44.349 INFO:teuthology.orchestra.run.smithi082.stdout:(21/174): python3-cephfs-19.0.0-2868.gc3c87ed0. 485 kB/s | 161 kB 00:00 2024-04-16T13:01:44.463 INFO:teuthology.orchestra.run.smithi067.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 899 kB/s | 3.5 MB 00:04 2024-04-16T13:01:44.797 INFO:teuthology.orchestra.run.smithi067.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 749 kB/s | 249 kB 00:00 2024-04-16T13:01:44.891 INFO:teuthology.orchestra.run.smithi082.stdout:(22/174): python3-rados-19.0.0-2868.gc3c87ed0.e 593 kB/s | 320 kB 00:00 2024-04-16T13:01:44.964 INFO:teuthology.orchestra.run.smithi067.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 296 kB/s | 49 kB 00:00 2024-04-16T13:01:45.072 INFO:teuthology.orchestra.run.smithi067.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 153 kB/s | 16 kB 00:00 2024-04-16T13:01:45.333 INFO:teuthology.orchestra.run.smithi082.stdout:(23/174): python3-rbd-19.0.0-2868.gc3c87ed0.el9 677 kB/s | 298 kB 00:00 2024-04-16T13:01:45.489 INFO:teuthology.orchestra.run.smithi067.stdout:(35/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 634 kB/s | 264 kB 00:00 2024-04-16T13:01:45.516 INFO:teuthology.orchestra.run.smithi082.stdout:(24/174): python3-rgw-19.0.0-2868.gc3c87ed0.el9 544 kB/s | 99 kB 00:00 2024-04-16T13:01:45.708 INFO:teuthology.orchestra.run.smithi082.stdout:(25/174): rbd-fuse-19.0.0-2868.gc3c87ed0.el9.x8 448 kB/s | 85 kB 00:00 2024-04-16T13:01:46.215 INFO:teuthology.orchestra.run.smithi067.stdout:(36/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 1.0 MB/s | 762 kB 00:00 2024-04-16T13:01:46.331 INFO:teuthology.orchestra.run.smithi067.stdout:(37/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 158 kB/s | 18 kB 00:00 2024-04-16T13:01:46.808 INFO:teuthology.orchestra.run.smithi082.stdout:(26/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 2.6 MB/s | 49 MB 00:19 2024-04-16T13:01:46.909 INFO:teuthology.orchestra.run.smithi082.stdout:(27/174): rbd-nbd-19.0.0-2868.gc3c87ed0.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-16T13:01:46.940 INFO:teuthology.orchestra.run.smithi067.stdout:(38/174): ceph-test-19.0.0-2868.gc3c87ed0.el9.x 2.1 MB/s | 49 MB 00:23 2024-04-16T13:01:46.967 INFO:teuthology.orchestra.run.smithi082.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2868.g 594 kB/s | 34 kB 00:00 2024-04-16T13:01:47.024 INFO:teuthology.orchestra.run.smithi067.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 959 kB/s | 662 kB 00:00 2024-04-16T13:01:47.043 INFO:teuthology.orchestra.run.smithi082.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2868.gc3c87ed 1.9 MB/s | 142 kB 00:00 2024-04-16T13:01:47.124 INFO:teuthology.orchestra.run.smithi067.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 920 kB 00:00 2024-04-16T13:01:47.158 INFO:teuthology.orchestra.run.smithi067.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 819 kB/s | 106 kB 00:00 2024-04-16T13:01:47.192 INFO:teuthology.orchestra.run.smithi067.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2024-04-16T13:01:47.342 INFO:teuthology.orchestra.run.smithi067.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 176 kB/s | 32 kB 00:00 2024-04-16T13:01:47.550 INFO:teuthology.orchestra.run.smithi067.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.4 MB/s | 3.0 MB 00:00 2024-04-16T13:01:47.575 INFO:teuthology.orchestra.run.smithi067.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 79 kB/s | 17 kB 00:00 2024-04-16T13:01:47.601 INFO:teuthology.orchestra.run.smithi067.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 205 kB/s | 10 kB 00:00 2024-04-16T13:01:47.634 INFO:teuthology.orchestra.run.smithi067.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-04-16T13:01:47.659 INFO:teuthology.orchestra.run.smithi067.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 788 kB/s | 44 kB 00:00 2024-04-16T13:01:47.718 INFO:teuthology.orchestra.run.smithi067.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.9 MB/s | 661 kB 00:00 2024-04-16T13:01:47.768 INFO:teuthology.orchestra.run.smithi067.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 5.4 MB/s | 578 kB 00:00 2024-04-16T13:01:47.785 INFO:teuthology.orchestra.run.smithi067.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 764 kB/s | 46 kB 00:00 2024-04-16T13:01:47.818 INFO:teuthology.orchestra.run.smithi082.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2868.gc3c87 4.6 MB/s | 3.5 MB 00:00 2024-04-16T13:01:47.827 INFO:teuthology.orchestra.run.smithi067.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-16T13:01:47.861 INFO:teuthology.orchestra.run.smithi067.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2024-04-16T13:01:47.894 INFO:teuthology.orchestra.run.smithi067.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-04-16T13:01:47.911 INFO:teuthology.orchestra.run.smithi067.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 725 kB/s | 34 kB 00:00 2024-04-16T13:01:48.204 INFO:teuthology.orchestra.run.smithi067.stdout:(56/174): postgresql-13.14-1.el9.x86_64.rpm 5.3 MB/s | 1.5 MB 00:00 2024-04-16T13:01:48.304 INFO:teuthology.orchestra.run.smithi067.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-04-16T13:01:48.346 INFO:teuthology.orchestra.run.smithi067.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 5.7 MB/s | 817 kB 00:00 2024-04-16T13:01:48.368 INFO:teuthology.orchestra.run.smithi082.stdout:(31/174): rbd-mirror-19.0.0-2868.gc3c87ed0.el9. 1.2 MB/s | 3.1 MB 00:02 2024-04-16T13:01:48.371 INFO:teuthology.orchestra.run.smithi067.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 132 kB 00:00 2024-04-16T13:01:48.618 INFO:teuthology.orchestra.run.smithi082.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2868.gc3 1.0 MB/s | 249 kB 00:00 2024-04-16T13:01:48.621 INFO:teuthology.orchestra.run.smithi067.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2024-04-16T13:01:48.672 INFO:teuthology.orchestra.run.smithi067.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-04-16T13:01:48.727 INFO:teuthology.orchestra.run.smithi082.stdout:(33/174): ceph-mgr-rook-19.0.0-2868.gc3c87ed0.e 461 kB/s | 49 kB 00:00 2024-04-16T13:01:48.813 INFO:teuthology.orchestra.run.smithi067.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 427 kB/s | 78 kB 00:00 2024-04-16T13:01:48.827 INFO:teuthology.orchestra.run.smithi082.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2868.gc 165 kB/s | 16 kB 00:00 2024-04-16T13:01:49.047 INFO:teuthology.orchestra.run.smithi067.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2024-04-16T13:01:49.052 INFO:teuthology.orchestra.run.smithi082.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-04-16T13:01:49.072 INFO:teuthology.orchestra.run.smithi067.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 99 kB/s | 24 kB 00:00 2024-04-16T13:01:49.086 INFO:teuthology.orchestra.run.smithi082.stdout:(36/174): ceph-volume-19.0.0-2868.gc3c87ed0.el9 1.0 MB/s | 264 kB 00:00 2024-04-16T13:01:49.106 INFO:teuthology.orchestra.run.smithi067.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 315 kB/s | 18 kB 00:00 2024-04-16T13:01:49.139 INFO:teuthology.orchestra.run.smithi067.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-04-16T13:01:49.165 INFO:teuthology.orchestra.run.smithi067.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 561 kB/s | 32 kB 00:00 2024-04-16T13:01:49.186 INFO:teuthology.orchestra.run.smithi082.stdout:(37/174): cephadm-19.0.0-2868.gc3c87ed0.el9.noa 5.6 MB/s | 762 kB 00:00 2024-04-16T13:01:49.203 INFO:teuthology.orchestra.run.smithi082.stdout:(38/174): cephfs-top-19.0.0-2868.gc3c87ed0.el9. 157 kB/s | 18 kB 00:00 2024-04-16T13:01:49.416 INFO:teuthology.orchestra.run.smithi067.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-04-16T13:01:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 768 kB/s | 217 kB 00:00 2024-04-16T13:01:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2024-04-16T13:01:49.495 INFO:teuthology.orchestra.run.smithi082.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-04-16T13:01:49.508 INFO:teuthology.orchestra.run.smithi067.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-04-16T13:01:49.537 INFO:teuthology.orchestra.run.smithi082.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 920 kB 00:00 2024-04-16T13:01:49.556 INFO:teuthology.orchestra.run.smithi067.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 575 kB/s | 41 kB 00:00 2024-04-16T13:01:49.562 INFO:teuthology.orchestra.run.smithi082.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.7 MB/s | 106 kB 00:00 2024-04-16T13:01:49.592 INFO:teuthology.orchestra.run.smithi067.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 238 kB 00:00 2024-04-16T13:01:49.596 INFO:teuthology.orchestra.run.smithi082.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-04-16T13:01:49.617 INFO:teuthology.orchestra.run.smithi067.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-04-16T13:01:49.621 INFO:teuthology.orchestra.run.smithi082.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 574 kB/s | 32 kB 00:00 2024-04-16T13:01:49.659 INFO:teuthology.orchestra.run.smithi067.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2024-04-16T13:01:49.684 INFO:teuthology.orchestra.run.smithi067.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 740 kB/s | 47 kB 00:00 2024-04-16T13:01:49.710 INFO:teuthology.orchestra.run.smithi067.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 874 kB/s | 43 kB 00:00 2024-04-16T13:01:49.738 INFO:teuthology.orchestra.run.smithi082.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-16T13:01:49.786 INFO:teuthology.orchestra.run.smithi082.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 120 kB/s | 17 kB 00:00 2024-04-16T13:01:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 240 kB/s | 39 kB 00:00 2024-04-16T13:01:49.913 INFO:teuthology.orchestra.run.smithi082.stdout:(46/174): librgw2-19.0.0-2868.gc3c87ed0.el9.x86 757 kB/s | 5.2 MB 00:07 2024-04-16T13:01:49.931 INFO:teuthology.orchestra.run.smithi082.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 70 kB/s | 10 kB 00:00 2024-04-16T13:01:49.955 INFO:teuthology.orchestra.run.smithi082.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 948 kB/s | 159 kB 00:00 2024-04-16T13:01:49.973 INFO:teuthology.orchestra.run.smithi082.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 782 kB/s | 44 kB 00:00 2024-04-16T13:01:50.031 INFO:teuthology.orchestra.run.smithi082.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 661 kB 00:00 2024-04-16T13:01:50.065 INFO:teuthology.orchestra.run.smithi082.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 578 kB 00:00 2024-04-16T13:01:50.082 INFO:teuthology.orchestra.run.smithi082.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 428 kB/s | 46 kB 00:00 2024-04-16T13:01:50.115 INFO:teuthology.orchestra.run.smithi082.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-04-16T13:01:50.149 INFO:teuthology.orchestra.run.smithi082.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-16T13:01:50.177 INFO:teuthology.orchestra.run.smithi067.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-04-16T13:01:50.182 INFO:teuthology.orchestra.run.smithi082.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2024-04-16T13:01:50.210 INFO:teuthology.orchestra.run.smithi067.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 132 kB/s | 41 kB 00:00 2024-04-16T13:01:50.224 INFO:teuthology.orchestra.run.smithi082.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 34 kB 00:00 2024-04-16T13:01:50.244 INFO:teuthology.orchestra.run.smithi067.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 220 kB 00:00 2024-04-16T13:01:50.374 INFO:teuthology.orchestra.run.smithi082.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-04-16T13:01:50.386 INFO:teuthology.orchestra.run.smithi067.stdout:(82/174): ceph-mgr-diskprediction-local-19.0.0- 782 kB/s | 7.4 MB 00:09 2024-04-16T13:01:50.411 INFO:teuthology.orchestra.run.smithi067.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 176 kB/s | 35 kB 00:00 2024-04-16T13:01:50.433 INFO:teuthology.orchestra.run.smithi082.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 6.6 MB/s | 1.5 MB 00:00 2024-04-16T13:01:50.475 INFO:teuthology.orchestra.run.smithi082.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 3.4 MB/s | 817 kB 00:00 2024-04-16T13:01:50.501 INFO:teuthology.orchestra.run.smithi082.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 132 kB 00:00 2024-04-16T13:01:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 150 kB/s | 46 kB 00:00 2024-04-16T13:01:50.619 INFO:teuthology.orchestra.run.smithi082.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 7.7 MB/s | 1.0 MB 00:00 2024-04-16T13:01:50.619 INFO:teuthology.orchestra.run.smithi067.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2024-04-16T13:01:50.637 INFO:teuthology.orchestra.run.smithi067.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 708 kB/s | 56 kB 00:00 2024-04-16T13:01:50.663 INFO:teuthology.orchestra.run.smithi067.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 599 kB/s | 63 kB 00:00 2024-04-16T13:01:50.688 INFO:teuthology.orchestra.run.smithi067.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 601 kB/s | 44 kB 00:00 2024-04-16T13:01:50.721 INFO:teuthology.orchestra.run.smithi067.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-04-16T13:01:50.743 INFO:teuthology.orchestra.run.smithi082.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-04-16T13:01:50.759 INFO:teuthology.orchestra.run.smithi082.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 332 kB/s | 78 kB 00:00 2024-04-16T13:01:50.763 INFO:teuthology.orchestra.run.smithi067.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2024-04-16T13:01:50.805 INFO:teuthology.orchestra.run.smithi067.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.1 MB 00:00 2024-04-16T13:01:50.830 INFO:teuthology.orchestra.run.smithi067.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-04-16T13:01:50.864 INFO:teuthology.orchestra.run.smithi067.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-04-16T13:01:50.889 INFO:teuthology.orchestra.run.smithi067.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-04-16T13:01:50.943 INFO:teuthology.orchestra.run.smithi082.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-04-16T13:01:50.968 INFO:teuthology.orchestra.run.smithi082.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 127 kB/s | 24 kB 00:00 2024-04-16T13:01:50.993 INFO:teuthology.orchestra.run.smithi082.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 83 kB/s | 18 kB 00:00 2024-04-16T13:01:51.022 INFO:teuthology.orchestra.run.smithi067.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-16T13:01:51.048 INFO:teuthology.orchestra.run.smithi067.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-16T13:01:51.052 INFO:teuthology.orchestra.run.smithi082.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-04-16T13:01:51.081 INFO:teuthology.orchestra.run.smithi067.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-16T13:01:51.094 INFO:teuthology.orchestra.run.smithi082.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 32 kB 00:00 2024-04-16T13:01:51.107 INFO:teuthology.orchestra.run.smithi067.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 373 kB/s | 21 kB 00:00 2024-04-16T13:01:51.141 INFO:teuthology.orchestra.run.smithi067.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 439 kB/s | 25 kB 00:00 2024-04-16T13:01:51.183 INFO:teuthology.orchestra.run.smithi067.stdout:(100/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-04-16T13:01:51.216 INFO:teuthology.orchestra.run.smithi067.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 3.2 MB/s | 245 kB 00:00 2024-04-16T13:01:51.228 INFO:teuthology.orchestra.run.smithi082.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-04-16T13:01:51.250 INFO:teuthology.orchestra.run.smithi067.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 3.7 MB/s | 248 kB 00:00 2024-04-16T13:01:51.253 INFO:teuthology.orchestra.run.smithi082.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2024-04-16T13:01:51.275 INFO:teuthology.orchestra.run.smithi067.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-16T13:01:51.278 INFO:teuthology.orchestra.run.smithi082.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-04-16T13:01:51.300 INFO:teuthology.orchestra.run.smithi067.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 453 kB/s | 22 kB 00:00 2024-04-16T13:01:51.320 INFO:teuthology.orchestra.run.smithi082.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-04-16T13:01:51.345 INFO:teuthology.orchestra.run.smithi082.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 41 kB 00:00 2024-04-16T13:01:51.367 INFO:teuthology.orchestra.run.smithi067.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 9.3 MB/s | 863 kB 00:00 2024-04-16T13:01:51.379 INFO:teuthology.orchestra.run.smithi082.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 238 kB 00:00 2024-04-16T13:01:51.412 INFO:teuthology.orchestra.run.smithi082.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-04-16T13:01:51.437 INFO:teuthology.orchestra.run.smithi082.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-04-16T13:01:51.454 INFO:teuthology.orchestra.run.smithi082.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 662 kB/s | 47 kB 00:00 2024-04-16T13:01:51.497 INFO:teuthology.orchestra.run.smithi082.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 748 kB/s | 43 kB 00:00 2024-04-16T13:01:51.568 INFO:teuthology.orchestra.run.smithi067.stdout:(106/174): openssl-devel-3.0.7-27.el9.x86_64.rp 9.0 MB/s | 4.1 MB 00:00 2024-04-16T13:01:51.897 INFO:teuthology.orchestra.run.smithi082.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-16T13:01:51.922 INFO:teuthology.orchestra.run.smithi082.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 87 kB/s | 39 kB 00:00 2024-04-16T13:01:51.947 INFO:teuthology.orchestra.run.smithi082.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 96 kB/s | 41 kB 00:00 2024-04-16T13:01:51.968 INFO:teuthology.orchestra.run.smithi067.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 49 kB/s | 19 kB 00:00 2024-04-16T13:01:51.980 INFO:teuthology.orchestra.run.smithi082.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2024-04-16T13:01:52.006 INFO:teuthology.orchestra.run.smithi082.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 630 kB/s | 35 kB 00:00 2024-04-16T13:01:52.031 INFO:teuthology.orchestra.run.smithi082.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 578 kB/s | 46 kB 00:00 2024-04-16T13:01:52.064 INFO:teuthology.orchestra.run.smithi082.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2024-04-16T13:01:52.090 INFO:teuthology.orchestra.run.smithi082.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-04-16T13:01:52.115 INFO:teuthology.orchestra.run.smithi082.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 784 kB/s | 63 kB 00:00 2024-04-16T13:01:52.140 INFO:teuthology.orchestra.run.smithi082.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 599 kB/s | 44 kB 00:00 2024-04-16T13:01:52.174 INFO:teuthology.orchestra.run.smithi082.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-04-16T13:01:52.199 INFO:teuthology.orchestra.run.smithi082.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2024-04-16T13:01:52.258 INFO:teuthology.orchestra.run.smithi082.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-04-16T13:01:52.283 INFO:teuthology.orchestra.run.smithi082.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-04-16T13:01:52.308 INFO:teuthology.orchestra.run.smithi082.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-04-16T13:01:52.342 INFO:teuthology.orchestra.run.smithi082.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 187 kB 00:00 2024-04-16T13:01:52.343 INFO:teuthology.orchestra.run.smithi067.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 317 kB/s | 309 kB 00:00 2024-04-16T13:01:52.502 INFO:teuthology.orchestra.run.smithi067.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 165 kB/s | 26 kB 00:00 2024-04-16T13:01:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 874 kB/s | 187 kB 00:00 2024-04-16T13:01:52.535 INFO:teuthology.orchestra.run.smithi067.stdout:(110/174): abseil-cpp-20211102.0-3.el9.x86_64.r 444 kB/s | 548 kB 00:01 2024-04-16T13:01:52.551 INFO:teuthology.orchestra.run.smithi082.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 939 kB/s | 195 kB 00:00 2024-04-16T13:01:52.601 INFO:teuthology.orchestra.run.smithi082.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-16T13:01:52.626 INFO:teuthology.orchestra.run.smithi082.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 288 kB/s | 21 kB 00:00 2024-04-16T13:01:52.644 INFO:teuthology.orchestra.run.smithi067.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 344 kB/s | 49 kB 00:00 2024-04-16T13:01:52.669 INFO:teuthology.orchestra.run.smithi067.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2024-04-16T13:01:52.693 INFO:teuthology.orchestra.run.smithi082.stdout:(99/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-04-16T13:01:52.719 INFO:teuthology.orchestra.run.smithi082.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 219 kB/s | 25 kB 00:00 2024-04-16T13:01:52.761 INFO:teuthology.orchestra.run.smithi067.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-04-16T13:01:52.786 INFO:teuthology.orchestra.run.smithi082.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-04-16T13:01:52.828 INFO:teuthology.orchestra.run.smithi082.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-04-16T13:01:52.836 INFO:teuthology.orchestra.run.smithi067.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 790 kB/s | 151 kB 00:00 2024-04-16T13:01:52.861 INFO:teuthology.orchestra.run.smithi082.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.7 MB/s | 248 kB 00:00 2024-04-16T13:01:52.878 INFO:teuthology.orchestra.run.smithi082.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 451 kB/s | 22 kB 00:00 2024-04-16T13:01:52.878 INFO:teuthology.orchestra.run.smithi067.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-04-16T13:01:52.979 INFO:teuthology.orchestra.run.smithi082.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2024-04-16T13:01:52.987 INFO:teuthology.orchestra.run.smithi067.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 299 kB/s | 32 kB 00:00 2024-04-16T13:01:53.012 INFO:teuthology.orchestra.run.smithi067.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 249 kB/s | 43 kB 00:00 2024-04-16T13:01:53.079 INFO:teuthology.orchestra.run.smithi067.stdout:(118/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2024-04-16T13:01:53.104 INFO:teuthology.orchestra.run.smithi067.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2024-04-16T13:01:53.188 INFO:teuthology.orchestra.run.smithi067.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 983 kB/s | 172 kB 00:00 2024-04-16T13:01:53.230 INFO:teuthology.orchestra.run.smithi067.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-04-16T13:01:53.262 INFO:teuthology.orchestra.run.smithi082.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-04-16T13:01:53.263 INFO:teuthology.orchestra.run.smithi067.stdout:(122/174): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-04-16T13:01:53.297 INFO:teuthology.orchestra.run.smithi067.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 327 kB/s | 35 kB 00:00 2024-04-16T13:01:53.339 INFO:teuthology.orchestra.run.smithi067.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.8 MB/s | 203 kB 00:00 2024-04-16T13:01:53.448 INFO:teuthology.orchestra.run.smithi067.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-16T13:01:53.473 INFO:teuthology.orchestra.run.smithi067.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 826 kB/s | 144 kB 00:00 2024-04-16T13:01:53.556 INFO:teuthology.orchestra.run.smithi067.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-04-16T13:01:53.656 INFO:teuthology.orchestra.run.smithi067.stdout:(128/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-04-16T13:01:53.671 INFO:teuthology.orchestra.run.smithi082.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 493 kB/s | 309 kB 00:00 2024-04-16T13:01:53.682 INFO:teuthology.orchestra.run.smithi067.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 111 kB/s | 23 kB 00:00 2024-04-16T13:01:53.707 INFO:teuthology.orchestra.run.smithi067.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 130 kB/s | 19 kB 00:00 2024-04-16T13:01:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-04-16T13:01:53.808 INFO:teuthology.orchestra.run.smithi067.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 467 kB/s | 46 kB 00:00 2024-04-16T13:01:53.875 INFO:teuthology.orchestra.run.smithi067.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 790 kB/s | 79 kB 00:00 2024-04-16T13:01:53.913 INFO:teuthology.orchestra.run.smithi067.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 555 kB/s | 58 kB 00:00 2024-04-16T13:01:53.988 INFO:teuthology.orchestra.run.smithi067.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-16T13:01:54.014 INFO:teuthology.orchestra.run.smithi067.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-04-16T13:01:54.072 INFO:teuthology.orchestra.run.smithi067.stdout:(137/174): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-04-16T13:01:54.098 INFO:teuthology.orchestra.run.smithi067.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 831 kB/s | 90 kB 00:00 2024-04-16T13:01:54.123 INFO:teuthology.orchestra.run.smithi067.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-04-16T13:01:54.174 INFO:teuthology.orchestra.run.smithi067.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-04-16T13:01:54.207 INFO:teuthology.orchestra.run.smithi067.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-16T13:01:54.232 INFO:teuthology.orchestra.run.smithi067.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2024-04-16T13:01:54.274 INFO:teuthology.orchestra.run.smithi067.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-04-16T13:01:54.308 INFO:teuthology.orchestra.run.smithi067.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2024-04-16T13:01:54.341 INFO:teuthology.orchestra.run.smithi067.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-16T13:01:54.375 INFO:teuthology.orchestra.run.smithi067.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 899 kB/s | 90 kB 00:00 2024-04-16T13:01:54.426 INFO:teuthology.orchestra.run.smithi067.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-16T13:01:54.451 INFO:teuthology.orchestra.run.smithi067.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-04-16T13:01:54.484 INFO:teuthology.orchestra.run.smithi067.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-16T13:01:54.610 INFO:teuthology.orchestra.run.smithi067.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-16T13:01:54.818 INFO:teuthology.orchestra.run.smithi067.stdout:(151/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 9.4 MB/s | 3.1 MB 00:00 2024-04-16T13:01:54.885 INFO:teuthology.orchestra.run.smithi067.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 8.3 MB/s | 2.3 MB 00:00 2024-04-16T13:01:54.994 INFO:teuthology.orchestra.run.smithi067.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-04-16T13:01:55.019 INFO:teuthology.orchestra.run.smithi067.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 338 kB/s | 41 kB 00:00 2024-04-16T13:01:55.078 INFO:teuthology.orchestra.run.smithi067.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 3.0 MB/s | 248 kB 00:00 2024-04-16T13:01:55.112 INFO:teuthology.orchestra.run.smithi067.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.4 MB/s | 321 kB 00:00 2024-04-16T13:01:55.170 INFO:teuthology.orchestra.run.smithi067.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 808 kB/s | 71 kB 00:00 2024-04-16T13:01:55.195 INFO:teuthology.orchestra.run.smithi067.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 440 kB/s | 36 kB 00:00 2024-04-16T13:01:55.238 INFO:teuthology.orchestra.run.smithi067.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-16T13:01:55.288 INFO:teuthology.orchestra.run.smithi067.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.7 MB/s | 256 kB 00:00 2024-04-16T13:01:55.313 INFO:teuthology.orchestra.run.smithi067.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 311 kB/s | 23 kB 00:00 2024-04-16T13:01:55.338 INFO:teuthology.orchestra.run.smithi067.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-16T13:01:55.372 INFO:teuthology.orchestra.run.smithi067.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-16T13:01:55.397 INFO:teuthology.orchestra.run.smithi067.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-04-16T13:01:55.414 INFO:teuthology.orchestra.run.smithi067.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-16T13:01:55.439 INFO:teuthology.orchestra.run.smithi067.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 701 kB/s | 29 kB 00:00 2024-04-16T13:01:55.523 INFO:teuthology.orchestra.run.smithi067.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2024-04-16T13:01:55.615 INFO:teuthology.orchestra.run.smithi067.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-04-16T13:01:55.723 INFO:teuthology.orchestra.run.smithi067.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-16T13:01:55.757 INFO:teuthology.orchestra.run.smithi067.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.2 MB/s | 465 kB 00:00 2024-04-16T13:01:55.782 INFO:teuthology.orchestra.run.smithi067.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 540 kB/s | 31 kB 00:00 2024-04-16T13:01:55.829 INFO:teuthology.orchestra.run.smithi082.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 7.6 kB/s | 19 kB 00:02 2024-04-16T13:01:55.841 INFO:teuthology.orchestra.run.smithi067.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-04-16T13:01:55.866 INFO:teuthology.orchestra.run.smithi067.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 901 kB/s | 74 kB 00:00 2024-04-16T13:01:56.766 INFO:teuthology.orchestra.run.smithi067.stdout:(174/174): librados2-19.0.0-2868.gc3c87ed0.el9. 1.5 MB/s | 3.4 MB 00:02 2024-04-16T13:01:56.779 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-04-16T13:01:56.780 INFO:teuthology.orchestra.run.smithi067.stdout:Total 3.8 MB/s | 228 MB 01:00 2024-04-16T13:01:57.095 INFO:teuthology.orchestra.run.smithi082.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 20 kB/s | 26 kB 00:01 2024-04-16T13:01:57.904 INFO:teuthology.orchestra.run.smithi082.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 60 kB/s | 49 kB 00:00 2024-04-16T13:01:58.030 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-04-16T13:01:58.432 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-04-16T13:01:58.432 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-04-16T13:01:58.612 INFO:teuthology.orchestra.run.smithi082.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 95 kB/s | 67 kB 00:00 2024-04-16T13:01:59.462 INFO:teuthology.orchestra.run.smithi082.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 178 kB/s | 151 kB 00:00 2024-04-16T13:02:00.915 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-04-16T13:02:00.915 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-04-16T13:02:01.679 INFO:teuthology.orchestra.run.smithi082.stdout:(113/174): abseil-cpp-20211102.0-3.el9.x86_64.r 62 kB/s | 548 kB 00:08 2024-04-16T13:02:03.029 INFO:teuthology.orchestra.run.smithi082.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 235 kB/s | 838 kB 00:03 2024-04-16T13:02:03.262 INFO:teuthology.orchestra.run.smithi082.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 187 kB/s | 43 kB 00:00 2024-04-16T13:02:03.429 INFO:teuthology.orchestra.run.smithi082.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 194 kB/s | 32 kB 00:00 2024-04-16T13:02:03.871 INFO:teuthology.orchestra.run.smithi082.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 34 kB/s | 15 kB 00:00 2024-04-16T13:02:04.979 INFO:teuthology.orchestra.run.smithi082.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 155 kB/s | 172 kB 00:01 2024-04-16T13:02:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:(119/174): python3-asyncssh-2.13.2-5.el9.noarch 158 kB/s | 548 kB 00:03 2024-04-16T13:02:06.671 INFO:teuthology.orchestra.run.smithi082.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 212 kB/s | 358 kB 00:01 2024-04-16T13:02:06.855 INFO:teuthology.orchestra.run.smithi082.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 193 kB/s | 35 kB 00:00 2024-04-16T13:02:07.613 INFO:teuthology.orchestra.run.smithi082.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 122 kB/s | 303 kB 00:02 2024-04-16T13:02:07.647 INFO:teuthology.orchestra.run.smithi082.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 256 kB/s | 203 kB 00:00 2024-04-16T13:02:08.197 INFO:teuthology.orchestra.run.smithi082.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 263 kB/s | 144 kB 00:00 2024-04-16T13:02:08.310 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-04-16T13:02:08.428 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T13:02:08.473 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T13:02:08.502 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T13:02:08.548 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T13:02:08.645 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T13:02:08.750 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T13:02:08.804 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T13:02:08.835 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T13:02:08.922 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T13:02:09.006 INFO:teuthology.orchestra.run.smithi082.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 13 kB/s | 11 kB 00:00 2024-04-16T13:02:09.181 INFO:teuthology.orchestra.run.smithi082.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 101 kB/s | 18 kB 00:00 2024-04-16T13:02:09.339 INFO:teuthology.orchestra.run.smithi082.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 147 kB/s | 23 kB 00:00 2024-04-16T13:02:09.346 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T13:02:09.375 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:02:09.506 INFO:teuthology.orchestra.run.smithi082.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 117 kB/s | 19 kB 00:00 2024-04-16T13:02:09.526 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:02:09.559 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:02:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:02:09.682 INFO:teuthology.orchestra.run.smithi082.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 113 kB/s | 20 kB 00:00 2024-04-16T13:02:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T13:02:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T13:02:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T13:02:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T13:02:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:02:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:02:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T13:02:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T13:02:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T13:02:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T13:02:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T13:02:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T13:02:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T13:02:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T13:02:11.274 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T13:02:11.515 INFO:teuthology.orchestra.run.smithi082.stdout:(130/174): libarrow-9.0.0-10.el9.x86_64.rpm 253 kB/s | 4.4 MB 00:17 2024-04-16T13:02:11.641 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T13:02:11.728 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T13:02:11.732 INFO:teuthology.orchestra.run.smithi082.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 214 kB/s | 46 kB 00:00 2024-04-16T13:02:11.895 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:11.961 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:12.294 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:12.374 INFO:teuthology.orchestra.run.smithi082.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 123 kB/s | 79 kB 00:00 2024-04-16T13:02:12.484 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T13:02:12.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T13:02:12.650 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T13:02:12.687 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T13:02:12.733 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T13:02:12.765 INFO:teuthology.orchestra.run.smithi082.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 148 kB/s | 58 kB 00:00 2024-04-16T13:02:12.847 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T13:02:12.908 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T13:02:12.957 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T13:02:13.058 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T13:02:13.126 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T13:02:13.196 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T13:02:13.246 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T13:02:13.285 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T13:02:13.411 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T13:02:13.448 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T13:02:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T13:02:13.539 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T13:02:13.664 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T13:02:13.728 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T13:02:13.840 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T13:02:14.021 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T13:02:14.078 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T13:02:14.700 INFO:teuthology.orchestra.run.smithi082.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 141 kB/s | 272 kB 00:01 2024-04-16T13:02:14.800 INFO:teuthology.orchestra.run.smithi082.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-04-16T13:02:14.835 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T13:02:14.891 INFO:teuthology.orchestra.run.smithi082.stdout:(136/174): python3-kubernetes-26.1.0-2.el9.noar 201 kB/s | 1.0 MB 00:05 2024-04-16T13:02:14.928 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T13:02:15.037 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T13:02:15.042 INFO:teuthology.orchestra.run.smithi082.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 188 kB/s | 28 kB 00:00 2024-04-16T13:02:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T13:02:15.120 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T13:02:15.190 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T13:02:15.209 INFO:teuthology.orchestra.run.smithi082.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 220 kB/s | 90 kB 00:00 2024-04-16T13:02:15.235 INFO:teuthology.orchestra.run.smithi082.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 161 kB/s | 31 kB 00:00 2024-04-16T13:02:15.269 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T13:02:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T13:02:15.375 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T13:02:15.469 INFO:teuthology.orchestra.run.smithi082.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 254 kB/s | 59 kB 00:00 2024-04-16T13:02:15.627 INFO:teuthology.orchestra.run.smithi082.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 227 kB/s | 36 kB 00:00 2024-04-16T13:02:15.835 INFO:teuthology.orchestra.run.smithi082.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 246 kB/s | 51 kB 00:00 2024-04-16T13:02:15.845 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T13:02:16.064 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T13:02:16.146 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T13:02:16.220 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T13:02:16.235 INFO:teuthology.orchestra.run.smithi082.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 184 kB/s | 188 kB 00:01 2024-04-16T13:02:16.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T13:02:16.491 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T13:02:16.561 INFO:teuthology.orchestra.run.smithi082.stdout:(144/174): python3-websocket-client-1.2.3-2.el9 276 kB/s | 90 kB 00:00 2024-04-16T13:02:16.568 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T13:02:16.586 INFO:teuthology.orchestra.run.smithi082.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 306 kB/s | 230 kB 00:00 2024-04-16T13:02:16.666 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T13:02:16.703 INFO:teuthology.orchestra.run.smithi082.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-04-16T13:02:16.708 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T13:02:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T13:02:16.817 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T13:02:16.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T13:02:16.909 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T13:02:16.958 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T13:02:17.144 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T13:02:17.212 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T13:02:17.236 INFO:teuthology.orchestra.run.smithi082.stdout:(147/174): re2-20211101-3.el9.x86_64.rpm 360 kB/s | 192 kB 00:00 2024-04-16T13:02:17.256 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T13:02:17.306 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T13:02:17.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T13:02:17.547 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T13:02:17.596 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T13:02:17.631 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T13:02:17.645 INFO:teuthology.orchestra.run.smithi082.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 394 kB/s | 427 kB 00:01 2024-04-16T13:02:17.663 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T13:02:17.840 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T13:02:18.020 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T13:02:18.156 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T13:02:18.206 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T13:02:18.277 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T13:02:18.355 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T13:02:18.370 INFO:teuthology.orchestra.run.smithi082.stdout:(149/174): python3-grpcio-1.46.7-10.el9.x86_64. 194 kB/s | 2.0 MB 00:10 2024-04-16T13:02:18.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T13:02:18.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T13:02:18.831 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T13:02:18.880 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T13:02:18.929 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T13:02:18.967 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T13:02:19.017 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T13:02:19.059 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T13:02:19.104 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T13:02:19.151 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T13:02:19.194 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T13:02:19.303 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T13:02:19.359 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T13:02:19.393 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T13:02:19.449 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T13:02:19.488 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T13:02:19.596 INFO:teuthology.orchestra.run.smithi082.stdout:(150/174): librbd1-19.0.0-2868.gc3c87ed0.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-04-16T13:02:19.636 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T13:02:19.670 INFO:teuthology.orchestra.run.smithi082.stdout:(151/174): librados2-19.0.0-2868.gc3c87ed0.el9. 1.7 MB/s | 3.4 MB 00:02 2024-04-16T13:02:19.746 INFO:teuthology.orchestra.run.smithi082.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-04-16T13:02:19.752 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T13:02:19.802 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T13:02:19.813 INFO:teuthology.orchestra.run.smithi082.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 14 MB/s | 1.8 MB 00:00 2024-04-16T13:02:19.839 INFO:teuthology.orchestra.run.smithi082.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 521 kB/s | 41 kB 00:00 2024-04-16T13:02:19.839 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T13:02:19.871 INFO:teuthology.orchestra.run.smithi082.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-04-16T13:02:19.890 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T13:02:19.905 INFO:teuthology.orchestra.run.smithi082.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2024-04-16T13:02:19.956 INFO:teuthology.orchestra.run.smithi082.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 894 kB/s | 71 kB 00:00 2024-04-16T13:02:19.981 INFO:teuthology.orchestra.run.smithi082.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 490 kB/s | 36 kB 00:00 2024-04-16T13:02:20.028 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T13:02:20.065 INFO:teuthology.orchestra.run.smithi082.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-04-16T13:02:20.095 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T13:02:20.098 INFO:teuthology.orchestra.run.smithi082.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-04-16T13:02:20.132 INFO:teuthology.orchestra.run.smithi082.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 349 kB/s | 23 kB 00:00 2024-04-16T13:02:20.157 INFO:teuthology.orchestra.run.smithi082.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-16T13:02:20.191 INFO:teuthology.orchestra.run.smithi082.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-16T13:02:20.233 INFO:teuthology.orchestra.run.smithi082.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-04-16T13:02:20.266 INFO:teuthology.orchestra.run.smithi082.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 857 kB/s | 64 kB 00:00 2024-04-16T13:02:20.291 INFO:teuthology.orchestra.run.smithi082.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 504 kB/s | 29 kB 00:00 2024-04-16T13:02:20.442 INFO:teuthology.orchestra.run.smithi082.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 6.9 MB/s | 1.2 MB 00:00 2024-04-16T13:02:20.508 INFO:teuthology.orchestra.run.smithi082.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2024-04-16T13:02:20.584 INFO:teuthology.orchestra.run.smithi082.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 6.1 MB/s | 465 kB 00:00 2024-04-16T13:02:20.634 INFO:teuthology.orchestra.run.smithi082.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 634 kB/s | 31 kB 00:00 2024-04-16T13:02:20.743 INFO:teuthology.orchestra.run.smithi082.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-04-16T13:02:20.835 INFO:teuthology.orchestra.run.smithi082.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 5.8 MB/s | 2.3 MB 00:00 2024-04-16T13:02:20.861 INFO:teuthology.orchestra.run.smithi082.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 640 kB/s | 74 kB 00:00 2024-04-16T13:02:20.977 INFO:teuthology.orchestra.run.smithi082.stdout:(174/174): thrift-0.15.0-2.el9.x86_64.rpm 433 kB/s | 1.6 MB 00:03 2024-04-16T13:02:20.991 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-16T13:02:20.992 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.9 MB/s | 228 MB 01:19 2024-04-16T13:02:21.081 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T13:02:21.135 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T13:02:21.160 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T13:02:21.225 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T13:02:21.341 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T13:02:21.748 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T13:02:22.035 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T13:02:22.066 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T13:02:22.116 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-16T13:02:22.201 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T13:02:22.498 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-16T13:02:22.498 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-16T13:02:23.107 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T13:02:23.252 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T13:02:24.862 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-16T13:02:24.863 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-16T13:02:24.883 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T13:02:24.977 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T13:02:25.015 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T13:02:25.045 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T13:02:25.077 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T13:02:25.459 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T13:02:25.492 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T13:02:25.597 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T13:02:25.632 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T13:02:25.688 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T13:02:26.249 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T13:02:26.278 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T13:02:26.370 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T13:02:26.419 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T13:02:29.119 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:29.177 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:29.857 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:29.905 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T13:02:30.065 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T13:02:30.065 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T13:02:30.065 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T13:02:30.066 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:30.114 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T13:02:32.032 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-16T13:02:32.141 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-16T13:02:32.180 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-16T13:02:32.219 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T13:02:32.264 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-16T13:02:32.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-16T13:02:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-16T13:02:32.522 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-16T13:02:32.551 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-16T13:02:32.636 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-16T13:02:33.034 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-16T13:02:33.091 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:02:33.241 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:02:33.275 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:02:33.397 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:02:33.432 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T13:02:33.491 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-16T13:02:33.780 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-16T13:02:33.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-16T13:02:33.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:02:33.997 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:02:34.025 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T13:02:34.123 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 17/198 2024-04-16T13:02:34.168 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-16T13:02:34.193 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T13:02:34.257 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-16T13:02:34.556 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T13:02:34.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-16T13:02:34.694 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-16T13:02:35.020 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-16T13:02:35.185 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T13:02:35.272 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-16T13:02:35.459 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:35.537 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:35.887 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-16T13:02:36.081 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-16T13:02:36.208 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-16T13:02:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-16T13:02:36.289 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-16T13:02:36.351 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-16T13:02:36.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-16T13:02:36.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-16T13:02:36.594 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-16T13:02:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-16T13:02:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-16T13:02:36.804 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-16T13:02:36.842 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-16T13:02:36.877 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-16T13:02:36.989 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-16T13:02:37.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 39/198 2024-04-16T13:02:37.084 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 40/198 2024-04-16T13:02:37.121 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 41/198 2024-04-16T13:02:37.240 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-16T13:02:37.301 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-16T13:02:37.400 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-16T13:02:37.588 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-16T13:02:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-16T13:02:38.353 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-16T13:02:38.440 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-16T13:02:38.552 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-16T13:02:38.600 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T13:02:38.627 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-16T13:02:38.683 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-16T13:02:38.749 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-16T13:02:38.800 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 53/198 2024-04-16T13:02:38.842 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-16T13:02:39.343 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-16T13:02:39.541 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-16T13:02:39.655 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-16T13:02:39.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-16T13:02:39.909 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-16T13:02:39.994 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-16T13:02:40.069 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-16T13:02:40.165 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-16T13:02:40.201 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-16T13:02:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-16T13:02:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-16T13:02:40.349 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-16T13:02:40.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-16T13:02:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-16T13:02:40.670 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-16T13:02:40.730 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-16T13:02:40.769 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-16T13:02:40.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-16T13:02:40.983 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-16T13:02:41.016 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-16T13:02:41.062 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-16T13:02:41.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-16T13:02:41.132 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-16T13:02:41.291 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-16T13:02:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-16T13:02:41.617 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-16T13:02:41.668 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-16T13:02:41.730 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-16T13:02:41.811 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-16T13:02:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-16T13:02:42.106 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-16T13:02:42.276 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-16T13:02:42.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-16T13:02:42.371 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-16T13:02:42.409 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T13:02:42.445 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-16T13:02:42.487 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-16T13:02:42.544 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-16T13:02:42.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-16T13:02:42.663 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-16T13:02:42.795 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-16T13:02:42.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-16T13:02:42.887 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-16T13:02:42.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-16T13:02:42.997 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-16T13:02:43.139 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-16T13:02:43.253 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-16T13:02:43.310 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-16T13:02:43.346 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-16T13:02:43.404 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-16T13:02:43.551 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-16T13:02:43.638 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T13:02:43.638 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-04-16T13:02:43.639 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:43.642 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-16T13:02:43.890 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T13:02:43.941 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T13:02:43.941 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:43.941 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T13:02:43.941 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-16T13:02:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-16T13:02:44.703 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-16T13:02:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-16T13:02:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-16T13:02:44.903 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-16T13:02:45.127 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-16T13:02:45.159 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-16T13:02:45.253 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-16T13:02:45.621 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T13:02:45.708 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T13:02:45.708 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:45.709 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T13:02:45.709 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T13:02:45.709 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T13:02:45.709 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:45.963 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T13:02:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T13:02:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T13:02:46.044 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T13:02:46.044 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T13:02:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-16T13:02:46.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-16T13:02:46.555 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T13:02:46.625 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T13:02:46.625 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:46.626 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T13:02:46.626 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T13:02:46.626 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T13:02:46.626 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:46.740 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T13:02:47.318 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T13:02:47.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T13:02:47.401 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T13:02:47.506 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T13:02:47.536 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T13:02:47.701 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-16T13:02:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-16T13:02:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-16T13:02:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-16T13:02:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-16T13:02:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-16T13:02:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T13:02:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 124/198 2024-04-16T13:02:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 125/198 2024-04-16T13:02:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-16T13:02:48.899 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T13:02:48.938 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T13:02:49.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-16T13:02:49.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T13:02:49.165 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 128/198 2024-04-16T13:02:49.201 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 129/198 2024-04-16T13:02:50.095 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T13:02:50.122 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T13:02:50.273 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T13:02:50.453 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T13:02:50.482 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T13:02:50.559 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:50.616 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T13:02:50.657 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T13:02:50.719 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T13:02:51.745 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T13:02:51.777 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T13:02:51.815 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:51.849 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T13:02:51.850 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:51.850 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T13:02:51.850 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T13:02:51.850 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T13:02:51.850 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:51.902 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T13:02:51.975 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T13:02:51.975 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:51.976 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T13:02:51.976 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:52.053 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T13:02:52.132 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 130/198 2024-04-16T13:02:52.512 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T13:02:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T13:02:52.588 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T13:02:52.589 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:02:52.589 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T13:02:52.589 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T13:02:52.589 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T13:02:52.589 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:02:52.745 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 131/198 2024-04-16T13:02:52.746 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T13:02:52.746 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T13:02:52.746 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:02:52.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T13:02:57.795 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T13:02:57.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T13:02:57.892 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T13:02:57.929 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T13:02:58.209 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T13:02:58.335 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T13:02:58.385 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T13:02:58.444 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T13:02:58.501 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T13:02:58.546 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T13:02:58.589 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T13:02:58.624 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T13:02:58.676 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T13:02:58.757 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T13:02:58.882 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T13:02:58.933 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T13:02:59.874 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:02:59.922 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:02:59.982 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:03:01.400 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T13:03:01.493 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T13:03:01.552 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T13:03:01.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T13:03:01.722 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T13:03:01.756 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T13:03:01.790 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T13:03:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T13:03:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T13:03:01.978 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T13:03:02.027 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T13:03:02.028 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T13:03:02.166 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T13:03:02.211 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T13:03:02.263 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T13:03:02.326 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T13:03:02.363 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T13:03:02.435 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T13:03:02.518 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T13:03:02.567 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T13:03:02.601 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T13:03:02.634 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T13:03:02.668 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T13:03:02.701 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T13:03:02.740 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:02.740 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:03.085 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:03.085 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T13:03:03.215 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T13:03:03.267 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T13:03:03.304 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T13:03:03.357 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T13:03:03.397 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T13:03:03.522 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T13:03:03.772 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T13:03:03.772 INFO:teuthology.orchestra.run.smithi067.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-16T13:03:03.772 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 132/198 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-16T13:03:05.512 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:05.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T13:03:05.759 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 133/198 2024-04-16T13:03:05.760 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:05.760 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T13:03:05.760 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T13:03:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 134/198 2024-04-16T13:03:07.423 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:07.423 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T13:03:07.423 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T13:03:07.423 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T13:03:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T13:03:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 135/198 2024-04-16T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T13:03:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 136/198 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T13:03:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-16T13:03:08.829 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T13:03:08.829 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T13:03:08.830 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T13:03:08.831 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T13:03:08.832 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T13:03:08.832 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T13:03:08.832 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T13:03:08.849 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T13:03:08.850 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T13:03:08.851 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T13:03:08.852 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T13:03:08.853 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T13:03:08.854 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T13:03:08.855 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T13:03:08.856 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T13:03:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T13:03:08.858 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T13:03:08.859 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T13:03:08.860 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T13:03:08.861 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T13:03:08.862 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T13:03:09.069 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T13:03:09.107 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 138/198 2024-04-16T13:03:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 139/198 2024-04-16T13:03:09.258 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 140/198 2024-04-16T13:03:09.286 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T13:03:10.573 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 141/198 2024-04-16T13:03:10.613 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T13:03:11.308 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T13:03:11.308 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T13:03:11.309 INFO:teuthology.orchestra.run.smithi067.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.310 INFO:teuthology.orchestra.run.smithi067.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.311 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.312 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: jq-1.6-16.el9.x86_64 2024-04-16T13:03:11.313 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.314 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:11.315 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T13:03:11.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T13:03:11.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T13:03:11.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T13:03:11.319 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T13:03:11.320 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.321 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T13:03:11.322 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T13:03:11.323 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:11.323 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-04-16T13:03:11.717 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 142/198 2024-04-16T13:03:11.746 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T13:03:11.888 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 143/198 2024-04-16T13:03:12.077 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 144/198 2024-04-16T13:03:12.115 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T13:03:12.182 DEBUG:teuthology.parallel:result is None 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 145/198 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T13:03:12.201 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:12.266 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T13:03:12.304 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 146/198 2024-04-16T13:03:12.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 147/198 2024-04-16T13:03:13.349 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-16T13:03:13.385 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T13:03:13.451 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 149/198 2024-04-16T13:03:13.451 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:13.451 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T13:03:13.451 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T13:03:13.451 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T13:03:13.452 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:13.501 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T13:03:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 150/198 2024-04-16T13:03:13.570 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:13.570 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T13:03:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:13.628 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:03:13.698 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:03:13.698 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:13.699 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-16T13:03:13.699 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T13:03:13.699 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-16T13:03:13.699 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T13:03:14.129 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 152/198 2024-04-16T13:03:14.129 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T13:03:14.129 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T13:03:14.129 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T13:03:14.130 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T13:03:14.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:19.038 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T13:03:19.094 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 154/198 2024-04-16T13:03:19.135 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 155/198 2024-04-16T13:03:19.173 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-16T13:03:19.431 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 157/198 2024-04-16T13:03:19.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-16T13:03:19.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 159/198 2024-04-16T13:03:19.656 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-16T13:03:19.717 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-16T13:03:19.763 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-16T13:03:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 163/198 2024-04-16T13:03:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-16T13:03:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-16T13:03:19.969 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-16T13:03:20.074 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-16T13:03:20.110 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-16T13:03:20.987 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:03:21.046 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:03:21.102 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-16T13:03:22.463 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 170/198 2024-04-16T13:03:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-16T13:03:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-16T13:03:22.736 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-16T13:03:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-16T13:03:22.798 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-16T13:03:22.858 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-16T13:03:22.901 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-16T13:03:22.901 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T13:03:23.046 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-16T13:03:23.087 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-16T13:03:23.088 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T13:03:23.208 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-16T13:03:23.254 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-16T13:03:23.299 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-16T13:03:23.332 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-16T13:03:23.365 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-16T13:03:23.435 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-16T13:03:23.513 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-16T13:03:23.570 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-16T13:03:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-16T13:03:23.637 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-16T13:03:23.670 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-16T13:03:23.702 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-16T13:03:23.739 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:23.739 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:24.062 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-16T13:03:24.062 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T13:03:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-16T13:03:24.252 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-16T13:03:24.281 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-16T13:03:24.317 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-16T13:03:24.358 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-16T13:03:24.477 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T13:03:24.728 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-16T13:03:24.728 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-16T13:03:24.728 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:30.168 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 1/198 2024-04-16T13:03:30.168 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 3/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 4/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2868.gc3c87 5/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 6/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 7/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 8/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 9/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 10/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 11/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 12/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 13/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 14/198 2024-04-16T13:03:30.169 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_ 15/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 16/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 17/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_6 18/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86 19/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 20/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el 21/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9. 22/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_6 23/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 24/198 2024-04-16T13:03:30.170 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 25/198 2024-04-16T13:03:30.186 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 26/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 27/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 28/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 29/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0. 30/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noa 31/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.n 32/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c 33/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el 34/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 35/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.e 36/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 37/198 2024-04-16T13:03:30.187 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 38/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 39/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-16T13:03:30.188 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-16T13:03:30.189 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-16T13:03:30.190 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-16T13:03:30.191 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-16T13:03:30.192 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-16T13:03:30.193 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-16T13:03:30.194 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-16T13:03:30.195 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 151/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 153/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-16T13:03:30.196 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-16T13:03:30.197 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-16T13:03:30.198 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-16T13:03:30.199 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: acl-2.3.1-4.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-16T13:03:32.690 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:32.691 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.692 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.693 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-2868.gc3c87ed0.el9.noarch 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-16T13:03:32.694 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-16.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T13:03:32.695 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T13:03:32.696 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T13:03:32.697 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T13:03:32.698 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T13:03:32.699 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T13:03:32.700 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T13:03:32.701 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-2868.gc3c87ed0.el9.x86_64 2024-04-16T13:03:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:32.703 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-16T13:03:33.461 DEBUG:teuthology.parallel:result is None 2024-04-16T13:03:33.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T13:03:33.680 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T13:03:33.752 INFO:teuthology.orchestra.run.smithi067.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T13:03:33.753 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T13:03:33.753 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T13:03:33.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f 2024-04-16T13:03:33.891 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T13:03:33.943 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-2868.gc3c87ed0.el9 2024-04-16T13:03:33.943 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2868.gc3c87ed0.el9 2024-04-16T13:03:33.943 INFO:teuthology.task.install:The correct ceph version 19.0.0-2868.gc3c87ed0 is installed. 2024-04-16T13:03:33.945 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T13:03:33.945 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:33.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T13:03:34.057 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:34.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T13:03:34.133 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T13:03:34.133 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:34.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T13:03:34.241 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T13:03:34.343 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:34.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T13:03:34.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T13:03:34.532 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T13:03:34.533 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:34.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T13:03:34.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T13:03:34.789 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:34.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T13:03:34.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T13:03:34.976 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T13:03:34.976 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:34.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T13:03:35.083 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T13:03:35.174 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:35.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T13:03:35.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T13:03:35.357 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T13:03:35.448 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T13:03:35.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-04-16T13:03:35.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-04-16T13:03:35.550 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T13:03:35.550 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T13:03:35.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T13:03:35.649 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T13:03:35.649 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T13:03:35.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T13:03:35.757 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-16T13:03:35.757 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-16T13:03:35.757 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-16T13:03:35.757 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:35.757 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T13:03:35.814 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T13:03:36.096 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T13:03:36.197 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:36.197 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-16T13:03:36.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-16T13:03:36.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-16T13:03:36.563 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-16T13:03:36.563 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T13:03:36.563 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149', 'branch': 'wip-lusov-shared-log-segment', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7658149', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-shared-log-segment'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-shared-log-segment', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2402, 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-shared-log-segment', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtca6e1dodxY/L0I7XQ5fFK8sZMH3qsYD4wbgQfPYFRr2+Rwqx99pj26svM2NknK6Hd7/LT8w2+vX1gzuP/hZw=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLI73+JI8kvs0vsDCgI+UPQh+ABXeZ64+J33eiEFv6wO5JJV2808YLTlAmPm4iKRLV8AQXiryDQCzCuiYhr0m0o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_12:36:42', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T13:03:36.564 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T13:03:36.571 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-16T13:03:36.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T13:03:36.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T13:03:36.736 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:36.736 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T13:03:36.794 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T13:03:36.794 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-04-16T13:03:36.851 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T13:03:36.851 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:36.851 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-16 13:03:04.221280167 +0000 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-16 12:59:52.268269542 +0000 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-16 12:59:52.268269542 +0000 2024-04-16T13:03:36.852 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-16 12:59:52.268269542 +0000 2024-04-16T13:03:36.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T13:03:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-16T13:03:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-16T13:03:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.00036099 s, 1.4 MB/s 2024-04-16T13:03:36.944 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T13:03:36.999 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-04-16T13:03:37.048 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T13:03:37.048 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:37.048 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-16T13:03:37.048 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:37.048 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:37.049 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-16 13:03:04.222280145 +0000 2024-04-16T13:03:37.049 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-16 12:59:52.874256382 +0000 2024-04-16T13:03:37.049 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-16 12:59:52.874256382 +0000 2024-04-16T13:03:37.049 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-16 12:59:52.874256382 +0000 2024-04-16T13:03:37.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T13:03:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-16T13:03:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-16T13:03:37.141 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000346543 s, 1.5 MB/s 2024-04-16T13:03:37.145 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T13:03:37.206 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-04-16T13:03:37.265 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T13:03:37.265 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:37.265 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-16T13:03:37.265 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:37.266 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:37.266 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-16 13:03:04.222280145 +0000 2024-04-16T13:03:37.266 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-16 12:59:53.491242984 +0000 2024-04-16T13:03:37.266 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-16 12:59:53.491242984 +0000 2024-04-16T13:03:37.266 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-16 12:59:53.491242984 +0000 2024-04-16T13:03:37.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T13:03:37.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-16T13:03:37.368 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-16T13:03:37.368 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000339513 s, 1.5 MB/s 2024-04-16T13:03:37.373 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T13:03:37.430 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-04-16 13:03:04.223280123 +0000 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-04-16 12:59:54.126229195 +0000 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-04-16 12:59:54.126229195 +0000 2024-04-16T13:03:37.483 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-04-16 12:59:54.126229195 +0000 2024-04-16T13:03:37.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T13:03:37.575 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-04-16T13:03:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-04-16T13:03:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000313159 s, 1.6 MB/s 2024-04-16T13:03:37.580 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T13:03:37.641 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:37.641 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:37.641 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T13:03:37.700 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T13:03:37.700 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-16T13:03:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T13:03:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:37.751 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-16T13:03:37.751 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:37.751 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:37.752 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-16 13:03:25.195950962 +0000 2024-04-16T13:03:37.752 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-16 12:59:40.098012875 +0000 2024-04-16T13:03:37.752 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-16 12:59:40.098012875 +0000 2024-04-16T13:03:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-16 12:59:40.098012875 +0000 2024-04-16T13:03:37.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T13:03:37.839 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-16T13:03:37.839 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-16T13:03:37.839 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000370273 s, 1.4 MB/s 2024-04-16T13:03:37.843 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T13:03:37.894 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-16 13:03:25.195950962 +0000 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-16 12:59:40.776999901 +0000 2024-04-16T13:03:37.941 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-16 12:59:40.776999901 +0000 2024-04-16T13:03:37.942 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-16 12:59:40.776999901 +0000 2024-04-16T13:03:37.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T13:03:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-16T13:03:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-16T13:03:38.075 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00031079 s, 1.6 MB/s 2024-04-16T13:03:38.079 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T13:03:38.134 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-16T13:03:38.184 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T13:03:38.184 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-16 13:03:25.196950943 +0000 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-16 12:59:41.356988818 +0000 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-16 12:59:41.356988818 +0000 2024-04-16T13:03:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-16 12:59:41.356988818 +0000 2024-04-16T13:03:38.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T13:03:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-16T13:03:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-16T13:03:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00031215 s, 1.6 MB/s 2024-04-16T13:03:38.271 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T13:03:38.323 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-16 13:03:25.197950924 +0000 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-16 12:59:41.937977716 +0000 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-16 12:59:41.937977716 +0000 2024-04-16T13:03:38.372 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-04-16 12:59:41.937977716 +0000 2024-04-16T13:03:38.373 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T13:03:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-16T13:03:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-16T13:03:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000333559 s, 1.5 MB/s 2024-04-16T13:03:38.463 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T13:03:38.521 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:38.521 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T13:03:38.522 INFO:tasks.ceph:Generating config... 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] debug client = 20 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] debug ms = 1 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] pid file = 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-16T13:03:38.523 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-16T13:03:38.523 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-16T13:03:38.523 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-16T13:03:38.523 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] mds debug zombie log segments = True 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T13:03:38.524 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T13:03:38.525 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T13:03:38.525 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-16T13:03:38.525 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-16T13:03:38.525 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-16T13:03:38.526 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-16T13:03:38.526 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-16T13:03:38.526 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-16T13:03:38.526 INFO:tasks.ceph:Setting up mon.a... 2024-04-16T13:03:38.526 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-16T13:03:38.682 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-04-16T13:03:38.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-16T13:03:38.840 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T13:03:38.933 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.b', '172.21.15.82'), ('mon.c', '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]')] 2024-04-16T13:03:38.933 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds debug zombie log segments': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-16T13:03:38.934 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:38.934 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T13:03:38.985 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --add b 172.21.15.82 --addv c '[v2:172.21.15.82:3301,v1:172.21.15.82:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid dc50e499-96cc-43d1-bcde-ee8dfcd0732f 2024-04-16T13:03:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-04-16T13:03:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-04-16T13:03:39.140 INFO:teuthology.orchestra.run.smithi067.stdout:fsid dc50e499-96cc-43d1-bcde-ee8dfcd0732f 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-04-16T13:03:39.139713+0000 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-04-16T13:03:39.139713+0000 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.b 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] mon.c 2024-04-16T13:03:39.141 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-16T13:03:39.144 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T13:03:39.196 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc50e499-96cc-43d1-bcde-ee8dfcd0732f... 2024-04-16T13:03:39.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T13:03:39.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-04-16T13:03:39.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-04-16T13:03:39.378 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.379 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = dc50e499-96cc-43d1-bcde-ee8dfcd0732f 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.380 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-04-16T13:03:39.381 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T13:03:39.382 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.383 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.384 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon down mkfs grace = 300 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-04-16T13:03:39.385 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-16T13:03:39.386 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug zombie log segments = True 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-04-16T13:03:39.387 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-04-16T13:03:39.388 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-04-16T13:03:39.389 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.67,172.21.15.82,[v2:172.21.15.82:3301,v1:172.21.15.82:6790]" 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-04-16T13:03:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = dc50e499-96cc-43d1-bcde-ee8dfcd0732f 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug trim objects = true 2024-04-16T13:03:39.391 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-04-16T13:03:39.392 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 20 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 20 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 10 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-04-16T13:03:39.393 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-04-16T13:03:39.394 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.395 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: mon down mkfs grace = 300 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-04-16T13:03:39.396 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug zombie log segments = True 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-04-16T13:03:39.397 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-04-16T13:03:39.398 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-04-16T13:03:39.398 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-04-16T13:03:39.398 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-04-16T13:03:39.425 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-16T13:03:39.425 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-16T13:03:39.572 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T13:03:39.572 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:39.572 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-16T13:03:39.622 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:39.622 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-16T13:03:39.672 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:03:39.673 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:39.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T13:03:39.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T13:03:39.824 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:03:39.824 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:39.879 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:03:39.879 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:39.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-16T13:03:39.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-16T13:03:40.027 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:03:40.027 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:40.124 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T13:03:40.124 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T13:03:40.125 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T13:03:40.325 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-16T13:03:40.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T13:03:40.525 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-16T13:03:40.536 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T13:03:40.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T13:03:40.733 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-16T13:03:40.743 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-16T13:03:40.847 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T13:03:41.034 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-16T13:03:41.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-16T13:03:41.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T13:03:41.328 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-16T13:03:41.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-16T13:03:41.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T13:03:41.606 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-16T13:03:41.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-16T13:03:41.702 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T13:03:41.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T13:03:41.839 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-16T13:03:41.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-16T13:03:42.026 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-16T13:03:42.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T13:03:42.215 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-16T13:03:42.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-16T13:03:42.392 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-16T13:03:42.444 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T13:03:42.444 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-16T13:03:42.444 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-16T13:03:42.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:42.552 INFO:tasks.ceph:role: osd.0 2024-04-16T13:03:42.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:03:42.552 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T13:03:42.656 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:03:42.657 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:03:43.064 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-16T13:03:43.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-16T13:03:43.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-16T13:03:43.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-16T13:03:43.350 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-16T13:03:43.452 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:43.452 INFO:tasks.ceph:role: osd.1 2024-04-16T13:03:43.453 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:03:43.453 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:03:43.558 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:03:43.918 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-16T13:03:43.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-16T13:03:43.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-16T13:03:44.067 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-16T13:03:44.160 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-16T13:03:44.256 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:44.256 INFO:tasks.ceph:role: osd.2 2024-04-16T13:03:44.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:03:44.256 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:03:44.361 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:03:44.362 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:03:44.362 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:03:44.362 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:03:44.362 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:03:44.785 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-16T13:03:44.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-16T13:03:44.793 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-16T13:03:44.958 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-16T13:03:45.069 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-16T13:03:45.175 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:45.175 INFO:tasks.ceph:role: osd.3 2024-04-16T13:03:45.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:03:45.175 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T13:03:45.279 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:03:45.280 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:03:45.640 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-04-16T13:03:45.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-04-16T13:03:45.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-16T13:03:45.765 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-16T13:03:45.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:46.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.020+0000 7fbf92c0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-16T13:03:46.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.021+0000 7fbf92c0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-16T13:03:46.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.021+0000 7fbf92c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T13:03:46.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.021+0000 7fbf92c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T13:03:46.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.021+0000 7fbf92c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-16T13:03:46.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:46.025+0000 7fbf92c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-16T13:03:49.021 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T13:03:49.127 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:49.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.270+0000 7fa734415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-16T13:03:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.271+0000 7fa734415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-16T13:03:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.271+0000 7fa734415640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T13:03:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.271+0000 7fa734415640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T13:03:49.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.271+0000 7fa734415640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-16T13:03:49.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:49.274+0000 7fa734415640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-16T13:03:52.255 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T13:03:52.358 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:52.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.498+0000 7f887ea1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-16T13:03:52.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.499+0000 7f887ea1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-16T13:03:52.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.499+0000 7f887ea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T13:03:52.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.499+0000 7f887ea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T13:03:52.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.499+0000 7f887ea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-16T13:03:52.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:52.501+0000 7f887ea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-16T13:03:55.715 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T13:03:55.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:03:55.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.961+0000 7f1f43e10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-16T13:03:55.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.962+0000 7f1f43e10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-16T13:03:55.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.962+0000 7f1f43e10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T13:03:55.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.962+0000 7f1f43e10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T13:03:55.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.962+0000 7f1f43e10640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-16T13:03:55.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:03:55.965+0000 7f1f43e10640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-16T13:03:59.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T13:03:59.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-16T13:03:59.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T13:03:59.387 INFO:tasks.ceph:role: osd.4 2024-04-16T13:03:59.387 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:03:59.387 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:03:59.489 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:03:59.490 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:03:59.490 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:03:59.490 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:03:59.490 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:03:59.905 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-04-16T13:03:59.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-16T13:03:59.914 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-16T13:04:00.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-16T13:04:00.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-16T13:04:00.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T13:04:00.253 INFO:tasks.ceph:role: osd.5 2024-04-16T13:04:00.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:04:00.253 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T13:04:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:04:00.343 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:04:00.699 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-04-16T13:04:00.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-16T13:04:00.704 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-16T13:04:00.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-16T13:04:00.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-16T13:04:00.968 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T13:04:00.969 INFO:tasks.ceph:role: osd.6 2024-04-16T13:04:00.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:04:00.969 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:04:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:04:01.054 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:04:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:04:01.446 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-04-16T13:04:01.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-16T13:04:01.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-16T13:04:01.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-16T13:04:01.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-16T13:04:01.788 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-16T13:04:01.788 INFO:tasks.ceph:role: osd.7 2024-04-16T13:04:01.788 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:04:01.788 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-16T13:04:01.886 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T13:04:01.887 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T13:04:02.297 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-04-16T13:04:02.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-16T13:04:02.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-16T13:04:02.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-16T13:04:02.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:02.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.677+0000 7f18a0218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-16T13:04:02.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.678+0000 7f18a0218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-16T13:04:02.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.678+0000 7f18a0218640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T13:04:02.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.678+0000 7f18a0218640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T13:04:02.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.678+0000 7f18a0218640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-16T13:04:02.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:02.681+0000 7f18a0218640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-16T13:04:05.633 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T13:04:05.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.860+0000 7ff358f1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-16T13:04:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.861+0000 7ff358f1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-16T13:04:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.861+0000 7ff358f1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T13:04:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.861+0000 7ff358f1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T13:04:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.861+0000 7ff358f1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-16T13:04:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:05.863+0000 7ff358f1b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-16T13:04:06.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:04:06.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:04:08.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T13:04:08.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.068+0000 7f1b98b1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-16T13:04:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.069+0000 7f1b98b1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-16T13:04:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.069+0000 7f1b98b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T13:04:09.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.069+0000 7f1b98b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T13:04:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.069+0000 7f1b98b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-16T13:04:09.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:09.071+0000 7f1b98b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-16T13:04:12.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-16T13:04:12.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:12.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.244+0000 7f9f2a5ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-16T13:04:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.244+0000 7f9f2a5ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-16T13:04:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.244+0000 7f9f2a5ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T13:04:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.244+0000 7f9f2a5ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T13:04:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.244+0000 7f9f2a5ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-16T13:04:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:12.247+0000 7f9f2a5ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-16T13:04:15.217 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-16T13:04:15.313 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T13:04:15.313 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-16T13:04:15.419 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.419 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-16T13:04:15.522 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.522 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-16T13:04:15.621 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-16T13:04:15.725 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-16T13:04:15.829 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-16T13:04:15.934 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:15.934 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-16T13:04:16.035 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-16T13:04:16.133 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-16T13:04:16.228 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-16T13:04:16.323 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-16T13:04:16.421 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-16T13:04:16.519 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-16T13:04:16.612 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-16T13:04:16.705 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:16.706 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-16T13:04:16.766 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:16.767 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-16T13:04:16.824 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.825 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-16T13:04:16.882 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:16.882 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-16T13:04:16.932 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T13:04:16.932 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T13:04:16.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAsdx5mW7pVExAAKg1y730VfhQ8TZrPr1QPTA== 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAsdx5mKDiwKxAAB/2SqKXC6PinGTxmG1wjNw== 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAtdx5mJhUDAhAAAS1VD8kMRDpnuNfLyrP8MA== 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-04-16T13:04:17.030 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAydx5m/fVHARAAfogNjHicu/zxOIpsc9JGoQ== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA1dx5mX24rEBAA3VdBo+Xd3MyAhBuJb8PksA== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA4dx5mniK+HRAAkm/W4Le2u1LK7yAJ2UKjOg== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA7dx5mhlxdORAAVny2FQuxpEigVHELFyXh8A== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAsdx5mD6xAHxAA9qRCa1l04q0YEtWCtybfYg== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAtdx5m85CDExAAl9uft//pnRfoLRJAzjDJMw== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAtdx5mWZAUJBAAqu1bvA9kKNV3n1iQ/ebQ3Q== 2024-04-16T13:04:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBCdx5m5tdsKBAAPz5WQ4UT4zexGadiaHW0ng== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBFdx5muKJYMxAAoRYM0hhUoF3vnWyAedUKzA== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBJdx5mQBcmBBAA9SfW6lchF2KudqGNSxPXSw== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBMdx5mIYuWDhAAQ385knJcu84tJi5H8/dtyw== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAtdx5mZkj6MRAAjWl5YRoT0oxyKKPI86iZSw== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAudx5msV+RARAAJ6bG7u19XN/Yacy6G3Elig== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAudx5mGO/NDBAAC9cDA/W+X930tJXedCMk7g== 2024-04-16T13:04:17.032 INFO:teuthology.orchestra.run.smithi067.stdout:[client.3] 2024-04-16T13:04:17.033 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAudx5mAQtdFxAAZ5rjfolmqHEcIVoVey37Fw== 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAsdx5mW7pVExAAKg1y730VfhQ8TZrPr1QPTA== 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAsdx5mKDiwKxAAB/2SqKXC6PinGTxmG1wjNw== 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAtdx5mJhUDAhAAAS1VD8kMRDpnuNfLyrP8MA== 2024-04-16T13:04:17.064 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-04-16T13:04:17.065 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAydx5m/fVHARAAfogNjHicu/zxOIpsc9JGoQ== 2024-04-16T13:04:17.065 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-04-16T13:04:17.065 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA1dx5mX24rEBAA3VdBo+Xd3MyAhBuJb8PksA== 2024-04-16T13:04:17.065 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA4dx5mniK+HRAAkm/W4Le2u1LK7yAJ2UKjOg== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA7dx5mhlxdORAAVny2FQuxpEigVHELFyXh8A== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAsdx5mD6xAHxAA9qRCa1l04q0YEtWCtybfYg== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAtdx5m85CDExAAl9uft//pnRfoLRJAzjDJMw== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAtdx5mWZAUJBAAqu1bvA9kKNV3n1iQ/ebQ3Q== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBCdx5m5tdsKBAAPz5WQ4UT4zexGadiaHW0ng== 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2024-04-16T13:04:17.066 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBFdx5muKJYMxAAoRYM0hhUoF3vnWyAedUKzA== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBJdx5mQBcmBBAA9SfW6lchF2KudqGNSxPXSw== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBMdx5mIYuWDhAAQ385knJcu84tJi5H8/dtyw== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAtdx5mZkj6MRAAjWl5YRoT0oxyKKPI86iZSw== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAudx5msV+RARAAJ6bG7u19XN/Yacy6G3Elig== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAudx5mGO/NDBAAC9cDA/W+X930tJXedCMk7g== 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2024-04-16T13:04:17.067 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAudx5mAQtdFxAAZ5rjfolmqHEcIVoVey37Fw== 2024-04-16T13:04:17.068 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T13:04:17.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T13:04:17.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:17.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:17.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:17.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:17.542 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.990 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:17.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T13:04:18.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T13:04:18.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:18.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:18.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:18.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-16T13:04:18.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:18.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:19.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:19.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T13:04:19.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.514 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.666 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T13:04:19.823 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T13:04:19.823 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-16T13:04:19.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T13:04:20.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-16T13:04:20.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-16T13:04:20.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T13:04:20.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-16T13:04:20.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-16T13:04:20.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-16T13:04:20.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-16T13:04:20.848 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:20.856 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-16T13:04:20.907 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-16T13:04:20.907 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-16T13:04:20.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-16T13:04:20.913 INFO:tasks.ceph.mon.a:Started 2024-04-16T13:04:20.913 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-16T13:04:20.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-16T13:04:20.918 INFO:tasks.ceph.mon.b:Started 2024-04-16T13:04:20.918 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-16T13:04:20.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-16T13:04:20.923 INFO:tasks.ceph.mon.c:Started 2024-04-16T13:04:20.923 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-16T13:04:20.924 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-16T13:04:20.924 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-16T13:04:20.928 INFO:tasks.ceph.mgr.y:Started 2024-04-16T13:04:20.929 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-16T13:04:20.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-16T13:04:20.933 INFO:tasks.ceph.mgr.x:Started 2024-04-16T13:04:20.933 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T13:04:20.933 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-04-16T13:04:21.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.114+0000 7f26ae200640 1 Processor -- start 2024-04-16T13:04:21.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.114+0000 7f26ae200640 1 -- start start 2024-04-16T13:04:21.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.115+0000 7f26ae200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26a80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ae200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ae200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a80d2b10 con 0x7f26a80d22c0 2024-04-16T13:04:21.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ae200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f26a80d2df0 con 0x7f26a80d17f0 2024-04-16T13:04:21.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ae200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26a80d30d0 con 0x7f26a815e7e0 2024-04-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ace00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26a80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:59284/0 (socket says 172.21.15.67:59284) 2024-04-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 learned_addr learned my addr 172.21.15.67:0/2754145768 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 msgr2=0x7f26a806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 msgr2=0x7f26a806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ace00640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 msgr2=0x7f26a80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ace00640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 msgr2=0x7f26a80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.116+0000 7f26ace00640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26a80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.117+0000 7f26ace00640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26a80d0240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T13:04:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.134+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429048063 0 0) 0x7f26a80d2b10 con 0x7f26a80d22c0 2024-04-16T13:04:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.134+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2690003520 con 0x7f26a80d22c0 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1780693961 0 0) 0x7f2690003520 con 0x7f26a80d22c0 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 msgr2=0x7f26a80d0240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26a80d0240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 msgr2=0x7f26a806d330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 --2- 172.21.15.67:0/2754145768 >> v2:172.21.15.82:3300/0 conn(0x7f26a80d17f0 0x7f26a806d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a80d33b0 con 0x7f26a80d22c0 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f2694001670 con 0x7f26a80d22c0 2024-04-16T13:04:21.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 >> v1:172.21.15.82:6789/0 conn(0x7f26a80d22c0 legacy=0x7f26a80d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900039b0 0x7f2690003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2690004800 0x7f2690004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80d2df0 con 0x7f26900039b0 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80d30d0 con 0x7f2690004800 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f269000bac0 con 0x7f26a815e7e0 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.138+0000 7f26a7e00640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2690004800 0x7f2690004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.139+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2690004800 msgr2=0x7f2690004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.139+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2690004800 0x7f2690004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.139+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900039b0 msgr2=0x7f2690003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.139+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26900039b0 0x7f2690003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.139+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2690003520 con 0x7f26a815e7e0 2024-04-16T13:04:21.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.140+0000 7f26ad800640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26900051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a00096d0 tx=0x7f2690005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcdb3300c2791033 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:21.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.140+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0032070 con 0x7f26a815e7e0 2024-04-16T13:04:21.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.140+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a002caf0 con 0x7f26a815e7e0 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.140+0000 7f26a7400640 1 -- 172.21.15.67:0/2754145768 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a00098c0 con 0x7f26a815e7e0 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 -- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 msgr2=0x7f26900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 --2- 172.21.15.67:0/2754145768 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a815e7e0 0x7f26900051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a00096d0 tx=0x7f2690005830 comp rx=0 tx=0).stop 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ad800640 1 -- 172.21.15.67:0/2754145768 reap_dead start 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 -- 172.21.15.67:0/2754145768 shutdown_connections 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 -- 172.21.15.67:0/2754145768 >> 172.21.15.67:0/2754145768 conn(0x7f26a809da60 msgr2=0x7f26a808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 -- 172.21.15.67:0/2754145768 shutdown_connections 2024-04-16T13:04:21.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.141+0000 7f26ae200640 1 -- 172.21.15.67:0/2754145768 wait complete. 2024-04-16T13:04:21.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.143+0000 7f26ae200640 1 Processor -- start 2024-04-16T13:04:21.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.143+0000 7f26ae200640 1 -- start start 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a81539e0 0x7f26a815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 0x7f26a815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80d28a0 con 0x7f26a815e7e0 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80d2720 con 0x7f26a80b8820 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ae200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26a815ebc0 con 0x7f26a81539e0 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.144+0000 7f26ace00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45410/0 (socket says 172.21.15.67:45410) 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 -- 172.21.15.67:0/4059853467 learned_addr learned my addr 172.21.15.67:0/4059853467 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ad800640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 0x7f26a815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26a7e00640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a81539e0 0x7f26a815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 -- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a81539e0 msgr2=0x7f26a815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a81539e0 0x7f26a815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 -- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 msgr2=0x7f26a815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 0x7f26a815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 -- 172.21.15.67:0/4059853467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a80b8d90 con 0x7f26a815e7e0 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ad800640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 0x7f26a815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.145+0000 7f26ace00640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d600 tx=0x7f269c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.146+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0125f0 con 0x7f26a815e7e0 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.146+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c019070 con 0x7f26a815e7e0 2024-04-16T13:04:21.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.146+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0129d0 con 0x7f26a815e7e0 2024-04-16T13:04:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.146+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a80b9070 con 0x7f26a815e7e0 2024-04-16T13:04:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.146+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a80b9630 con 0x7f26a815e7e0 2024-04-16T13:04:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.148+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f269c012b70 con 0x7f26a815e7e0 2024-04-16T13:04:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.148+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a80ce060 con 0x7f26a815e7e0 2024-04-16T13:04:21.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.148+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f269c014590 con 0x7f26a815e7e0 2024-04-16T13:04:21.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.151+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f269c014830 con 0x7f26a815e7e0 2024-04-16T13:04:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.223+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f26a8075bd0 con 0x7f26a815e7e0 2024-04-16T13:04:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.227+0000 7f26a4c00640 1 -- 172.21.15.67:0/4059853467 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f269c014a10 con 0x7f26a815e7e0 2024-04-16T13:04:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 msgr2=0x7f26a80cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d600 tx=0x7f269c00dac0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 shutdown_connections 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80b8820 0x7f26a815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26a81539e0 0x7f26a815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 --2- 172.21.15.67:0/4059853467 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26a815e7e0 0x7f26a80cd220 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:21.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.229+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 >> 172.21.15.67:0/4059853467 conn(0x7f26a809da60 msgr2=0x7f26a80b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:21.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.230+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 shutdown_connections 2024-04-16T13:04:21.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:21.230+0000 7f26ae200640 1 -- 172.21.15.67:0/4059853467 wait complete. 2024-04-16T13:04:21.250 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T13:04:21.250 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-16T13:04:21.251 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:21.251 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-16T13:04:21.336 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:21.336 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-16T13:04:21.408 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:21.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-16T13:04:21.535 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:21.535 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-16T13:04:21.622 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:21.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-16T13:04:21.714 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:21.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-16T13:04:21.841 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:21.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-16T13:04:21.887 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:21.885+0000 7f4b02c2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T13:04:21.912 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:21.910+0000 7f80ca02b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T13:04:21.957 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:21.956+0000 7f4b02c2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T13:04:21.960 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:04:21.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-16T13:04:21.980 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:21.978+0000 7f80ca02b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T13:04:22.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 9486d07d-0d40-41cf-ac91-fcfdd272ec36 0 2024-04-16T13:04:22.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.283+0000 7f8805c00640 1 Processor -- start 2024-04-16T13:04:22.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.283+0000 7f8805c00640 1 -- start start 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.284+0000 7f8805c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f88000d48e0 0x7f88000d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.284+0000 7f8805c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.284+0000 7f8805c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88000d34c0 con 0x7f880015ecc0 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.284+0000 7f8805c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f88000d37a0 con 0x7f88000d48e0 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.284+0000 7f8805c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88000d3a80 con 0x7f88000b7a80 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87fe000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f88000d48e0 0x7f88000d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87ff400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87ff400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:60100/0 (socket says 172.21.15.82:60100) 2024-04-16T13:04:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87ff400640 1 -- 172.21.15.82:0/2092303799 learned_addr learned my addr 172.21.15.82:0/2092303799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87fe000640 1 -- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 msgr2=0x7f88000b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87fe000640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87fe000640 1 -- 172.21.15.82:0/2092303799 >> v1:172.21.15.67:6789/0 conn(0x7f880015ecc0 legacy=0x7f88000d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87fe000640 1 -- 172.21.15.82:0/2092303799 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88000d3d60 con 0x7f88000d48e0 2024-04-16T13:04:22.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.285+0000 7f87ff400640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:04:22.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.286+0000 7f87fe000640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000d4d70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0097a0 tx=0x7f87ec02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888fa5d77b658e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.286+0000 7f87fd600640 1 -- 172.21.15.82:0/2092303799 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec035020 con 0x7f88000d48e0 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f87fd600640 1 -- 172.21.15.82:0/2092303799 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec031810 con 0x7f88000d48e0 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f87fd600640 1 -- 172.21.15.82:0/2092303799 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec031be0 con 0x7f88000d48e0 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 -- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 msgr2=0x7f88000d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000d4d70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0097a0 tx=0x7f87ec02b8b0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 -- 172.21.15.82:0/2092303799 shutdown_connections 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f88000b7a80 0x7f88000b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 --2- 172.21.15.82:0/2092303799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000d4d70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 -- 172.21.15.82:0/2092303799 >> 172.21.15.82:0/2092303799 conn(0x7f8800067b80 msgr2=0x7f8800067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 -- 172.21.15.82:0/2092303799 shutdown_connections 2024-04-16T13:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.287+0000 7f8805c00640 1 -- 172.21.15.82:0/2092303799 wait complete. 2024-04-16T13:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.289+0000 7f8805c00640 1 Processor -- start 2024-04-16T13:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.290+0000 7f8805c00640 1 -- start start 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88000b7a80 0x7f8800153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880015ecc0 0x7f88001569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f880015f0a0 con 0x7f88000b7a80 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88000d4560 con 0x7f88000d48e0 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f8805c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f88000d3150 con 0x7f880015ecc0 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f87fe000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f87fe000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50824/0 (socket says 172.21.15.82:50824) 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f87ff400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880015ecc0 0x7f88001569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f87fe000640 1 -- 172.21.15.82:0/1898482470 learned_addr learned my addr 172.21.15.82:0/1898482470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.291+0000 7f87fea00640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88000b7a80 0x7f8800153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 -- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880015ecc0 msgr2=0x7f88001569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880015ecc0 0x7f88001569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 -- 172.21.15.82:0/1898482470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88000b7a80 msgr2=0x7f8800153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88000b7a80 0x7f8800153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 -- 172.21.15.82:0/1898482470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88000c9e50 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87fe000640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87ec02bec0 tx=0x7f87ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec041070 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec03ad00 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec035040 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.292+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88001f89b0 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.293+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88001f8f70 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.293+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f87ec04c060 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.293+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f87ec03bd30 con 0x7f88000d48e0 2024-04-16T13:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.294+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8800068a70 con 0x7f88000d48e0 2024-04-16T13:04:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.296+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f87ec03b650 con 0x7f88000d48e0 2024-04-16T13:04:22.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.375+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9486d07d-0d40-41cf-ac91-fcfdd272ec36", "id": 0} v 0) -- 0x7f880015ade0 con 0x7f88000d48e0 2024-04-16T13:04:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.385+0000 7f87f6a00640 1 -- 172.21.15.82:0/1898482470 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9486d07d-0d40-41cf-ac91-fcfdd272ec36", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f87ec03b830 con 0x7f88000d48e0 2024-04-16T13:04:22.388 INFO:teuthology.orchestra.run.smithi082.stdout:0 2024-04-16T13:04:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 msgr2=0x7f88000c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f87ec02bec0 tx=0x7f87ec0046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 shutdown_connections 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f880015ecc0 0x7f88001569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88000d48e0 0x7f88000c9910 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 --2- 172.21.15.82:0/1898482470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88000b7a80 0x7f8800153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 >> 172.21.15.82:0/1898482470 conn(0x7f8800067b80 msgr2=0x7f88000c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 shutdown_connections 2024-04-16T13:04:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.387+0000 7f8805c00640 1 -- 172.21.15.82:0/1898482470 wait complete. 2024-04-16T13:04:22.406 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new e39e9244-6912-44cc-9392-73c5cc0e865e 1 2024-04-16T13:04:22.581 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.580+0000 7f4b02c2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T13:04:22.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.590+0000 7fd05b200640 1 Processor -- start 2024-04-16T13:04:22.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.590+0000 7fd05b200640 1 -- start start 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd05b200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd05c0d4660 0x7fd05c0d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd05b200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd05c0b4390 0x7fd05c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd05b200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0b4d20 con 0x7fd05c15e890 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd05b200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd05c0d1300 con 0x7fd05c0b4390 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd05b200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd05c0b4fa0 con 0x7fd05c0d4660 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd059400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd05c0d4660 0x7fd05c0d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd059400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd05c0d4660 0x7fd05c0d4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50836/0 (socket says 172.21.15.82:50836) 2024-04-16T13:04:22.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.591+0000 7fd059400640 1 -- 172.21.15.82:0/3753234953 learned_addr learned my addr 172.21.15.82:0/3753234953 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.592+0000 7fd05a800640 1 --2- 172.21.15.82:0/3753234953 >> v2:172.21.15.67:3300/0 conn(0x7fd05c0b4390 0x7fd05c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.592+0000 7fd059400640 1 -- 172.21.15.82:0/3753234953 >> v2:172.21.15.67:3300/0 conn(0x7fd05c0b4390 msgr2=0x7fd05c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.592+0000 7fd059400640 1 --2- 172.21.15.82:0/3753234953 >> v2:172.21.15.67:3300/0 conn(0x7fd05c0b4390 0x7fd05c0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.592+0000 7fd059400640 1 -- 172.21.15.82:0/3753234953 >> v1:172.21.15.82:6789/0 conn(0x7fd05c15e890 legacy=0x7fd05c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.592+0000 7fd059400640 1 -- 172.21.15.82:0/3753234953 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0b5280 con 0x7fd05c0d4660 2024-04-16T13:04:22.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.593+0000 7fd059400640 1 --2- 172.21.15.82:0/3753234953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0d4660 0x7fd05c0d4b10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0d21a0 tx=0x7fd04802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc060180ac84e478 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.593+0000 7fd058a00640 1 -- 172.21.15.82:0/3753234953 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048034070 con 0x7fd05c0d4660 2024-04-16T13:04:22.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.593+0000 7fd058a00640 1 -- 172.21.15.82:0/3753234953 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd048030860 con 0x7fd05c0d4660 2024-04-16T13:04:22.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.593+0000 7fd058a00640 1 -- 172.21.15.82:0/3753234953 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048030c30 con 0x7fd05c0d4660 2024-04-16T13:04:22.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 -- 172.21.15.82:0/3753234953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0d4660 msgr2=0x7fd05c0d4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 --2- 172.21.15.82:0/3753234953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0d4660 0x7fd05c0d4b10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0d21a0 tx=0x7fd04802b9a0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 -- 172.21.15.82:0/3753234953 shutdown_connections 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 --2- 172.21.15.82:0/3753234953 >> v2:172.21.15.67:3300/0 conn(0x7fd05c0b4390 0x7fd05c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 --2- 172.21.15.82:0/3753234953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0d4660 0x7fd05c0d4b10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 -- 172.21.15.82:0/3753234953 >> 172.21.15.82:0/3753234953 conn(0x7fd05c09da80 msgr2=0x7fd05c08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 -- 172.21.15.82:0/3753234953 shutdown_connections 2024-04-16T13:04:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.594+0000 7fd05b200640 1 -- 172.21.15.82:0/3753234953 wait complete. 2024-04-16T13:04:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.596+0000 7fd05b200640 1 Processor -- start 2024-04-16T13:04:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.596+0000 7fd05b200640 1 -- start start 2024-04-16T13:04:22.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c0d4660 0x7fd05c0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd05c15e890 0x7fd05c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c15ec70 con 0x7fd05c0d4660 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c0d24f0 con 0x7fd05c0b4390 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.597+0000 7fd05b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c0d2a10 con 0x7fd05c15e890 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50846/0 (socket says 172.21.15.82:50846) 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 -- 172.21.15.82:0/876523750 learned_addr learned my addr 172.21.15.82:0/876523750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd05a800640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd05c15e890 0x7fd05c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059400640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c0d4660 0x7fd05c0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 -- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd05c15e890 msgr2=0x7fd05c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd05c15e890 0x7fd05c0b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 -- 172.21.15.82:0/876523750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c0d4660 msgr2=0x7fd05c0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c0d4660 0x7fd05c0b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.598+0000 7fd059e00640 1 -- 172.21.15.82:0/876523750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0caf00 con 0x7fd05c0b4390 2024-04-16T13:04:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd059e00640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c3c0 tx=0x7fd04c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0052d0 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c005490 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c007260 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c1f4440 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c1f4a00 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd04c007400 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.599+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd04c003ad0 con 0x7fd05c0b4390 2024-04-16T13:04:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.600+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c075bd0 con 0x7fd05c0b4390 2024-04-16T13:04:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.603+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd05c0b4d20 con 0x7fd05c0b4390 2024-04-16T13:04:22.649 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.648+0000 7f4b02c2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T13:04:22.668 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:22.665+0000 7f80ca02b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T13:04:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.681+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e39e9244-6912-44cc-9392-73c5cc0e865e", "id": 1} v 0) -- 0x7fd05c0b4170 con 0x7fd05c0b4390 2024-04-16T13:04:22.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.690+0000 7fd052000640 1 -- 172.21.15.82:0/876523750 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e39e9244-6912-44cc-9392-73c5cc0e865e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd04c0035f0 con 0x7fd05c0b4390 2024-04-16T13:04:22.692 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 msgr2=0x7fd05c1f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c3c0 tx=0x7fd04c00c880 comp rx=0 tx=0).stop 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 shutdown_connections 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd05c15e890 0x7fd05c0b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c0d4660 0x7fd05c0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 --2- 172.21.15.82:0/876523750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd05c0b4390 0x7fd05c1f8180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 >> 172.21.15.82:0/876523750 conn(0x7fd05c09da80 msgr2=0x7fd05c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 shutdown_connections 2024-04-16T13:04:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.691+0000 7fd05b200640 1 -- 172.21.15.82:0/876523750 wait complete. 2024-04-16T13:04:22.705 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.703+0000 7f4b02c2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T13:04:22.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new a2df53ff-36f0-4109-86e0-5b3148230cae 2 2024-04-16T13:04:22.736 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:22.734+0000 7f80ca02b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T13:04:22.771 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.769+0000 7f4b02c2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T13:04:22.791 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:22.788+0000 7f80ca02b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T13:04:22.824 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.822+0000 7f4b02c2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T13:04:22.857 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:22.854+0000 7f80ca02b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T13:04:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.884+0000 7ff9ebe00640 1 Processor -- start 2024-04-16T13:04:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.884+0000 7ff9ebe00640 1 -- start start 2024-04-16T13:04:22.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.885+0000 7ff9ebe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.885+0000 7ff9ebe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9ec0d22c0 0x7ff9ec0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.885+0000 7ff9ebe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec0d2b10 con 0x7ff9ec0d1620 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.885+0000 7ff9ebe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec0d1a80 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.885+0000 7ff9ebe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec0d2df0 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50860/0 (socket says 172.21.15.82:50860) 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 -- 172.21.15.82:0/2651477073 learned_addr learned my addr 172.21.15.82:0/2651477073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9e3e00640 1 --2- 172.21.15.82:0/2651477073 >> v2:172.21.15.67:3300/0 conn(0x7ff9ec0d22c0 0x7ff9ec0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 -- 172.21.15.82:0/2651477073 >> v2:172.21.15.67:3300/0 conn(0x7ff9ec0d22c0 msgr2=0x7ff9ec0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 --2- 172.21.15.82:0/2651477073 >> v2:172.21.15.67:3300/0 conn(0x7ff9ec0d22c0 0x7ff9ec0d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 -- 172.21.15.82:0/2651477073 >> v1:172.21.15.67:6789/0 conn(0x7ff9ec0d1620 legacy=0x7ff9ec0d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:22.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.886+0000 7ff9eaa00640 1 -- 172.21.15.82:0/2651477073 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0d30d0 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.887+0000 7ff9eaa00640 1 --2- 172.21.15.82:0/2651477073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec08e7d0 tx=0x7ff9dc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56426724ea2cdea server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.887+0000 7ff9ea000640 1 -- 172.21.15.82:0/2651477073 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc02d040 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.887+0000 7ff9ea000640 1 -- 172.21.15.82:0/2651477073 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc004230 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.887+0000 7ff9ea000640 1 -- 172.21.15.82:0/2651477073 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc003610 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 -- 172.21.15.82:0/2651477073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 msgr2=0x7ff9ec0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/2651477073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec08e7d0 tx=0x7ff9dc02b8f0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 -- 172.21.15.82:0/2651477073 shutdown_connections 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/2651477073 >> v2:172.21.15.67:3300/0 conn(0x7ff9ec0d22c0 0x7ff9ec0d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/2651477073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec0d0240 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 -- 172.21.15.82:0/2651477073 >> 172.21.15.82:0/2651477073 conn(0x7ff9ec09da60 msgr2=0x7ff9ec08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 -- 172.21.15.82:0/2651477073 shutdown_connections 2024-04-16T13:04:22.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.888+0000 7ff9ebe00640 1 -- 172.21.15.82:0/2651477073 wait complete. 2024-04-16T13:04:22.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.890+0000 7ff9ebe00640 1 Processor -- start 2024-04-16T13:04:22.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.890+0000 7ff9ebe00640 1 -- start start 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9ec0d1620 0x7ff9ec14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec06d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0d2750 con 0x7ff9ec0d1620 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0d36d0 con 0x7ff9ec15e7e0 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9ebe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0d28d0 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9eb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9e3e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.82:60134/0 (socket says 172.21.15.82:60134) 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9e3e00640 1 -- 172.21.15.82:0/3704946375 learned_addr learned my addr 172.21.15.82:0/3704946375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.891+0000 7ff9eaa00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9ec0d1620 0x7ff9ec14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 -- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 msgr2=0x7ff9ec06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 -- 172.21.15.82:0/3704946375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9ec0d1620 msgr2=0x7ff9ec14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9ec0d1620 0x7ff9ec14e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 -- 172.21.15.82:0/3704946375 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec1f7890 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e3e00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400d830 tx=0x7ff9d400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400b6c0 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4019070 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400ba80 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec1f7b70 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.892+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec1f8130 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.893+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9d401e460 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.893+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff9d4014b70 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.893+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec075bd0 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.896+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff9d4014d70 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.910 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:22.908+0000 7f80ca02b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T13:04:22.963 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:22.961+0000 7f4b02c2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T13:04:22.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.975+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2df53ff-36f0-4109-86e0-5b3148230cae", "id": 2} v 0) -- 0x7ff9ec0d1dd0 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.984+0000 7ff9e2a00640 1 -- 172.21.15.82:0/3704946375 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2df53ff-36f0-4109-86e0-5b3148230cae", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff9d4014750 con 0x7ff9ec0d22c0 2024-04-16T13:04:22.986 INFO:teuthology.orchestra.run.smithi082.stdout:2 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 msgr2=0x7ff9ec06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400d830 tx=0x7ff9d400dcf0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 shutdown_connections 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ec15e7e0 0x7ff9ec06d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff9ec0d22c0 0x7ff9ec06d230 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 --2- 172.21.15.82:0/3704946375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9ec0d1620 0x7ff9ec14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 >> 172.21.15.82:0/3704946375 conn(0x7ff9ec09da60 msgr2=0x7ff9ec06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 shutdown_connections 2024-04-16T13:04:22.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:22.985+0000 7ff9ebe00640 1 -- 172.21.15.82:0/3704946375 wait complete. 2024-04-16T13:04:23.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 923b85c0-7d7b-436e-84d8-12773be890d6 3 2024-04-16T13:04:23.048 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.047+0000 7f4b02c2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T13:04:23.051 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.045+0000 7f80ca02b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T13:04:23.105 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.103+0000 7f4b02c2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T13:04:23.133 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.131+0000 7f80ca02b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T13:04:23.170 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.169+0000 7f4b02c2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T13:04:23.191 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.189+0000 7f80ca02b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T13:04:23.228 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.227+0000 7f4b02c2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T13:04:23.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.236+0000 7f0954c00640 1 Processor -- start 2024-04-16T13:04:23.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.237+0000 7f0954c00640 1 -- start start 2024-04-16T13:04:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f0954c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f095015e7e0 0x7f09500d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f0954c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f09500d17f0 0x7f095006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f0954c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09500d2b10 con 0x7f09500d22c0 2024-04-16T13:04:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f0954c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f09500d2df0 con 0x7f09500d17f0 2024-04-16T13:04:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f0954c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f09500d30d0 con 0x7f095015e7e0 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f094f400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f095015e7e0 0x7f09500d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f094f400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f095015e7e0 0x7f09500d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50870/0 (socket says 172.21.15.82:50870) 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.238+0000 7f094f400640 1 -- 172.21.15.82:0/3225570377 learned_addr learned my addr 172.21.15.82:0/3225570377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.239+0000 7f094fe00640 1 --2- 172.21.15.82:0/3225570377 >> v2:172.21.15.67:3300/0 conn(0x7f09500d17f0 0x7f095006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.239+0000 7f094f400640 1 -- 172.21.15.82:0/3225570377 >> v2:172.21.15.67:3300/0 conn(0x7f09500d17f0 msgr2=0x7f095006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.239+0000 7f094f400640 1 --2- 172.21.15.82:0/3225570377 >> v2:172.21.15.67:3300/0 conn(0x7f09500d17f0 0x7f095006d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.239+0000 7f094f400640 1 -- 172.21.15.82:0/3225570377 >> v1:172.21.15.67:6789/0 conn(0x7f09500d22c0 legacy=0x7f09500d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.239+0000 7f094f400640 1 -- 172.21.15.82:0/3225570377 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500d33b0 con 0x7f095015e7e0 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.240+0000 7f094f400640 1 --2- 172.21.15.82:0/3225570377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f09500d0240 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f095008e7d0 tx=0x7f094002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af71f8b109373751 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.240+0000 7f094ea00640 1 -- 172.21.15.82:0/3225570377 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094002d040 con 0x7f095015e7e0 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.240+0000 7f094ea00640 1 -- 172.21.15.82:0/3225570377 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940004230 con 0x7f095015e7e0 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.240+0000 7f094ea00640 1 -- 172.21.15.82:0/3225570377 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940003610 con 0x7f095015e7e0 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 -- 172.21.15.82:0/3225570377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 msgr2=0x7f09500d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 --2- 172.21.15.82:0/3225570377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f09500d0240 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f095008e7d0 tx=0x7f094002b8f0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 -- 172.21.15.82:0/3225570377 shutdown_connections 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 --2- 172.21.15.82:0/3225570377 >> v2:172.21.15.67:3300/0 conn(0x7f09500d17f0 0x7f095006d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 --2- 172.21.15.82:0/3225570377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f09500d0240 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 -- 172.21.15.82:0/3225570377 >> 172.21.15.82:0/3225570377 conn(0x7f095009da60 msgr2=0x7f095008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 -- 172.21.15.82:0/3225570377 shutdown_connections 2024-04-16T13:04:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.241+0000 7f0954c00640 1 -- 172.21.15.82:0/3225570377 wait complete. 2024-04-16T13:04:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.243+0000 7f0954c00640 1 Processor -- start 2024-04-16T13:04:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.243+0000 7f0954c00640 1 -- start start 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09500d17f0 0x7f0950155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09500d22c0 0x7f095015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09500d28d0 con 0x7f09500d17f0 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09500d2750 con 0x7f095015e7e0 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0954c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f095015ebc0 con 0x7f09500d22c0 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50876/0 (socket says 172.21.15.82:50876) 2024-04-16T13:04:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 -- 172.21.15.82:0/4194934299 learned_addr learned my addr 172.21.15.82:0/4194934299 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f0947e00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09500d22c0 0x7f095015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094f400640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09500d17f0 0x7f0950155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 -- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09500d22c0 msgr2=0x7f095015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09500d22c0 0x7f095015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 -- 172.21.15.82:0/4194934299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09500d17f0 msgr2=0x7f0950155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09500d17f0 0x7f0950155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.244+0000 7f094fe00640 1 -- 172.21.15.82:0/4194934299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095015f460 con 0x7f095015e7e0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f094fe00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0948007e40 tx=0x7f094800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948014620 con 0x7f095015e7e0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0948019070 con 0x7f095015e7e0 2024-04-16T13:04:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09500cccc0 con 0x7f095015e7e0 2024-04-16T13:04:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948014a20 con 0x7f095015e7e0 2024-04-16T13:04:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09500cd280 con 0x7f095015e7e0 2024-04-16T13:04:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0948014bc0 con 0x7f095015e7e0 2024-04-16T13:04:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.245+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f094801e8f0 con 0x7f095015e7e0 2024-04-16T13:04:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.246+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0950075bd0 con 0x7f095015e7e0 2024-04-16T13:04:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.249+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f094801e460 con 0x7f095015e7e0 2024-04-16T13:04:23.255 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.253+0000 7f80ca02b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T13:04:23.312 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.310+0000 7f80ca02b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T13:04:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.327+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "923b85c0-7d7b-436e-84d8-12773be890d6", "id": 3} v 0) -- 0x7f09500cfbe0 con 0x7f095015e7e0 2024-04-16T13:04:23.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.336+0000 7f0947400640 1 -- 172.21.15.82:0/4194934299 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "923b85c0-7d7b-436e-84d8-12773be890d6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f094801e700 con 0x7f095015e7e0 2024-04-16T13:04:23.338 INFO:teuthology.orchestra.run.smithi082.stdout:3 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 msgr2=0x7f095015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0948007e40 tx=0x7f094800e4b0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 shutdown_connections 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f095015e7e0 0x7f095015c520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f09500d22c0 0x7f095015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 --2- 172.21.15.82:0/4194934299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09500d17f0 0x7f0950155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 >> 172.21.15.82:0/4194934299 conn(0x7f095009da60 msgr2=0x7f09500b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 shutdown_connections 2024-04-16T13:04:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.337+0000 7f0954c00640 1 -- 172.21.15.82:0/4194934299 wait complete. 2024-04-16T13:04:23.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new cf4036b5-bfaf-451f-8137-0c55c0ac6042 4 2024-04-16T13:04:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.534+0000 7fb578a00640 1 Processor -- start 2024-04-16T13:04:23.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.535+0000 7fb578a00640 1 -- start start 2024-04-16T13:04:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb578a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 0x7fb5740d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb578a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5740d1620 0x7fb57406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb578a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5740d2b10 con 0x7fb57415e7e0 2024-04-16T13:04:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb578a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb5740d1a80 con 0x7fb5740d1620 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb578a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb5740d2df0 con 0x7fb5740d0240 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb573200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5740d1620 0x7fb57406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb56be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 0x7fb5740d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb573200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5740d1620 0x7fb57406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50892/0 (socket says 172.21.15.82:50892) 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.536+0000 7fb573200640 1 -- 172.21.15.82:0/2215917354 learned_addr learned my addr 172.21.15.82:0/2215917354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb571e00640 1 -- 172.21.15.82:0/2215917354 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093950863 0 0) 0x7fb5740d2b10 con 0x7fb57415e7e0 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb571e00640 1 -- 172.21.15.82:0/2215917354 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb558003520 con 0x7fb57415e7e0 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb573200640 1 -- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 msgr2=0x7fb5740d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb573200640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 0x7fb5740d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb573200640 1 -- 172.21.15.82:0/2215917354 >> v1:172.21.15.82:6789/0 conn(0x7fb57415e7e0 legacy=0x7fb5740d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb573200640 1 -- 172.21.15.82:0/2215917354 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5740d30d0 con 0x7fb5740d1620 2024-04-16T13:04:23.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.537+0000 7fb56be00640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 0x7fb5740d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:04:23.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.538+0000 7fb573200640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb57406d330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009e50 tx=0x7fb56c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128912e6804bbecb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.538+0000 7fb571e00640 1 -- 172.21.15.82:0/2215917354 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c02cb00 con 0x7fb5740d1620 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.538+0000 7fb571e00640 1 -- 172.21.15.82:0/2215917354 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56c02cca0 con 0x7fb5740d1620 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.538+0000 7fb571e00640 1 -- 172.21.15.82:0/2215917354 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0345f0 con 0x7fb5740d1620 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 -- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 msgr2=0x7fb57406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb57406d330 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009e50 tx=0x7fb56c02bf60 comp rx=0 tx=0).stop 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 -- 172.21.15.82:0/2215917354 shutdown_connections 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb57406d330 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 --2- 172.21.15.82:0/2215917354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5740d0240 0x7fb5740d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 -- 172.21.15.82:0/2215917354 >> 172.21.15.82:0/2215917354 conn(0x7fb57409da60 msgr2=0x7fb57408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 -- 172.21.15.82:0/2215917354 shutdown_connections 2024-04-16T13:04:23.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.539+0000 7fb578a00640 1 -- 172.21.15.82:0/2215917354 wait complete. 2024-04-16T13:04:23.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.541+0000 7fb578a00640 1 Processor -- start 2024-04-16T13:04:23.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.541+0000 7fb578a00640 1 -- start start 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5740d0240 0x7fb5740b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb57415e7e0 0x7fb574161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb57415ebc0 con 0x7fb5740d0240 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb5740d3690 con 0x7fb5740d1620 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb578a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb57415ed40 con 0x7fb57415e7e0 2024-04-16T13:04:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb56be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb56be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50906/0 (socket says 172.21.15.82:50906) 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb573200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb57415e7e0 0x7fb574161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.542+0000 7fb56be00640 1 -- 172.21.15.82:0/3643402415 learned_addr learned my addr 172.21.15.82:0/3643402415 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 -- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb57415e7e0 msgr2=0x7fb574161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb57415e7e0 0x7fb574161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 -- 172.21.15.82:0/3643402415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5740d0240 msgr2=0x7fb5740b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5740d0240 0x7fb5740b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 -- 172.21.15.82:0/3643402415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5740c89f0 con 0x7fb5740d1620 2024-04-16T13:04:23.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56be00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00ebe0 tx=0x7fb55c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c017070 con 0x7fb5740d1620 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c00cc30 con 0x7fb5740d1620 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c013470 con 0x7fb5740d1620 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5740c8cd0 con 0x7fb5740d1620 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.543+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5740c9290 con 0x7fb5740d1620 2024-04-16T13:04:23.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.544+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb55c01a070 con 0x7fb5740d1620 2024-04-16T13:04:23.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.544+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb55c013b20 con 0x7fb5740d1620 2024-04-16T13:04:23.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.545+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb574075bd0 con 0x7fb5740d1620 2024-04-16T13:04:23.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.547+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb55c013610 con 0x7fb5740d1620 2024-04-16T13:04:23.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.626+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf4036b5-bfaf-451f-8137-0c55c0ac6042", "id": 4} v 0) -- 0x7fb5740d0ea0 con 0x7fb5740d1620 2024-04-16T13:04:23.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.634+0000 7fb56aa00640 1 -- 172.21.15.82:0/3643402415 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf4036b5-bfaf-451f-8137-0c55c0ac6042", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb55c0137f0 con 0x7fb5740d1620 2024-04-16T13:04:23.637 INFO:teuthology.orchestra.run.smithi082.stdout:4 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.635+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 msgr2=0x7fb574160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.635+0000 7fb578a00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00ebe0 tx=0x7fb55c00c520 comp rx=0 tx=0).stop 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 shutdown_connections 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb57415e7e0 0x7fb574161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5740d1620 0x7fb574160f40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 --2- 172.21.15.82:0/3643402415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5740d0240 0x7fb5740b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 >> 172.21.15.82:0/3643402415 conn(0x7fb57409da60 msgr2=0x7fb57415dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 shutdown_connections 2024-04-16T13:04:23.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.636+0000 7fb578a00640 1 -- 172.21.15.82:0/3643402415 wait complete. 2024-04-16T13:04:23.655 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new bd54c71c-646b-45e0-a915-142317b0a0fd 5 2024-04-16T13:04:23.705 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.704+0000 7f4b02c2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T13:04:23.788 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.786+0000 7f80ca02b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T13:04:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.829+0000 7f9731600640 1 Processor -- start 2024-04-16T13:04:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.829+0000 7f9731600640 1 -- start start 2024-04-16T13:04:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.830+0000 7f9731600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c15c860 0x7f972c0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f9731600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f972c0cc9f0 0x7f972c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f9731600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c0c6e70 con 0x7f972c161020 2024-04-16T13:04:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f9731600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f972c0c7710 con 0x7f972c0cc9f0 2024-04-16T13:04:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f9731600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f972c0c7150 con 0x7f972c15c860 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f972c0cc9f0 0x7f972c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f972c0cc9f0 0x7f972c160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50914/0 (socket says 172.21.15.82:50914) 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972aa00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c15c860 0x7f972c0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 -- 172.21.15.82:0/229474513 learned_addr learned my addr 172.21.15.82:0/229474513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 -- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c15c860 msgr2=0x7f972c0c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 --2- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c15c860 0x7f972c0c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 -- 172.21.15.82:0/229474513 >> v1:172.21.15.67:6789/0 conn(0x7f972c161020 legacy=0x7f972c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.831+0000 7f972a000640 1 -- 172.21.15.82:0/229474513 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c0c7430 con 0x7f972c0cc9f0 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.832+0000 7f972a000640 1 --2- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c160ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9718009870 tx=0x7f971802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aad775ab238140dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.833+0000 7f9729600640 1 -- 172.21.15.82:0/229474513 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718035020 con 0x7f972c0cc9f0 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.833+0000 7f9729600640 1 -- 172.21.15.82:0/229474513 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718031640 con 0x7f972c0cc9f0 2024-04-16T13:04:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.833+0000 7f9729600640 1 -- 172.21.15.82:0/229474513 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971802d040 con 0x7f972c0cc9f0 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.833+0000 7f9731600640 1 -- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 msgr2=0x7f972c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.833+0000 7f9731600640 1 --2- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c160ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9718009870 tx=0x7f971802b8f0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 -- 172.21.15.82:0/229474513 shutdown_connections 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 --2- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c160ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 --2- 172.21.15.82:0/229474513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c15c860 0x7f972c0c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 -- 172.21.15.82:0/229474513 >> 172.21.15.82:0/229474513 conn(0x7f972c067d90 msgr2=0x7f972c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 -- 172.21.15.82:0/229474513 shutdown_connections 2024-04-16T13:04:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.834+0000 7f9731600640 1 -- 172.21.15.82:0/229474513 wait complete. 2024-04-16T13:04:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.835+0000 7f9731600640 1 Processor -- start 2024-04-16T13:04:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.835+0000 7f9731600640 1 -- start start 2024-04-16T13:04:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f972c15c860 0x7f972c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 0x7f972c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f972c15cc40 con 0x7f972c15c860 2024-04-16T13:04:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f972c0cce50 con 0x7f972c0cc9f0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.836+0000 7f9731600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f972c0b3e10 con 0x7f972c161020 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50918/0 (socket says 172.21.15.82:50918) 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 -- 172.21.15.82:0/3763333740 learned_addr learned my addr 172.21.15.82:0/3763333740 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972b400640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 0x7f972c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972a000640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f972c15c860 0x7f972c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 -- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 msgr2=0x7f972c0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 0x7f972c0cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 -- 172.21.15.82:0/3763333740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f972c15c860 msgr2=0x7f972c0cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f972c15c860 0x7f972c0cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 -- 172.21.15.82:0/3763333740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c1585a0 con 0x7f972c0cc9f0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972b400640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 0x7f972c0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.837+0000 7f972aa00640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f971c00e9b0 tx=0x7f971c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c017070 con 0x7f972c0cc9f0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f971c00c9a0 con 0x7f972c0cc9f0 2024-04-16T13:04:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00cd90 con 0x7f972c0cc9f0 2024-04-16T13:04:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972c158880 con 0x7f972c0cc9f0 2024-04-16T13:04:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f972c158e40 con 0x7f972c0cc9f0 2024-04-16T13:04:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f971c01a070 con 0x7f972c0cc9f0 2024-04-16T13:04:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.838+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f971c0139f0 con 0x7f972c0cc9f0 2024-04-16T13:04:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.839+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972c068a70 con 0x7f972c0cc9f0 2024-04-16T13:04:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.841+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f971c013c90 con 0x7f972c0cc9f0 2024-04-16T13:04:23.875 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:23.874+0000 7f4b02c2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T13:04:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.920+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd54c71c-646b-45e0-a915-142317b0a0fd", "id": 5} v 0) -- 0x7f972c0b49f0 con 0x7f972c0cc9f0 2024-04-16T13:04:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.927+0000 7f9722a00640 1 -- 172.21.15.82:0/3763333740 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd54c71c-646b-45e0-a915-142317b0a0fd", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f971c013470 con 0x7f972c0cc9f0 2024-04-16T13:04:23.930 INFO:teuthology.orchestra.run.smithi082.stdout:5 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 msgr2=0x7f972c0c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f971c00e9b0 tx=0x7f971c00ee70 comp rx=0 tx=0).stop 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 shutdown_connections 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f972c161020 0x7f972c0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f972c15c860 0x7f972c0cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 --2- 172.21.15.82:0/3763333740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f972c0cc9f0 0x7f972c0c8da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.928+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 >> 172.21.15.82:0/3763333740 conn(0x7f972c067d90 msgr2=0x7f972c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.929+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 shutdown_connections 2024-04-16T13:04:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:23.929+0000 7f9731600640 1 -- 172.21.15.82:0/3763333740 wait complete. 2024-04-16T13:04:23.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 7e6b26de-02fb-4f77-9448-20fac484ce8d 6 2024-04-16T13:04:23.959 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:23.957+0000 7f80ca02b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T13:04:24.031 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.029+0000 7f4b02c2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T13:04:24.087 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.085+0000 7f4b02c2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T13:04:24.112 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.110+0000 7f80ca02b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T13:04:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.126+0000 7f42dbe00640 1 Processor -- start 2024-04-16T13:04:24.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.126+0000 7f42dbe00640 1 -- start start 2024-04-16T13:04:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42dbe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42dc15e7e0 0x7f42dc0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42dbe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42dc0d2b10 con 0x7f42dc0d22c0 2024-04-16T13:04:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42dbe00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42dc0d2df0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42dbe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f42dc0d30d0 con 0x7f42dc15e7e0 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42daa00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42dc15e7e0 0x7f42dc0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42daa00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42dc15e7e0 0x7f42dc0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50922/0 (socket says 172.21.15.82:50922) 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42db400640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f42dc0d17f0 0x7f42dc06d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:56646/0 (socket says 172.21.15.82:56646) 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.128+0000 7f42daa00640 1 -- 172.21.15.82:0/759092682 learned_addr learned my addr 172.21.15.82:0/759092682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.129+0000 7f42daa00640 1 -- 172.21.15.82:0/759092682 >> v1:172.21.15.82:6789/0 conn(0x7f42dc0d17f0 legacy=0x7f42dc06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.129+0000 7f42daa00640 1 -- 172.21.15.82:0/759092682 >> v1:172.21.15.67:6789/0 conn(0x7f42dc0d22c0 legacy=0x7f42dc0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.129+0000 7f42da000640 1 -- 172.21.15.82:0/759092682 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199666921 0 0) 0x7f42dc0d2df0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.129+0000 7f42daa00640 1 -- 172.21.15.82:0/759092682 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc0d33b0 con 0x7f42dc15e7e0 2024-04-16T13:04:24.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.130+0000 7f42daa00640 1 --2- 172.21.15.82:0/759092682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc15e7e0 0x7f42dc0d0240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009850 tx=0x7f42cc02ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f0140a65a9e3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.130+0000 7f42da000640 1 -- 172.21.15.82:0/759092682 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc004230 con 0x7f42dc15e7e0 2024-04-16T13:04:24.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.130+0000 7f42da000640 1 -- 172.21.15.82:0/759092682 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0043d0 con 0x7f42dc15e7e0 2024-04-16T13:04:24.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.130+0000 7f42da000640 1 -- 172.21.15.82:0/759092682 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc02f830 con 0x7f42dc15e7e0 2024-04-16T13:04:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 -- 172.21.15.82:0/759092682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc15e7e0 msgr2=0x7f42dc0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 --2- 172.21.15.82:0/759092682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc15e7e0 0x7f42dc0d0240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009850 tx=0x7f42cc02ba10 comp rx=0 tx=0).stop 2024-04-16T13:04:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 -- 172.21.15.82:0/759092682 shutdown_connections 2024-04-16T13:04:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 --2- 172.21.15.82:0/759092682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc15e7e0 0x7f42dc0d0240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 -- 172.21.15.82:0/759092682 >> 172.21.15.82:0/759092682 conn(0x7f42dc09da60 msgr2=0x7f42dc08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 -- 172.21.15.82:0/759092682 shutdown_connections 2024-04-16T13:04:24.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.131+0000 7f42dbe00640 1 -- 172.21.15.82:0/759092682 wait complete. 2024-04-16T13:04:24.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.132+0000 7f42dbe00640 1 Processor -- start 2024-04-16T13:04:24.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.133+0000 7f42dbe00640 1 -- start start 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42dc0d22c0 0x7f42dc0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc15e7e0 0x7f42dc153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0d28d0 con 0x7f42dc15e7e0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0d2750 con 0x7f42dc0d17f0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42dbe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f42dc15ebc0 con 0x7f42dc0d22c0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42daa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42daa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50932/0 (socket says 172.21.15.82:50932) 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42daa00640 1 -- 172.21.15.82:0/2629426375 learned_addr learned my addr 172.21.15.82:0/2629426375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42d3e00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42dc0d22c0 0x7f42dc0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.134+0000 7f42db400640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc15e7e0 0x7f42dc153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 -- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42dc0d22c0 msgr2=0x7f42dc0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42dc0d22c0 0x7f42dc0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 -- 172.21.15.82:0/2629426375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc15e7e0 msgr2=0x7f42dc153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc15e7e0 0x7f42dc153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 -- 172.21.15.82:0/2629426375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc1f7fb0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42daa00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc047070 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc02fbf0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc1f8290 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc003610 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.135+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc1f7ca0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.136+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f42cc04a070 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.136+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f42cc006670 con 0x7f42dc0d17f0 2024-04-16T13:04:24.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.136+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42dc160250 con 0x7f42dc0d17f0 2024-04-16T13:04:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.139+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f42cc033070 con 0x7f42dc0d17f0 2024-04-16T13:04:24.171 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.169+0000 7f80ca02b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T13:04:24.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.214+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e6b26de-02fb-4f77-9448-20fac484ce8d", "id": 6} v 0) -- 0x7f42dc075bd0 con 0x7f42dc0d17f0 2024-04-16T13:04:24.224 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.223+0000 7f4b02c2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T13:04:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.224+0000 7f42d2a00640 1 -- 172.21.15.82:0/2629426375 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e6b26de-02fb-4f77-9448-20fac484ce8d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f42cc004330 con 0x7f42dc0d17f0 2024-04-16T13:04:24.226 INFO:teuthology.orchestra.run.smithi082.stdout:6 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 msgr2=0x7f42dc1f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc0046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 shutdown_connections 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42dc15e7e0 0x7f42dc153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42dc0d22c0 0x7f42dc0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 --2- 172.21.15.82:0/2629426375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc0d17f0 0x7f42dc1f7760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.225+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 >> 172.21.15.82:0/2629426375 conn(0x7f42dc09da60 msgr2=0x7f42dc06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.226+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 shutdown_connections 2024-04-16T13:04:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.226+0000 7f42dbe00640 1 -- 172.21.15.82:0/2629426375 wait complete. 2024-04-16T13:04:24.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd new 5949c571-cb73-42e7-a9b8-cc1aa3534ea5 7 2024-04-16T13:04:24.307 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.305+0000 7f80ca02b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T13:04:24.341 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.340+0000 7f4b02c2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T13:04:24.425 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.422+0000 7f80ca02b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T13:04:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.476+0000 7fa0ad800640 1 Processor -- start 2024-04-16T13:04:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.476+0000 7fa0ad800640 1 -- start start 2024-04-16T13:04:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0a815c620 0x7fa0a80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa0a815ca00 0x7fa0a80b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a80d09a0 0x7fa0a80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80d1330 con 0x7fa0a815ca00 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80ce220 con 0x7fa0a815c620 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.477+0000 7fa0ad800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a80cd610 con 0x7fa0a80d09a0 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0a815c620 0x7fa0a80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0ace00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a80d09a0 0x7fa0a80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0a815c620 0x7fa0a80ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50946/0 (socket says 172.21.15.82:50946) 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 -- 172.21.15.82:0/1399435777 learned_addr learned my addr 172.21.15.82:0/1399435777 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa09f400640 1 --2- 172.21.15.82:0/1399435777 >> v2:172.21.15.67:3300/0 conn(0x7fa0a815ca00 0x7fa0a80b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 -- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a80d09a0 msgr2=0x7fa0a80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 --2- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a80d09a0 0x7fa0a80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 -- 172.21.15.82:0/1399435777 >> v2:172.21.15.67:3300/0 conn(0x7fa0a815ca00 msgr2=0x7fa0a80b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 --2- 172.21.15.82:0/1399435777 >> v2:172.21.15.67:3300/0 conn(0x7fa0a815ca00 0x7fa0a80b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.478+0000 7fa0a7e00640 1 -- 172.21.15.82:0/1399435777 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a80cd8f0 con 0x7fa0a815c620 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.479+0000 7fa0a7e00640 1 --2- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815c620 0x7fa0a80ccf50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0a809bbe0 tx=0x7fa09802b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09f34f86623f03a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0a7400640 1 -- 172.21.15.82:0/1399435777 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098035020 con 0x7fa0a815c620 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0a7400640 1 -- 172.21.15.82:0/1399435777 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09802d040 con 0x7fa0a815c620 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0a7400640 1 -- 172.21.15.82:0/1399435777 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098031a80 con 0x7fa0a815c620 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 -- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815c620 msgr2=0x7fa0a80ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815c620 0x7fa0a80ccf50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0a809bbe0 tx=0x7fa09802b900 comp rx=0 tx=0).stop 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 -- 172.21.15.82:0/1399435777 shutdown_connections 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a80d09a0 0x7fa0a80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1399435777 >> v2:172.21.15.67:3300/0 conn(0x7fa0a815ca00 0x7fa0a80b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1399435777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815c620 0x7fa0a80ccf50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 -- 172.21.15.82:0/1399435777 >> 172.21.15.82:0/1399435777 conn(0x7fa0a80d2550 msgr2=0x7fa0a80d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.480+0000 7fa0ad800640 1 -- 172.21.15.82:0/1399435777 shutdown_connections 2024-04-16T13:04:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.481+0000 7fa0ad800640 1 -- 172.21.15.82:0/1399435777 wait complete. 2024-04-16T13:04:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.482+0000 7fa0ad800640 1 Processor -- start 2024-04-16T13:04:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.482+0000 7fa0ad800640 1 -- start start 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a80d09a0 0x7fa0a8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a815c620 0x7fa0a815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a80b3d90 con 0x7fa0a80d09a0 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a80cdeb0 con 0x7fa0a815ca00 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ad800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a809aa70 con 0x7fa0a815c620 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ace00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ace00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50950/0 (socket says 172.21.15.82:50950) 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa0ace00640 1 -- 172.21.15.82:0/1417620592 learned_addr learned my addr 172.21.15.82:0/1417620592 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.483+0000 7fa09f400640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a815c620 0x7fa0a815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0a7e00640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a80d09a0 0x7fa0a8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 -- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a815c620 msgr2=0x7fa0a815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a815c620 0x7fa0a815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 -- 172.21.15.82:0/1417620592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a80d09a0 msgr2=0x7fa0a8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a80d09a0 0x7fa0a8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 -- 172.21.15.82:0/1417620592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a806cc60 con 0x7fa0a815ca00 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ace00640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000eed0 tx=0x7fa0a000b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0018020 con 0x7fa0a815ca00 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a0014400 con 0x7fa0a815ca00 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.484+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a80cb1b0 con 0x7fa0a815ca00 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.485+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00147f0 con 0x7fa0a815ca00 2024-04-16T13:04:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.485+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a806d1e0 con 0x7fa0a815ca00 2024-04-16T13:04:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.485+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0a0005d10 con 0x7fa0a815ca00 2024-04-16T13:04:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.485+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa0a001d400 con 0x7fa0a815ca00 2024-04-16T13:04:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.486+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a8075bd0 con 0x7fa0a815ca00 2024-04-16T13:04:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.488+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa0a0022030 con 0x7fa0a815ca00 2024-04-16T13:04:24.528 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.527+0000 7f4b02c2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T13:04:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.566+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5949c571-cb73-42e7-a9b8-cc1aa3534ea5", "id": 7} v 0) -- 0x7fa0a80cb4f0 con 0x7fa0a815ca00 2024-04-16T13:04:24.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.577+0000 7fa0a4c00640 1 -- 172.21.15.82:0/1417620592 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5949c571-cb73-42e7-a9b8-cc1aa3534ea5", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa0a001d9a0 con 0x7fa0a815ca00 2024-04-16T13:04:24.580 INFO:teuthology.orchestra.run.smithi082.stdout:7 2024-04-16T13:04:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.578+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 msgr2=0x7fa0a815b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.578+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000eed0 tx=0x7fa0a000b480 comp rx=0 tx=0).stop 2024-04-16T13:04:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 shutdown_connections 2024-04-16T13:04:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a815ca00 0x7fa0a815b2c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa0a815c620 0x7fa0a815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 --2- 172.21.15.82:0/1417620592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa0a80d09a0 0x7fa0a8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 >> 172.21.15.82:0/1417620592 conn(0x7fa0a80d2550 msgr2=0x7fa0a809ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 shutdown_connections 2024-04-16T13:04:24.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:04:24.579+0000 7fa0ad800640 1 -- 172.21.15.82:0/1417620592 wait complete. 2024-04-16T13:04:24.582 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.580+0000 7f4b02c2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T13:04:24.598 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-16T13:04:24.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-16T13:04:24.606 INFO:tasks.ceph.osd.0:Started 2024-04-16T13:04:24.606 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-16T13:04:24.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-16T13:04:24.612 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.609+0000 7f80ca02b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T13:04:24.613 INFO:tasks.ceph.osd.1:Started 2024-04-16T13:04:24.613 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-16T13:04:24.613 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-16T13:04:24.618 INFO:tasks.ceph.osd.2:Started 2024-04-16T13:04:24.618 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-16T13:04:24.618 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-16T13:04:24.624 INFO:tasks.ceph.osd.3:Started 2024-04-16T13:04:24.624 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-16T13:04:24.624 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-16T13:04:24.631 INFO:tasks.ceph.osd.4:Started 2024-04-16T13:04:24.632 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-16T13:04:24.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-16T13:04:24.638 INFO:tasks.ceph.osd.5:Started 2024-04-16T13:04:24.638 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-16T13:04:24.639 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-16T13:04:24.646 INFO:tasks.ceph.osd.6:Started 2024-04-16T13:04:24.646 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-16T13:04:24.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-16T13:04:24.652 INFO:tasks.ceph.osd.7:Started 2024-04-16T13:04:24.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:24.670 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.668+0000 7f80ca02b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T13:04:24.845 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:24.844+0000 7f4b02c2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T13:04:24.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.872+0000 7fa76a200640 1 Processor -- start 2024-04-16T13:04:24.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.872+0000 7fa76a200640 1 -- start start 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa76a200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa7640cf510 0x7fa7640ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa76a200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7640d3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa76a200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640b92d0 con 0x7fa7640cf8f0 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa76a200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa7640b95b0 con 0x7fa7640cf510 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa76a200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7640b9890 con 0x7fa7640b8980 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa762a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa7640cf8f0 0x7fa7640d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:57198/0 (socket says 172.21.15.67:57198) 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa762a00640 1 -- 172.21.15.67:0/3230930457 learned_addr learned my addr 172.21.15.67:0/3230930457 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa763400640 1 --2- 172.21.15.67:0/3230930457 >> v2:172.21.15.82:3300/0 conn(0x7fa7640cf510 0x7fa7640ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa763e00640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7640d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa762000640 1 -- 172.21.15.67:0/3230930457 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165236681 0 0) 0x7fa7640b92d0 con 0x7fa7640cf8f0 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.874+0000 7fa762000640 1 -- 172.21.15.67:0/3230930457 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa748003520 con 0x7fa7640cf8f0 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.875+0000 7fa763400640 1 -- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 msgr2=0x7fa7640d3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.875+0000 7fa763400640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7640d3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.875+0000 7fa763400640 1 -- 172.21.15.67:0/3230930457 >> v1:172.21.15.67:6789/0 conn(0x7fa7640cf8f0 legacy=0x7fa7640d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.875+0000 7fa763400640 1 -- 172.21.15.67:0/3230930457 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640b9b70 con 0x7fa7640cf510 2024-04-16T13:04:24.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.876+0000 7fa763400640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf510 0x7fa7640ba410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7540097a0 tx=0x7fa75402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=251ddf1803cc6e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.876+0000 7fa762000640 1 -- 172.21.15.67:0/3230930457 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754031780 con 0x7fa7640cf510 2024-04-16T13:04:24.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.876+0000 7fa762000640 1 -- 172.21.15.67:0/3230930457 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa754037070 con 0x7fa7640cf510 2024-04-16T13:04:24.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.876+0000 7fa762000640 1 -- 172.21.15.67:0/3230930457 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754031b20 con 0x7fa7640cf510 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 -- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf510 msgr2=0x7fa7640ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf510 0x7fa7640ba410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7540097a0 tx=0x7fa75402b820 comp rx=0 tx=0).stop 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 -- 172.21.15.67:0/3230930457 shutdown_connections 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7640d3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 --2- 172.21.15.67:0/3230930457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf510 0x7fa7640ba410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 -- 172.21.15.67:0/3230930457 >> 172.21.15.67:0/3230930457 conn(0x7fa764067b50 msgr2=0x7fa764067f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 -- 172.21.15.67:0/3230930457 shutdown_connections 2024-04-16T13:04:24.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.877+0000 7fa76a200640 1 -- 172.21.15.67:0/3230930457 wait complete. 2024-04-16T13:04:24.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.879+0000 7fa76a200640 1 Processor -- start 2024-04-16T13:04:24.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.879+0000 7fa76a200640 1 -- start start 2024-04-16T13:04:24.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7641558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf8f0 0x7fa7640cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:24.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa76415edb0 con 0x7fa7640cf510 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa76415ec30 con 0x7fa7640cf8f0 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa76a200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa7640b8db0 con 0x7fa7640b8980 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49116/0 (socket says 172.21.15.67:49116) 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 -- 172.21.15.67:0/1994603569 learned_addr learned my addr 172.21.15.67:0/1994603569 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa763400640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7641558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa763e00640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf8f0 0x7fa7640cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 -- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 msgr2=0x7fa7641558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7641558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 -- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf8f0 msgr2=0x7fa7640cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf8f0 0x7fa7640cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.880+0000 7fa762a00640 1 -- 172.21.15.67:0/1994603569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa764155de0 con 0x7fa7640cf510 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa762a00640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7500010e0 tx=0x7fa75000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750017070 con 0x7fa7640cf510 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa750005d00 con 0x7fa7640cf510 2024-04-16T13:04:24.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750007310 con 0x7fa7640cf510 2024-04-16T13:04:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa764160020 con 0x7fa7640cf510 2024-04-16T13:04:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7641605e0 con 0x7fa7640cf510 2024-04-16T13:04:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.881+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa75001a070 con 0x7fa7640cf510 2024-04-16T13:04:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.882+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa750012dc0 con 0x7fa7640cf510 2024-04-16T13:04:24.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.882+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa764159120 con 0x7fa7640cf510 2024-04-16T13:04:24.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.887+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa7500074b0 con 0x7fa7640cf510 2024-04-16T13:04:24.892 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:24.889+0000 7f80ca02b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T13:04:24.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.952+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7640cb1a0 con 0x7fa7640cf510 2024-04-16T13:04:24.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.953+0000 7fa75b400640 1 -- 172.21.15.67:0/1994603569 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa750007690 con 0x7fa7640cf510 2024-04-16T13:04:24.954 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:24.954 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:24.569896+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 msgr2=0x7fa7641585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7500010e0 tx=0x7fa75000c890 comp rx=0 tx=0).stop 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 shutdown_connections 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7640cf8f0 0x7fa7640cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7640cf510 0x7fa7641585a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 --2- 172.21.15.67:0/1994603569 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa7640b8980 0x7fa7641558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 >> 172.21.15.67:0/1994603569 conn(0x7fa764067b50 msgr2=0x7fa76415c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 shutdown_connections 2024-04-16T13:04:24.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:24.954+0000 7fa76a200640 1 -- 172.21.15.67:0/1994603569 wait complete. 2024-04-16T13:04:24.972 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-16T13:04:24.972 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T13:04:25.303 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-16T13:04:25.301+0000 7f7c9221d640 -1 Falling back to public interface 2024-04-16T13:04:25.318 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-04-16T13:04:25.315+0000 7f7d6af49640 -1 Falling back to public interface 2024-04-16T13:04:25.336 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-04-16T13:04:25.334+0000 7faf1c793640 -1 Falling back to public interface 2024-04-16T13:04:25.343 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-04-16T13:04:25.341+0000 7f2a1b60c640 -1 Falling back to public interface 2024-04-16T13:04:25.347 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-04-16T13:04:25.345+0000 7efe99c0f640 -1 Falling back to public interface 2024-04-16T13:04:25.353 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-16T13:04:25.351+0000 7f802700f640 -1 Falling back to public interface 2024-04-16T13:04:25.353 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-16T13:04:25.351+0000 7f30d5e0e640 -1 Falling back to public interface 2024-04-16T13:04:25.360 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-16T13:04:25.359+0000 7f32c1614640 -1 Falling back to public interface 2024-04-16T13:04:25.778 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:25.948 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.947+0000 7f3287200640 1 Processor -- start 2024-04-16T13:04:25.949 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.947+0000 7f3287200640 1 -- start start 2024-04-16T13:04:25.950 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f4b02c2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3287200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f328815e7c0 0x7f32880b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3287200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32880b4c90 con 0x7f32880d23c0 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3287200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32880b4f70 con 0x7f32880d33a0 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3287200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32880b5250 con 0x7f328815e7c0 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3285e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f328815e7c0 0x7f32880b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3285e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f328815e7c0 0x7f32880b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49124/0 (socket says 172.21.15.67:49124) 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.949+0000 7f3285e00640 1 -- 172.21.15.67:0/1280916308 learned_addr learned my addr 172.21.15.67:0/1280916308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.950+0000 7f3285e00640 1 -- 172.21.15.67:0/1280916308 >> v1:172.21.15.82:6789/0 conn(0x7f32880d33a0 legacy=0x7f32880cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.950+0000 7f3285e00640 1 -- 172.21.15.67:0/1280916308 >> v1:172.21.15.67:6789/0 conn(0x7f32880d23c0 legacy=0x7f32880d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:25.951 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.950+0000 7f3285e00640 1 -- 172.21.15.67:0/1280916308 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32880b5530 con 0x7f328815e7c0 2024-04-16T13:04:25.952 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:25.948+0000 7f80ca02b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3285e00640 1 --2- 172.21.15.67:0/1280916308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f32880b4340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3278009870 tx=0x7f327802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c9eea0e97f613 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3284a00640 1 -- 172.21.15.67:0/1280916308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278034070 con 0x7f328815e7c0 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3284a00640 1 -- 172.21.15.67:0/1280916308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3278030860 con 0x7f328815e7c0 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3284a00640 1 -- 172.21.15.67:0/1280916308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278030c30 con 0x7f328815e7c0 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3287200640 1 -- 172.21.15.67:0/1280916308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 msgr2=0x7f32880b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.951+0000 7f3287200640 1 --2- 172.21.15.67:0/1280916308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f32880b4340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3278009870 tx=0x7f327802b9a0 comp rx=0 tx=0).stop 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.952+0000 7f3287200640 1 -- 172.21.15.67:0/1280916308 shutdown_connections 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.952+0000 7f3287200640 1 --2- 172.21.15.67:0/1280916308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f32880b4340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.952+0000 7f3287200640 1 -- 172.21.15.67:0/1280916308 >> 172.21.15.67:0/1280916308 conn(0x7f328809d9b0 msgr2=0x7f328808bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.952+0000 7f3287200640 1 -- 172.21.15.67:0/1280916308 shutdown_connections 2024-04-16T13:04:25.953 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.952+0000 7f3287200640 1 -- 172.21.15.67:0/1280916308 wait complete. 2024-04-16T13:04:25.954 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.953+0000 7f3287200640 1 Processor -- start 2024-04-16T13:04:25.954 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.953+0000 7f3287200640 1 -- start start 2024-04-16T13:04:25.957 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32880d33a0 0x7f32880b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:25.957 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:25.957 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f328815aa20 0x7f32881515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:25.957 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f328815ed20 con 0x7f328815e7c0 2024-04-16T13:04:25.957 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f328815eba0 con 0x7f328815aa20 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.954+0000 7f3287200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f32880b4880 con 0x7f32880d33a0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49138/0 (socket says 172.21.15.67:49138) 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 -- 172.21.15.67:0/2742621350 learned_addr learned my addr 172.21.15.67:0/2742621350 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3286800640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f328815aa20 0x7f32881515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285e00640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32880d33a0 0x7f32880b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 -- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32880d33a0 msgr2=0x7f32880b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32880d33a0 0x7f32880b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 -- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f328815aa20 msgr2=0x7f32881515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f328815aa20 0x7f32881515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 -- 172.21.15.67:0/2742621350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32880c8510 con 0x7f328815e7c0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.955+0000 7f3285400640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f327400c3c0 tx=0x7f327400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:25.958 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274017070 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32740035f0 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32740039e0 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32880b9a20 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32880b9fe0 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f327401a070 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.956+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3274003b80 con 0x7f328815e7c0 2024-04-16T13:04:25.959 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.957+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3288075c70 con 0x7f328815e7c0 2024-04-16T13:04:25.961 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:25.960+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3274021020 con 0x7f328815e7c0 2024-04-16T13:04:26.028 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.027+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32880c86e0 con 0x7f328815e7c0 2024-04-16T13:04:26.029 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.028+0000 7f327e000640 1 -- 172.21.15.67:0/2742621350 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f327401c440 con 0x7f328815e7c0 2024-04-16T13:04:26.029 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-16T13:04:26.029 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:24.569896+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:26.030 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 msgr2=0x7f328815d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:26.030 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f327400c3c0 tx=0x7f327400c880 comp rx=0 tx=0).stop 2024-04-16T13:04:26.030 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 shutdown_connections 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f328815aa20 0x7f32881515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328815e7c0 0x7f328815d0a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 --2- 172.21.15.67:0/2742621350 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f32880d33a0 0x7f32880b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 >> 172.21.15.67:0/2742621350 conn(0x7f328809d9b0 msgr2=0x7f3288069990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 shutdown_connections 2024-04-16T13:04:26.031 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:26.029+0000 7f3287200640 1 -- 172.21.15.67:0/2742621350 wait complete. 2024-04-16T13:04:26.043 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T13:04:26.267 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:26.264+0000 7f80ca02b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T13:04:26.285 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:26.284+0000 7f4b02c2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T13:04:26.328 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:26.325+0000 7f80ca02b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T13:04:26.348 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:26.347+0000 7f4b02c2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T13:04:26.460 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:26.458+0000 7f80ca02b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T13:04:26.489 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-04-16T13:04:26.488+0000 7f4b02c2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T13:04:27.503 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:27.501+0000 7f806a200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-16T13:04:27.508 INFO:tasks.ceph.mgr.x.smithi082.stderr:2024-04-16T13:04:27.506+0000 7f806a200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-16T13:04:28.903 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-04-16T13:04:28.901+0000 7faf1c793640 -1 osd.7 0 log_to_monitors true 2024-04-16T13:04:28.911 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-16T13:04:28.910+0000 7f7c9221d640 -1 osd.1 0 log_to_monitors true 2024-04-16T13:04:28.960 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-04-16T13:04:28.957+0000 7f2a1b60c640 -1 osd.4 0 log_to_monitors true 2024-04-16T13:04:28.973 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-16T13:04:28.972+0000 7f32c1614640 -1 osd.3 0 log_to_monitors true 2024-04-16T13:04:29.000 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-04-16T13:04:28.998+0000 7efe99c0f640 -1 osd.6 0 log_to_monitors true 2024-04-16T13:04:29.029 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-16T13:04:29.028+0000 7f802700f640 -1 osd.2 0 log_to_monitors true 2024-04-16T13:04:29.029 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-16T13:04:29.028+0000 7f30d5e0e640 -1 osd.0 0 log_to_monitors true 2024-04-16T13:04:29.074 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-04-16T13:04:29.072+0000 7f7d6af49640 -1 osd.5 0 log_to_monitors true 2024-04-16T13:04:32.815 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-04-16T13:04:32.814+0000 7faf17600640 -1 osd.7 0 waiting for initial osdmap 2024-04-16T13:04:32.826 INFO:tasks.ceph.osd.7.smithi082.stderr:2024-04-16T13:04:32.824+0000 7faf0d600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.849 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:32.875 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-04-16T13:04:32.873+0000 7efe94400640 -1 osd.6 0 waiting for initial osdmap 2024-04-16T13:04:32.885 INFO:tasks.ceph.osd.6.smithi082.stderr:2024-04-16T13:04:32.884+0000 7efe8a400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.902 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-04-16T13:04:32.900+0000 7f7d65e00640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T13:04:32.908 INFO:tasks.ceph.osd.5.smithi082.stderr:2024-04-16T13:04:32.907+0000 7f7d5be00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.931 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-04-16T13:04:32.929+0000 7f2a15e00640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T13:04:32.942 INFO:tasks.ceph.osd.4.smithi082.stderr:2024-04-16T13:04:32.941+0000 7f2a0be00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.960 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-16T13:04:32.959+0000 7f8022200640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T13:04:32.971 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-04-16T13:04:32.970+0000 7f8017800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.979 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-16T13:04:32.977+0000 7f7c8d600640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T13:04:32.987 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-16T13:04:32.985+0000 7f30d0600640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T13:04:32.991 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-04-16T13:04:32.990+0000 7f7c82c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:32.996 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-04-16T13:04:32.994+0000 7f30c6600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:33.053 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.052+0000 7f9827600640 1 Processor -- start 2024-04-16T13:04:33.053 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.052+0000 7f9827600640 1 -- start start 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9827600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9820160420 0x7f982015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9827600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98201608b0 con 0x7f982015c990 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9827600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9820160b90 con 0x7f98200b3cf0 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9827600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9820160e70 con 0x7f9820160420 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9824c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f982015c990 0x7f98200b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41004/0 (socket says 172.21.15.67:41004) 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.053+0000 7f9824c00640 1 -- 172.21.15.67:0/4014365664 learned_addr learned my addr 172.21.15.67:0/4014365664 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133593932 0 0) 0x7f98201608b0 con 0x7f982015c990 2024-04-16T13:04:33.055 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9808003520 con 0x7f982015c990 2024-04-16T13:04:33.056 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981fe00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9820160420 0x7f982015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3172374825 0 0) 0x7f9808003520 con 0x7f982015c990 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9820160420 msgr2=0x7f982015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9820160420 0x7f982015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 >> v1:172.21.15.82:6789/0 conn(0x7f98200b3cf0 legacy=0x7f98200b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9820161150 con 0x7f982015c990 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f9814001670 con 0x7f982015c990 2024-04-16T13:04:33.057 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 >> v1:172.21.15.67:6789/0 conn(0x7f982015c990 legacy=0x7f98200b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98080039e0 0x7f9808003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9808004800 0x7f9808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808005210 0x7f980800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9820160e70 con 0x7f9808004800 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f980800bf30 con 0x7f98080039e0 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.054+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f980800c130 con 0x7f9808005210 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9808004800 0x7f9808004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f9824c00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98080039e0 0x7f9808003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 -- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808005210 msgr2=0x7f980800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808005210 0x7f980800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 -- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98080039e0 msgr2=0x7f9808003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98080039e0 0x7f9808003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.058 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.055+0000 7f981fe00640 1 -- 172.21.15.67:0/4014365664 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9808003520 con 0x7f9808004800 2024-04-16T13:04:33.059 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.056+0000 7f981fe00640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9808004800 0x7f9808004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f980c00ba00 tx=0x7f9808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aae49f04639892b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:33.059 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.056+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c036020 con 0x7f9808004800 2024-04-16T13:04:33.060 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.056+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c032630 con 0x7f9808004800 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.056+0000 7f981f400640 1 -- 172.21.15.67:0/4014365664 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c00b600 con 0x7f9808004800 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 -- 172.21.15.67:0/4014365664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9808004800 msgr2=0x7f9808004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 --2- 172.21.15.67:0/4014365664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9808004800 0x7f9808004c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f980c00ba00 tx=0x7f9808005830 comp rx=0 tx=0).stop 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9825600640 1 -- 172.21.15.67:0/4014365664 reap_dead start 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 -- 172.21.15.67:0/4014365664 shutdown_connections 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 -- 172.21.15.67:0/4014365664 >> 172.21.15.67:0/4014365664 conn(0x7f982009a9d0 msgr2=0x7f98200b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 -- 172.21.15.67:0/4014365664 shutdown_connections 2024-04-16T13:04:33.061 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.057+0000 7f9827600640 1 -- 172.21.15.67:0/4014365664 wait complete. 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.059+0000 7f9827600640 1 Processor -- start 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.059+0000 7f9827600640 1 -- start start 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808004800 0x7f98200cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 0x7f982015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.063 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f982015cd70 con 0x7f98200d1700 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f982015cef0 con 0x7f982015efb0 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9827600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f982015d070 con 0x7f9808004800 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45746/0 (socket says 172.21.15.67:45746) 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 -- 172.21.15.67:0/2678497377 learned_addr learned my addr 172.21.15.67:0/2678497377 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 -- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808004800 msgr2=0x7f98200cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808004800 0x7f98200cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f9825600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 0x7f982015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 -- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 msgr2=0x7f982015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 0x7f982015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.060+0000 7f981fe00640 1 -- 172.21.15.67:0/2678497377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982015a830 con 0x7f98200d1700 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f9825600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 0x7f982015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f981fe00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f980c00bb20 tx=0x7f980c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c041070 con 0x7f98200d1700 2024-04-16T13:04:33.064 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c030a40 con 0x7f98200d1700 2024-04-16T13:04:33.065 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c036040 con 0x7f98200d1700 2024-04-16T13:04:33.065 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982015ab10 con 0x7f98200d1700 2024-04-16T13:04:33.065 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.061+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982015b0d0 con 0x7f98200d1700 2024-04-16T13:04:33.065 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.063+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98200d20c0 con 0x7f98200d1700 2024-04-16T13:04:33.065 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.064+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f980c039020 con 0x7f98200d1700 2024-04-16T13:04:33.066 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.064+0000 7f981cc00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 0x7f980006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:33.066 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.064+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f980c0acfc0 con 0x7f98200d1700 2024-04-16T13:04:33.066 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.065+0000 7f9824c00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 0x7f980006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:33.067 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.066+0000 7f9824c00640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 0x7f980006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9814001050 tx=0x7f9814000f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:33.071 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.070+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f980c07c130 con 0x7f98200d1700 2024-04-16T13:04:33.080 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-16T13:04:33.079+0000 7f32bbe00640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T13:04:33.087 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-04-16T13:04:33.086+0000 7f32b1e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T13:04:33.271 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.270+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9820075ce0 con 0x7f98200d1700 2024-04-16T13:04:33.273 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.271+0000 7f981cc00640 1 -- 172.21.15.67:0/2678497377 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f980c07ba30 con 0x7f98200d1700 2024-04-16T13:04:33.273 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-16T13:04:33.273 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":12,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:30.509489+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:33.275 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 msgr2=0x7f980006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.275 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 0x7f980006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9814001050 tx=0x7f9814000f60 comp rx=0 tx=0).stop 2024-04-16T13:04:33.275 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 msgr2=0x7f98200d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:33.275 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f980c00bb20 tx=0x7f980c004730 comp rx=0 tx=0).stop 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 shutdown_connections 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980006c860 0x7f980006ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982015efb0 0x7f982015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98200d1700 0x7f98200d1b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 --2- 172.21.15.67:0/2678497377 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9808004800 0x7f98200cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 >> 172.21.15.67:0/2678497377 conn(0x7f982009a9d0 msgr2=0x7f98200cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 shutdown_connections 2024-04-16T13:04:33.276 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:33.274+0000 7f9827600640 1 -- 172.21.15.67:0/2678497377 wait complete. 2024-04-16T13:04:33.289 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-16T13:04:36.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:04:36.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:04:40.095 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:40.291 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.290+0000 7f42f8e00640 1 Processor -- start 2024-04-16T13:04:40.291 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.290+0000 7f42f8e00640 1 -- start start 2024-04-16T13:04:40.293 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f8e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42f4145fb0 0x7f42f40cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.293 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f8e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.293 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f8e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f415cf60 con 0x7f42f406bf60 2024-04-16T13:04:40.293 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f8e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f42f406c3d0 con 0x7f42f4145fb0 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f8e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f42f415d890 con 0x7f42f40b5550 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f1e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42f4145fb0 0x7f42f40cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f1e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f42f4145fb0 0x7f42f40cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45752/0 (socket says 172.21.15.67:45752) 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f1e00640 1 -- 172.21.15.67:0/91833659 learned_addr learned my addr 172.21.15.67:0/91833659 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.292+0000 7f42f2800640 1 --1- 172.21.15.67:0/91833659 >> v1:172.21.15.67:6789/0 conn(0x7f42f406bf60 0x7f42f4160440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41010/0 (socket says 172.21.15.67:41010) 2024-04-16T13:04:40.294 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f1400640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.295 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f1e00640 1 -- 172.21.15.67:0/91833659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 msgr2=0x7f42f406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:40.295 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f1e00640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.295 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f1e00640 1 -- 172.21.15.67:0/91833659 >> v1:172.21.15.67:6789/0 conn(0x7f42f406bf60 legacy=0x7f42f4160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.295 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f1e00640 1 -- 172.21.15.67:0/91833659 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f415d240 con 0x7f42f4145fb0 2024-04-16T13:04:40.295 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.293+0000 7f42f0a00640 1 -- 172.21.15.67:0/91833659 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736718830 0 0) 0x7f42f415cf60 con 0x7f42f406bf60 2024-04-16T13:04:40.296 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.294+0000 7f42f1e00640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f40cd8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009870 tx=0x7f42e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efce6c48f3187038 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.296 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.294+0000 7f42f0a00640 1 -- 172.21.15.67:0/91833659 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4034070 con 0x7f42f4145fb0 2024-04-16T13:04:40.296 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.294+0000 7f42f0a00640 1 -- 172.21.15.67:0/91833659 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e4030840 con 0x7f42f4145fb0 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.294+0000 7f42f0a00640 1 -- 172.21.15.67:0/91833659 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4030c10 con 0x7f42f4145fb0 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 -- 172.21.15.67:0/91833659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 msgr2=0x7f42f40cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f40cd8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009870 tx=0x7f42e402b980 comp rx=0 tx=0).stop 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 -- 172.21.15.67:0/91833659 shutdown_connections 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 --2- 172.21.15.67:0/91833659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f40cd8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 -- 172.21.15.67:0/91833659 >> 172.21.15.67:0/91833659 conn(0x7f42f40b21e0 msgr2=0x7f42f40b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 -- 172.21.15.67:0/91833659 shutdown_connections 2024-04-16T13:04:40.297 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.295+0000 7f42f8e00640 1 -- 172.21.15.67:0/91833659 wait complete. 2024-04-16T13:04:40.298 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.297+0000 7f42f8e00640 1 Processor -- start 2024-04-16T13:04:40.298 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.297+0000 7f42f8e00640 1 -- start start 2024-04-16T13:04:40.299 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 0x7f42f413ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.299 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f42f415dd20 con 0x7f42f4145fb0 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40d0140 con 0x7f42f406bf60 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f8e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40cdeb0 con 0x7f42f40b5550 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45762/0 (socket says 172.21.15.67:45762) 2024-04-16T13:04:40.300 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.298+0000 7f42f2800640 1 -- 172.21.15.67:0/4120096218 learned_addr learned my addr 172.21.15.67:0/4120096218 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:40.301 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f1400640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.301 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f1e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 0x7f42f413ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 -- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 msgr2=0x7f42f415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 -- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 msgr2=0x7f42f413ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 0x7f42f413ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 -- 172.21.15.67:0/4120096218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41403f0 con 0x7f42f4145fb0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f1e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 0x7f42f413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42f2800640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c7a0 tx=0x7f42ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.299+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec018070 con 0x7f42f4145fb0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.300+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ec00a640 con 0x7f42f4145fb0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.300+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00aab0 con 0x7f42f4145fb0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.300+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f415df40 con 0x7f42f4145fb0 2024-04-16T13:04:40.302 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.300+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f415e7e0 con 0x7f42f4145fb0 2024-04-16T13:04:40.303 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.301+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f415e110 con 0x7f42f4145fb0 2024-04-16T13:04:40.303 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.302+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42ec00ac50 con 0x7f42f4145fb0 2024-04-16T13:04:40.304 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.303+0000 7f42ea000640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 0x7f42d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.304 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.303+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f42ec08afb0 con 0x7f42f4145fb0 2024-04-16T13:04:40.304 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.303+0000 7f42f1e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 0x7f42d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.305 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.305+0000 7f42f1e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 0x7f42d406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42e4036000 tx=0x7f42e403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.309 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.308+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42f41403f0 con 0x7f42f4145fb0 2024-04-16T13:04:40.514 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.513+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42f415e9e0 con 0x7f42f4145fb0 2024-04-16T13:04:40.516 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.515+0000 7f42ea000640 1 -- 172.21.15.67:0/4120096218 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12788 (secure 0 0 0) 0x7f42f415e9e0 con 0x7f42f4145fb0 2024-04-16T13:04:40.517 INFO:teuthology.misc.health.smithi067.stdout: 2024-04-16T13:04:40.517 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":16,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:36.880143+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:40.519 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 msgr2=0x7f42d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.519 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 0x7f42d406edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42e4036000 tx=0x7f42e403b040 comp rx=0 tx=0).stop 2024-04-16T13:04:40.519 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 msgr2=0x7f42f413d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.519 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c7a0 tx=0x7f42ec00cc60 comp rx=0 tx=0).stop 2024-04-16T13:04:40.519 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 shutdown_connections 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f42d406c8f0 0x7f42d406edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42f4145fb0 0x7f42f413d7d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f42f40b5550 0x7f42f415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 --2- 172.21.15.67:0/4120096218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42f406bf60 0x7f42f413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 >> 172.21.15.67:0/4120096218 conn(0x7f42f40b21e0 msgr2=0x7f42f40b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 shutdown_connections 2024-04-16T13:04:40.520 INFO:teuthology.misc.health.smithi067.stderr:2024-04-16T13:04:40.518+0000 7f42f8e00640 1 -- 172.21.15.67:0/4120096218 wait complete. 2024-04-16T13:04:40.533 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-16T13:04:40.533 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-16T13:04:40.533 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T13:04:40.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T13:04:40.540 INFO:tasks.ceph.mds.a:Started 2024-04-16T13:04:40.540 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T13:04:40.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T13:04:40.547 INFO:tasks.ceph.mds.c:Started 2024-04-16T13:04:40.547 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T13:04:40.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T13:04:40.555 INFO:tasks.ceph.mds.b:Started 2024-04-16T13:04:40.555 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T13:04:40.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T13:04:40.562 INFO:tasks.ceph.mds.d:Started 2024-04-16T13:04:40.562 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-16T13:04:40.563 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:40.692 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-04-16T13:04:40.700 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-04-16T13:04:40.717 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-04-16T13:04:40.718 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-04-16T13:04:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.745+0000 7fe198200640 1 Processor -- start 2024-04-16T13:04:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.745+0000 7fe198200640 1 -- start start 2024-04-16T13:04:40.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.746+0000 7fe198200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.746+0000 7fe198200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1900cec90 0x7fe19015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.746+0000 7fe198200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19006dd50 con 0x7fe190071e50 2024-04-16T13:04:40.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.746+0000 7fe198200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe19015d4e0 con 0x7fe1900cec90 2024-04-16T13:04:40.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.746+0000 7fe198200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe19015d7c0 con 0x7fe190146150 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe194e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1900cec90 0x7fe19015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe195800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe196200640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe190071e50 0x7fe19006e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:35906/0 (socket says 172.21.15.67:35906) 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe196200640 1 -- 172.21.15.67:0/1663254486 learned_addr learned my addr 172.21.15.67:0/1663254486 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe195800640 1 -- 172.21.15.67:0/1663254486 >> v2:172.21.15.82:3300/0 conn(0x7fe1900cec90 msgr2=0x7fe19015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe195800640 1 --2- 172.21.15.67:0/1663254486 >> v2:172.21.15.82:3300/0 conn(0x7fe1900cec90 0x7fe19015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe195800640 1 -- 172.21.15.67:0/1663254486 >> v1:172.21.15.82:6789/0 conn(0x7fe190071e50 legacy=0x7fe19006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe195800640 1 -- 172.21.15.67:0/1663254486 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19015daa0 con 0x7fe190146150 2024-04-16T13:04:40.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.747+0000 7fe18fe00640 1 -- 172.21.15.67:0/1663254486 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497230356 0 0) 0x7fe19006dd50 con 0x7fe190071e50 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.748+0000 7fe195800640 1 --2- 172.21.15.67:0/1663254486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015cca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1840097a0 tx=0x7fe18402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6129ddac82bcc52 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe18fe00640 1 -- 172.21.15.67:0/1663254486 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184038070 con 0x7fe190146150 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe18fe00640 1 -- 172.21.15.67:0/1663254486 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184031700 con 0x7fe190146150 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe18fe00640 1 -- 172.21.15.67:0/1663254486 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184031ad0 con 0x7fe190146150 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 -- 172.21.15.67:0/1663254486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 msgr2=0x7fe19015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 --2- 172.21.15.67:0/1663254486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015cca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe1840097a0 tx=0x7fe18402b7a0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 -- 172.21.15.67:0/1663254486 shutdown_connections 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 --2- 172.21.15.67:0/1663254486 >> v2:172.21.15.82:3300/0 conn(0x7fe1900cec90 0x7fe19015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 --2- 172.21.15.67:0/1663254486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015cca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 -- 172.21.15.67:0/1663254486 >> 172.21.15.67:0/1663254486 conn(0x7fe1900b2210 msgr2=0x7fe1900b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:40.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.749+0000 7fe198200640 1 -- 172.21.15.67:0/1663254486 shutdown_connections 2024-04-16T13:04:40.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.750+0000 7fe198200640 1 -- 172.21.15.67:0/1663254486 wait complete. 2024-04-16T13:04:40.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.751+0000 7fe198200640 1 Processor -- start 2024-04-16T13:04:40.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.751+0000 7fe198200640 1 -- start start 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe190071e50 0x7fe1900ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015e580 con 0x7fe1900cec90 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015e400 con 0x7fe190071e50 2024-04-16T13:04:40.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe198200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe19006e960 con 0x7fe190146150 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe194e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe194e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45804/0 (socket says 172.21.15.67:45804) 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.752+0000 7fe194e00640 1 -- 172.21.15.67:0/2690222454 learned_addr learned my addr 172.21.15.67:0/2690222454 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe196200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe195800640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe190071e50 0x7fe1900ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 -- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 msgr2=0x7fe19015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 -- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe190071e50 msgr2=0x7fe1900ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe190071e50 0x7fe1900ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 -- 172.21.15.67:0/2690222454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900acc50 con 0x7fe1900cec90 2024-04-16T13:04:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.753+0000 7fe194e00640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00e9e0 tx=0x7fe17c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.754+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c017070 con 0x7fe1900cec90 2024-04-16T13:04:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.754+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1900abc10 con 0x7fe1900cec90 2024-04-16T13:04:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.754+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1900ac450 con 0x7fe1900cec90 2024-04-16T13:04:40.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.754+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c005990 con 0x7fe1900cec90 2024-04-16T13:04:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.754+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c021060 con 0x7fe1900cec90 2024-04-16T13:04:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.755+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c005290 con 0x7fe1900cec90 2024-04-16T13:04:40.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.756+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe17c01a070 con 0x7fe1900cec90 2024-04-16T13:04:40.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.757+0000 7fe18d600640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:40.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.757+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe17c08b7a0 con 0x7fe1900cec90 2024-04-16T13:04:40.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.757+0000 7fe195800640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:40.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.758+0000 7fe195800640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 0x7fe17006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe184035000 tx=0x7fe184008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:40.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.762+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1900abc10 con 0x7fe1900cec90 2024-04-16T13:04:40.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.963+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe16c005580 con 0x7fe1900cec90 2024-04-16T13:04:40.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.965+0000 7fe18d600640 1 -- 172.21.15.67:0/2690222454 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12788 (secure 0 0 0) 0x7fe17c059830 con 0x7fe1900cec90 2024-04-16T13:04:40.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:40.967 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:36.880143+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:40.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 msgr2=0x7fe17006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 0x7fe17006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe184035000 tx=0x7fe184008030 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 msgr2=0x7fe1900b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00e9e0 tx=0x7fe17c00eea0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 shutdown_connections 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe190146150 0x7fe19015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1900cec90 0x7fe1900b4a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 --2- 172.21.15.67:0/2690222454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe190071e50 0x7fe1900ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 >> 172.21.15.67:0/2690222454 conn(0x7fe1900b2210 msgr2=0x7fe19015e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 shutdown_connections 2024-04-16T13:04:40.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:40.968+0000 7fe198200640 1 -- 172.21.15.67:0/2690222454 wait complete. 2024-04-16T13:04:40.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T13:04:40.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:04:41.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.187+0000 7f981a200640 1 Processor -- start 2024-04-16T13:04:41.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.187+0000 7f981a200640 1 -- start start 2024-04-16T13:04:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.188+0000 7f981a200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f981415eb40 0x7f98140b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.188+0000 7f981a200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98140707c0 0x7f98140ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.188+0000 7f981a200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981415ef20 con 0x7f98140b6550 2024-04-16T13:04:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.188+0000 7f981a200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f981406c6d0 con 0x7f981415eb40 2024-04-16T13:04:41.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.188+0000 7f981a200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f981406bac0 con 0x7f98140707c0 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f981415eb40 0x7f98140b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f981415eb40 0x7f98140b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45820/0 (socket says 172.21.15.67:45820) 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 -- 172.21.15.67:0/3318427535 learned_addr learned my addr 172.21.15.67:0/3318427535 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 -- 172.21.15.67:0/3318427535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98140707c0 msgr2=0x7f98140ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 --2- 172.21.15.67:0/3318427535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98140707c0 0x7f98140ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 -- 172.21.15.67:0/3318427535 >> v1:172.21.15.82:6789/0 conn(0x7f98140b6550 legacy=0x7f98140700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:41.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.189+0000 7f9818e00640 1 -- 172.21.15.67:0/3318427535 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981406bda0 con 0x7f981415eb40 2024-04-16T13:04:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.190+0000 7f9818e00640 1 --2- 172.21.15.67:0/3318427535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981415eb40 0x7f98140b6010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009870 tx=0x7f97fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a5f6f05757d593 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.190+0000 7f9813400640 1 -- 172.21.15.67:0/3318427535 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc02e070 con 0x7f981415eb40 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f9813400640 1 -- 172.21.15.67:0/3318427535 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc037070 con 0x7f981415eb40 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f9813400640 1 -- 172.21.15.67:0/3318427535 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc031a00 con 0x7f981415eb40 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 -- 172.21.15.67:0/3318427535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981415eb40 msgr2=0x7f98140b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 --2- 172.21.15.67:0/3318427535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981415eb40 0x7f98140b6010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009870 tx=0x7f97fc02b880 comp rx=0 tx=0).stop 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 -- 172.21.15.67:0/3318427535 shutdown_connections 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 --2- 172.21.15.67:0/3318427535 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f98140707c0 0x7f98140ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 --2- 172.21.15.67:0/3318427535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f981415eb40 0x7f98140b6010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 -- 172.21.15.67:0/3318427535 >> 172.21.15.67:0/3318427535 conn(0x7f98140732a0 msgr2=0x7f98140b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 -- 172.21.15.67:0/3318427535 shutdown_connections 2024-04-16T13:04:41.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.191+0000 7f981a200640 1 -- 172.21.15.67:0/3318427535 wait complete. 2024-04-16T13:04:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.193+0000 7f981a200640 1 Processor -- start 2024-04-16T13:04:41.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.193+0000 7f981a200640 1 -- start start 2024-04-16T13:04:41.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140b6550 0x7f98140ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f981415eb40 0x7f98140d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f981409aae0 con 0x7f98140707c0 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f981406c360 con 0x7f98140b6550 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f981a200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f981409ac60 con 0x7f981415eb40 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f9818e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f9818e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45828/0 (socket says 172.21.15.67:45828) 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.194+0000 7f9818e00640 1 -- 172.21.15.67:0/2595216122 learned_addr learned my addr 172.21.15.67:0/2595216122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 -- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f981415eb40 msgr2=0x7f98140d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f981415eb40 0x7f98140d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 -- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140b6550 msgr2=0x7f98140ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140b6550 0x7f98140ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 -- 172.21.15.67:0/2595216122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98141f5a80 con 0x7f98140707c0 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9818e00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f97fc000c00 tx=0x7f97fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc032880 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97fc032a40 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97fc032e30 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98140cf720 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.195+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98140cfce0 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.196+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9814075bd0 con 0x7f98140707c0 2024-04-16T13:04:41.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.197+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97fc04c060 con 0x7f98140707c0 2024-04-16T13:04:41.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.199+0000 7f9810c00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 0x7f97f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.199+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f97fc0ad470 con 0x7f98140707c0 2024-04-16T13:04:41.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.199+0000 7f9813e00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 0x7f97f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.200+0000 7f9813e00640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 0x7f97f006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9814161ec0 tx=0x7f9804009250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.204+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f97fc040070 con 0x7f98140707c0 2024-04-16T13:04:41.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.410+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98140b4d70 con 0x7f98140707c0 2024-04-16T13:04:41.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.411+0000 7f9810c00640 1 -- 172.21.15.67:0/2595216122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f97fc07bb50 con 0x7f98140707c0 2024-04-16T13:04:41.413 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:04:41.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 msgr2=0x7f97f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 0x7f97f006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9814161ec0 tx=0x7f9804009250 comp rx=0 tx=0).stop 2024-04-16T13:04:41.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 msgr2=0x7f9814154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f97fc000c00 tx=0x7f97fc0046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 shutdown_connections 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f97f006c8f0 0x7f97f006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f981415eb40 0x7f98140d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140b6550 0x7f98140ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 --2- 172.21.15.67:0/2595216122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98140707c0 0x7f9814154f40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 >> 172.21.15.67:0/2595216122 conn(0x7f98140732a0 msgr2=0x7f981415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 shutdown_connections 2024-04-16T13:04:41.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.414+0000 7f981a200640 1 -- 172.21.15.67:0/2595216122 wait complete. 2024-04-16T13:04:41.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:04:41.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.648+0000 7f6773200640 1 Processor -- start 2024-04-16T13:04:41.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.648+0000 7f6773200640 1 -- start start 2024-04-16T13:04:41.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6773200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f677415bb60 0x7f67740ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6773200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677415ff30 con 0x7f677415b3a0 2024-04-16T13:04:41.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6773200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677415f970 con 0x7f67740cd280 2024-04-16T13:04:41.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6773200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f677415f710 con 0x7f677415bb60 2024-04-16T13:04:41.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6771e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f677415b3a0 0x7f677415f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41030/0 (socket says 172.21.15.67:41030) 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6771e00640 1 -- 172.21.15.67:0/3409773618 learned_addr learned my addr 172.21.15.67:0/3409773618 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f676be00640 1 --2- 172.21.15.67:0/3409773618 >> v2:172.21.15.67:3300/0 conn(0x7f677415bb60 0x7f67740ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f6771400640 1 -- 172.21.15.67:0/3409773618 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233703077 0 0) 0x7f677415ff30 con 0x7f677415b3a0 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f676be00640 1 -- 172.21.15.67:0/3409773618 >> v1:172.21.15.82:6789/0 conn(0x7f67740cd280 legacy=0x7f67740ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f676be00640 1 -- 172.21.15.67:0/3409773618 >> v1:172.21.15.67:6789/0 conn(0x7f677415b3a0 legacy=0x7f677415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.650+0000 7f676be00640 1 -- 172.21.15.67:0/3409773618 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677415fc50 con 0x7f677415bb60 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f676be00640 1 --2- 172.21.15.67:0/3409773618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740ccd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f675c0097a0 tx=0x7f675c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f80405f1c09f34 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6771400640 1 -- 172.21.15.67:0/3409773618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0315a0 con 0x7f677415bb60 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6771400640 1 -- 172.21.15.67:0/3409773618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c037070 con 0x7f677415bb60 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6771400640 1 -- 172.21.15.67:0/3409773618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c031960 con 0x7f677415bb60 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6773200640 1 -- 172.21.15.67:0/3409773618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 msgr2=0x7f67740ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6773200640 1 --2- 172.21.15.67:0/3409773618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740ccd40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f675c0097a0 tx=0x7f675c02b840 comp rx=0 tx=0).stop 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6773200640 1 -- 172.21.15.67:0/3409773618 shutdown_connections 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6773200640 1 --2- 172.21.15.67:0/3409773618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740ccd40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.652+0000 7f6773200640 1 -- 172.21.15.67:0/3409773618 >> 172.21.15.67:0/3409773618 conn(0x7f67740b2070 msgr2=0x7f67740b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.653+0000 7f6773200640 1 -- 172.21.15.67:0/3409773618 shutdown_connections 2024-04-16T13:04:41.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.653+0000 7f6773200640 1 -- 172.21.15.67:0/3409773618 wait complete. 2024-04-16T13:04:41.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.654+0000 7f6773200640 1 Processor -- start 2024-04-16T13:04:41.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.654+0000 7f6773200640 1 -- start start 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67740cd280 0x7f6774157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f677415b3a0 0x7f67741f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f677415b900 con 0x7f677415bb60 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f677415b780 con 0x7f677415b3a0 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6773200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f67740cafa0 con 0x7f67740cd280 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.655+0000 7f6772800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45848/0 (socket says 172.21.15.67:45848) 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 -- 172.21.15.67:0/3288700665 learned_addr learned my addr 172.21.15.67:0/3288700665 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f676be00640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f677415b3a0 0x7f67741f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6771e00640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67740cd280 0x7f6774157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 -- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67740cd280 msgr2=0x7f6774157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67740cd280 0x7f6774157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 -- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f677415b3a0 msgr2=0x7f67741f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f677415b3a0 0x7f67741f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 -- 172.21.15.67:0/3288700665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67741f60e0 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.656+0000 7f6772800640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c780 tx=0x7f676c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.657+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c004b60 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.657+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676c004d00 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.657+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c00aa90 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.657+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67741f63c0 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.657+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6774158ab0 con 0x7f677415bb60 2024-04-16T13:04:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.658+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6774075bd0 con 0x7f677415bb60 2024-04-16T13:04:41.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.659+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f676c00ac30 con 0x7f677415bb60 2024-04-16T13:04:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.660+0000 7f676a000640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 0x7f675006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.660+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f676c08bb40 con 0x7f677415bb60 2024-04-16T13:04:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.661+0000 7f6771e00640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 0x7f675006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:41.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.662+0000 7f6771e00640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 0x7f675006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6764000f60 tx=0x7f6764009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:41.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.665+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f676c020070 con 0x7f677415bb60 2024-04-16T13:04:41.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.907+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67740b50d0 con 0x7f677415bb60 2024-04-16T13:04:41.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.908+0000 7f676a000640 1 -- 172.21.15.67:0/3288700665 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3855 (secure 0 0 0) 0x7f676c05a220 con 0x7f677415bb60 2024-04-16T13:04:41.909 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:41.909 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-16T13:04:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 3 2024-04-16T13:04:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.910+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 msgr2=0x7f675006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.910+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 0x7f675006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6764000f60 tx=0x7f6764009040 comp rx=0 tx=0).stop 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.910+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 msgr2=0x7f67740c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.910+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c780 tx=0x7f676c00cc40 comp rx=0 tx=0).stop 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.910+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 shutdown_connections 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f675006c8f0 0x7f675006edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f677415bb60 0x7f67740c56a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f677415b3a0 0x7f67741f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 --2- 172.21.15.67:0/3288700665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f67740cd280 0x7f6774157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:41.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 >> 172.21.15.67:0/3288700665 conn(0x7f67740b2070 msgr2=0x7f67740b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:41.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 shutdown_connections 2024-04-16T13:04:41.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:41.911+0000 7f6773200640 1 -- 172.21.15.67:0/3288700665 wait complete. 2024-04-16T13:04:41.934 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:42.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.142+0000 7faec6600640 1 Processor -- start 2024-04-16T13:04:42.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.143+0000 7faec6600640 1 -- start start 2024-04-16T13:04:42.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faec6600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faec006d360 0x7faec006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faec6600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 0x7faec00d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faec6600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec00d0000 con 0x7faec015eaa0 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faec6600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7faec006dd00 con 0x7faec006d360 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faec6600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faec00d0c10 con 0x7faec00d27b0 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faebfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faec006d360 0x7faec006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faebfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faec006d360 0x7faec006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45634/0 (socket says 172.21.15.67:45634) 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.144+0000 7faebfe00640 1 -- 172.21.15.67:0/3489209089 learned_addr learned my addr 172.21.15.67:0/3489209089 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:42.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faebfe00640 1 -- 172.21.15.67:0/3489209089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 msgr2=0x7faec00d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faec5c00640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 0x7faec00d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faebfe00640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 0x7faec00d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faebfe00640 1 -- 172.21.15.67:0/3489209089 >> v1:172.21.15.82:6789/0 conn(0x7faec015eaa0 legacy=0x7faec00d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faebfe00640 1 -- 172.21.15.67:0/3489209089 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec00d02e0 con 0x7faec006d360 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.145+0000 7faec5c00640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 0x7faec00d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.146+0000 7faebfe00640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec006d360 0x7faec006d7c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c1e454e3e53d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.146+0000 7faebf400640 1 -- 172.21.15.67:0/3489209089 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea80317c0 con 0x7faec006d360 2024-04-16T13:04:42.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.146+0000 7faebf400640 1 -- 172.21.15.67:0/3489209089 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8037070 con 0x7faec006d360 2024-04-16T13:04:42.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.146+0000 7faebf400640 1 -- 172.21.15.67:0/3489209089 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8031b80 con 0x7faec006d360 2024-04-16T13:04:42.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 -- 172.21.15.67:0/3489209089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec006d360 msgr2=0x7faec006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec006d360 0x7faec006d7c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea802b860 comp rx=0 tx=0).stop 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 -- 172.21.15.67:0/3489209089 shutdown_connections 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec00d27b0 0x7faec00d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 --2- 172.21.15.67:0/3489209089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec006d360 0x7faec006d7c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 -- 172.21.15.67:0/3489209089 >> 172.21.15.67:0/3489209089 conn(0x7faec008c000 msgr2=0x7faec00d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 -- 172.21.15.67:0/3489209089 shutdown_connections 2024-04-16T13:04:42.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.147+0000 7faec6600640 1 -- 172.21.15.67:0/3489209089 wait complete. 2024-04-16T13:04:42.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.149+0000 7faec6600640 1 Processor -- start 2024-04-16T13:04:42.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.150+0000 7faec6600640 1 -- start start 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 0x7faec00b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec015eaa0 0x7faec01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faec00d53f0 con 0x7faec00d27b0 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faec00d08a0 con 0x7faec015eaa0 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faec6600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faec015ee80 con 0x7faec006d360 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faebfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faebfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45646/0 (socket says 172.21.15.67:45646) 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.151+0000 7faebfe00640 1 -- 172.21.15.67:0/834238830 learned_addr learned my addr 172.21.15.67:0/834238830 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:42.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faec5c00640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec015eaa0 0x7faec01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faec5200640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 0x7faec00b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 -- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 msgr2=0x7faec00b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 0x7faec00b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 -- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec015eaa0 msgr2=0x7faec01533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec015eaa0 0x7faec01533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 -- 172.21.15.67:0/834238830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec00b9b50 con 0x7faec00d27b0 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faec5200640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 0x7faec00b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:42.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebfe00640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8032860 con 0x7faec00d27b0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea8032a00 con 0x7faec00d27b0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8032df0 con 0x7faec00d27b0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.152+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec00b9e30 con 0x7faec00d27b0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.153+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec015f300 con 0x7faec00d27b0 2024-04-16T13:04:42.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.154+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec0073520 con 0x7faec00d27b0 2024-04-16T13:04:42.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.155+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faea804d3f0 con 0x7faec00d27b0 2024-04-16T13:04:42.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.156+0000 7faebcc00640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 0x7fae9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.156+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7faea80ad580 con 0x7faec00d27b0 2024-04-16T13:04:42.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.157+0000 7faec5200640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 0x7fae9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.158+0000 7faec5200640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 0x7fae9c06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faeb0004520 tx=0x7faeb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.161+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faec0073520 con 0x7faec00d27b0 2024-04-16T13:04:42.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.364+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec0075bd0 con 0x7faec00d27b0 2024-04-16T13:04:42.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.366+0000 7faebcc00640 1 -- 172.21.15.67:0/834238830 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12788 (secure 0 0 0) 0x7faea8040070 con 0x7faec00d27b0 2024-04-16T13:04:42.367 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:42.368 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:36.880143+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:42.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 msgr2=0x7fae9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 0x7fae9c06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faeb0004520 tx=0x7faeb0009040 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 msgr2=0x7faec00cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea80046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 shutdown_connections 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fae9c06c8f0 0x7fae9c06edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faec015eaa0 0x7faec01533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faec00d27b0 0x7faec00cda30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 --2- 172.21.15.67:0/834238830 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faec006d360 0x7faec00b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 >> 172.21.15.67:0/834238830 conn(0x7faec008c000 msgr2=0x7faec00d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 shutdown_connections 2024-04-16T13:04:42.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.369+0000 7faec6600640 1 -- 172.21.15.67:0/834238830 wait complete. 2024-04-16T13:04:42.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T13:04:42.390 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:04:42.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.608+0000 7fe163800640 1 Processor -- start 2024-04-16T13:04:42.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.608+0000 7fe163800640 1 -- start start 2024-04-16T13:04:42.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe163800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe15c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe163800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c0b0d80 con 0x7fe15c0cbc10 2024-04-16T13:04:42.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe163800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c0b1060 con 0x7fe15c0b3b00 2024-04-16T13:04:42.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe163800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c0b1340 con 0x7fe15c15ebc0 2024-04-16T13:04:42.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe161800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe15c0cbc10 0x7fe15c0d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36382/0 (socket says 172.21.15.67:36382) 2024-04-16T13:04:42.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.609+0000 7fe161800640 1 -- 172.21.15.67:0/1616786431 learned_addr learned my addr 172.21.15.67:0/1616786431 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:42.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe160e00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe15c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493959539 0 0) 0x7fe15c0b0d80 con 0x7fe15c0cbc10 2024-04-16T13:04:42.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe140003520 con 0x7fe15c0cbc10 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4198608555 0 0) 0x7fe140003520 con 0x7fe15c0cbc10 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 msgr2=0x7fe15c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe15c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 >> v1:172.21.15.82:6789/0 conn(0x7fe15c0b3b00 legacy=0x7fe15c0b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0b1620 con 0x7fe15c0cbc10 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fe1540019f0 con 0x7fe15c0cbc10 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 >> v1:172.21.15.67:6789/0 conn(0x7fe15c0cbc10 legacy=0x7fe15c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.610+0000 7fe15b400640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe1400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15b400640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe140003f60 0x7fe140004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15b400640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe140004d40 0x7fe1400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0b1340 con 0x7fe140003f60 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe14000baa0 con 0x7fe140004d40 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe14000bca0 con 0x7fe15c15ebc0 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe140003f60 0x7fe140004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe160e00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe1400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe161800640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe140004d40 0x7fe1400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 -- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 msgr2=0x7fe1400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe15c15ebc0 0x7fe1400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 -- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe140004d40 msgr2=0x7fe1400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe140004d40 0x7fe1400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.611+0000 7fe15be00640 1 -- 172.21.15.67:0/1616786431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe140003520 con 0x7fe140003f60 2024-04-16T13:04:42.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.612+0000 7fe15be00640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe140003f60 0x7fe140004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe148001720 tx=0x7fe140005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617e1a4bb5e9e892 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148001370 con 0x7fe140003f60 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1480052d0 con 0x7fe140003f60 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe15b400640 1 -- 172.21.15.67:0/1616786431 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148003830 con 0x7fe140003f60 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe163800640 1 -- 172.21.15.67:0/1616786431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe140003f60 msgr2=0x7fe140004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe163800640 1 --2- 172.21.15.67:0/1616786431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe140003f60 0x7fe140004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe148001720 tx=0x7fe140005830 comp rx=0 tx=0).stop 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe161800640 1 -- 172.21.15.67:0/1616786431 reap_dead start 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe163800640 1 -- 172.21.15.67:0/1616786431 shutdown_connections 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.613+0000 7fe163800640 1 -- 172.21.15.67:0/1616786431 >> 172.21.15.67:0/1616786431 conn(0x7fe15c09aa70 msgr2=0x7fe15c0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.614+0000 7fe163800640 1 -- 172.21.15.67:0/1616786431 shutdown_connections 2024-04-16T13:04:42.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.614+0000 7fe163800640 1 -- 172.21.15.67:0/1616786431 wait complete. 2024-04-16T13:04:42.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.615+0000 7fe163800640 1 Processor -- start 2024-04-16T13:04:42.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.616+0000 7fe163800640 1 -- start start 2024-04-16T13:04:42.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.616+0000 7fe163800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe140003f60 0x7fe15c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.616+0000 7fe163800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe163800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15c0ca650 0x7fe15c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe163800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0b2250 con 0x7fe15c0c72c0 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe163800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c06c320 con 0x7fe15c0ca650 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe163800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c0d1080 con 0x7fe140003f60 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45654/0 (socket says 172.21.15.67:45654) 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 -- 172.21.15.67:0/3923614988 learned_addr learned my addr 172.21.15.67:0/3923614988 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe160e00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe140003f60 0x7fe15c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 -- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe140003f60 msgr2=0x7fe15c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe140003f60 0x7fe15c15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe161800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15c0ca650 0x7fe15c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 -- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15c0ca650 msgr2=0x7fe15c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15c0ca650 0x7fe15c0caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.617+0000 7fe15be00640 1 -- 172.21.15.67:0/3923614988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0b4400 con 0x7fe15c0c72c0 2024-04-16T13:04:42.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe15be00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe148008fd0 tx=0x7fe148001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148041070 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe148005480 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c0cb3e0 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148007a30 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.618+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c0cb020 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.619+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15c068a70 con 0x7fe15c0c72c0 2024-04-16T13:04:42.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.620+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe148044070 con 0x7fe15c0c72c0 2024-04-16T13:04:42.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.621+0000 7fe158c00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 0x7fe13c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:42.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.621+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe1480ad410 con 0x7fe15c0c72c0 2024-04-16T13:04:42.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.622+0000 7fe160e00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 0x7fe13c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:42.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.623+0000 7fe160e00640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 0x7fe13c06ee00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009a10 tx=0x7fe14c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:42.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.626+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe14807bc90 con 0x7fe15c0c72c0 2024-04-16T13:04:42.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.829+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe15c0cd450 con 0x7fe15c0c72c0 2024-04-16T13:04:42.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.830+0000 7fe158c00640 1 -- 172.21.15.67:0/3923614988 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fe14807b590 con 0x7fe15c0c72c0 2024-04-16T13:04:42.831 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 msgr2=0x7fe13c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 0x7fe13c06ee00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009a10 tx=0x7fe14c008040 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 msgr2=0x7fe15c0c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe148008fd0 tx=0x7fe148001120 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 shutdown_connections 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe13c06c940 0x7fe13c06ee00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15c0ca650 0x7fe15c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe15c0c72c0 0x7fe15c0c7720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 --2- 172.21.15.67:0/3923614988 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe140003f60 0x7fe15c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.832+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 >> 172.21.15.67:0/3923614988 conn(0x7fe15c09aa70 msgr2=0x7fe15c0b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:42.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.833+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 shutdown_connections 2024-04-16T13:04:42.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:42.833+0000 7fe163800640 1 -- 172.21.15.67:0/3923614988 wait complete. 2024-04-16T13:04:42.853 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T13:04:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.075+0000 7f5883800640 1 Processor -- start 2024-04-16T13:04:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.075+0000 7f5883800640 1 -- start start 2024-04-16T13:04:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5883800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f587c071e50 0x7f587c072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5883800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f587c072770 con 0x7f587c160ba0 2024-04-16T13:04:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5883800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f587c0afbe0 con 0x7f587c0aee70 2024-04-16T13:04:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5883800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f587c0afec0 con 0x7f587c071e50 2024-04-16T13:04:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5881800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f587c160ba0 0x7f587c160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36396/0 (socket says 172.21.15.67:36396) 2024-04-16T13:04:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.077+0000 7f5881800640 1 -- 172.21.15.67:0/3402770962 learned_addr learned my addr 172.21.15.67:0/3402770962 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:43.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f5880e00640 1 --2- 172.21.15.67:0/3402770962 >> v2:172.21.15.82:3300/0 conn(0x7f587c071e50 0x7f587c072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649482282 0 0) 0x7f587c072770 con 0x7f587c160ba0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5864003520 con 0x7f587c160ba0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2656359900 0 0) 0x7f5864003520 con 0x7f587c160ba0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 >> v2:172.21.15.82:3300/0 conn(0x7f587c071e50 msgr2=0x7f587c072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 --2- 172.21.15.67:0/3402770962 >> v2:172.21.15.82:3300/0 conn(0x7f587c071e50 0x7f587c072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 >> v1:172.21.15.82:6789/0 conn(0x7f587c0aee70 legacy=0x7f587c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1600c0 con 0x7f587c160ba0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f58740019f0 con 0x7f587c160ba0 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 >> v1:172.21.15.67:6789/0 conn(0x7f587c160ba0 legacy=0x7f587c160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 0x7f5864003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864004800 0x7f5864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864005210 0x7f586400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0afec0 con 0x7f5864003a00 2024-04-16T13:04:43.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f586400c160 con 0x7f5864005210 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.078+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f586400c360 con 0x7f5864004800 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 0x7f5864003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5881800640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864005210 0x7f586400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f587be00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864004800 0x7f5864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 -- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864004800 msgr2=0x7f5864004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864004800 0x7f5864004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 -- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864005210 msgr2=0x7f586400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5864005210 0x7f586400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5880e00640 1 -- 172.21.15.67:0/3402770962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5864003520 con 0x7f5864003a00 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f5881800640 1 -- 172.21.15.67:0/3402770962 reap_dead start 2024-04-16T13:04:43.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.079+0000 7f587be00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864004800 0x7f5864004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.080+0000 7f5880e00640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 0x7f5864003e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba30 tx=0x7f5864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfda990f9199dec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.080+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870036020 con 0x7f5864003a00 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5870032640 con 0x7f5864003a00 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f587b400640 1 -- 172.21.15.67:0/3402770962 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587000b600 con 0x7f5864003a00 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 -- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 msgr2=0x7f5864003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 0x7f5864003e20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba30 tx=0x7f5864005830 comp rx=0 tx=0).stop 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 -- 172.21.15.67:0/3402770962 shutdown_connections 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 --2- 172.21.15.67:0/3402770962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5864003a00 0x7f5864003e20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 -- 172.21.15.67:0/3402770962 >> 172.21.15.67:0/3402770962 conn(0x7f587c0b2210 msgr2=0x7f587c0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 -- 172.21.15.67:0/3402770962 shutdown_connections 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.081+0000 7f5883800640 1 -- 172.21.15.67:0/3402770962 wait complete. 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.083+0000 7f5883800640 1 Processor -- start 2024-04-16T13:04:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.083+0000 7f5883800640 1 -- start start 2024-04-16T13:04:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864003a00 0x7f587c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f587c15d2a0 0x7f587c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f587c145310 con 0x7f587c0b0180 2024-04-16T13:04:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f587c145190 con 0x7f587c15d2a0 2024-04-16T13:04:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f5883800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f587c072230 con 0x7f5864003a00 2024-04-16T13:04:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f587be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f587be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45670/0 (socket says 172.21.15.67:45670) 2024-04-16T13:04:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.084+0000 7f587be00640 1 -- 172.21.15.67:0/1640319599 learned_addr learned my addr 172.21.15.67:0/1640319599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5880e00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864003a00 0x7f587c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5881800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f587c15d2a0 0x7f587c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 -- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864003a00 msgr2=0x7f587c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864003a00 0x7f587c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 -- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f587c15d2a0 msgr2=0x7f587c06e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f587c15d2a0 0x7f587c06e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 -- 172.21.15.67:0/1640319599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1e8b10 con 0x7f587c0b0180 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f587be00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f586c00d460 tx=0x7f586c00d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c005480 con 0x7f587c0b0180 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c017070 con 0x7f587c0b0180 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c003830 con 0x7f587c0b0180 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.085+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c0b0950 con 0x7f587c0b0180 2024-04-16T13:04:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.086+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c1e8dd0 con 0x7f587c0b0180 2024-04-16T13:04:43.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.087+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c075bd0 con 0x7f587c0b0180 2024-04-16T13:04:43.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.087+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f586c0039d0 con 0x7f587c0b0180 2024-04-16T13:04:43.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.088+0000 7f5878c00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 0x7f586006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.088+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f586c08b4e0 con 0x7f587c0b0180 2024-04-16T13:04:43.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.089+0000 7f5880e00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 0x7f586006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.090+0000 7f5880e00640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 0x7f586006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba00 tx=0x7f587003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.093+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f586c00f2f0 con 0x7f587c0b0180 2024-04-16T13:04:43.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.307+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f587c15fb80 con 0x7f587c0b0180 2024-04-16T13:04:43.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.308+0000 7f5878c00640 1 -- 172.21.15.67:0/1640319599 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f586c059c60 con 0x7f587c0b0180 2024-04-16T13:04:43.309 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:04:43.310 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-04-16T13:04:43.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 msgr2=0x7f586006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 0x7f586006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba00 tx=0x7f587003d040 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 msgr2=0x7f587c1f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f586c00d460 tx=0x7f586c00d920 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 shutdown_connections 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f586006c8f0 0x7f586006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f587c15d2a0 0x7f587c06e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f587c0b0180 0x7f587c1f45b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 --2- 172.21.15.67:0/1640319599 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5864003a00 0x7f587c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 >> 172.21.15.67:0/1640319599 conn(0x7f587c0b2210 msgr2=0x7f587c0b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 shutdown_connections 2024-04-16T13:04:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.312+0000 7f5883800640 1 -- 172.21.15.67:0/1640319599 wait complete. 2024-04-16T13:04:43.333 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T13:04:43.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T13:04:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.556+0000 7fbc12e00640 1 Processor -- start 2024-04-16T13:04:43.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.557+0000 7fbc12e00640 1 -- start start 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc12e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 0x7fbc0c1694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc12e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c0d2b10 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc12e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c0d2df0 con 0x7fbc0c0d0240 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc12e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0c0d30d0 con 0x7fbc0c0d17f0 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc11a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbc0c15e7e0 0x7fbc0c0d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36408/0 (socket says 172.21.15.67:36408) 2024-04-16T13:04:43.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc11a00640 1 -- 172.21.15.67:0/1316025153 learned_addr learned my addr 172.21.15.67:0/1316025153 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.558+0000 7fbc12400640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 0x7fbc0c1694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481570559 0 0) 0x7fbc0c0d2b10 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf4003520 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2132396522 0 0) 0x7fbbf4003520 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 msgr2=0x7fbc0c1694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 0x7fbc0c1694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 >> v1:172.21.15.82:6789/0 conn(0x7fbc0c0d0240 legacy=0x7fbc0c0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c0d33b0 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fbbfc0017f0 con 0x7fbc0c15e7e0 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 >> v1:172.21.15.67:6789/0 conn(0x7fbc0c15e7e0 legacy=0x7fbc0c0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf40039e0 0x7fbbf4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 0x7fbbf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbf4004d40 0x7fbbf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c0d30d0 con 0x7fbbf40039e0 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf400bad0 con 0x7fbbf4004d40 2024-04-16T13:04:43.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf400bcd0 con 0x7fbc0c0d17f0 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.559+0000 7fbc11a00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf40039e0 0x7fbbf4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc12400640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbf4004d40 0x7fbbf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc11a00640 1 -- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 msgr2=0x7fbbf4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc11a00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbc0c0d17f0 0x7fbbf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc11a00640 1 -- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbf4004d40 msgr2=0x7fbbf40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc11a00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbf4004d40 0x7fbbf40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.560+0000 7fbc11a00640 1 -- 172.21.15.67:0/1316025153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf4003520 con 0x7fbbf40039e0 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.561+0000 7fbc11a00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf40039e0 0x7fbbf4003e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c0e0 tx=0x7fbbf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0622e131a19543 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.561+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc007c30 con 0x7fbbf40039e0 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.561+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc030070 con 0x7fbbf40039e0 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.561+0000 7fbc0be00640 1 -- 172.21.15.67:0/1316025153 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0074f0 con 0x7fbbf40039e0 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 -- 172.21.15.67:0/1316025153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf40039e0 msgr2=0x7fbbf4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 --2- 172.21.15.67:0/1316025153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbf40039e0 0x7fbbf4003e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c0e0 tx=0x7fbbf4005830 comp rx=0 tx=0).stop 2024-04-16T13:04:43.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12400640 1 -- 172.21.15.67:0/1316025153 reap_dead start 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 -- 172.21.15.67:0/1316025153 shutdown_connections 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 -- 172.21.15.67:0/1316025153 >> 172.21.15.67:0/1316025153 conn(0x7fbc0c09da60 msgr2=0x7fbc0c08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 -- 172.21.15.67:0/1316025153 shutdown_connections 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.562+0000 7fbc12e00640 1 -- 172.21.15.67:0/1316025153 wait complete. 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.564+0000 7fbc12e00640 1 Processor -- start 2024-04-16T13:04:43.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.564+0000 7fbc12e00640 1 -- start start 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbbf40039e0 0x7fbc0c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 0x7fbc0c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c15ed40 con 0x7fbc0c0cd600 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c15ebc0 con 0x7fbc0c0c9890 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0c06e340 con 0x7fbbf40039e0 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45688/0 (socket says 172.21.15.67:45688) 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 -- 172.21.15.67:0/3420663910 learned_addr learned my addr 172.21.15.67:0/3420663910 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:43.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11a00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbbf40039e0 0x7fbc0c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc12400640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 0x7fbc0c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 -- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbbf40039e0 msgr2=0x7fbc0c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbbf40039e0 0x7fbc0c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 -- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 msgr2=0x7fbc0c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 0x7fbc0c0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.565+0000 7fbc11000640 1 -- 172.21.15.67:0/3420663910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c0cc130 con 0x7fbc0c0cd600 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc12400640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 0x7fbc0c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:43.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc11000640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c530 tx=0x7fbc0000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc000052d0 con 0x7fbc0c0cd600 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc00005470 con 0x7fbc0c0cd600 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0c0cc410 con 0x7fbc0c0cd600 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00012870 con 0x7fbc0c0cd600 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.566+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0c0cc9d0 con 0x7fbc0c0cd600 2024-04-16T13:04:43.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.568+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0c075bd0 con 0x7fbc0c0cd600 2024-04-16T13:04:43.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.568+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc00012a10 con 0x7fbc0c0cd600 2024-04-16T13:04:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.570+0000 7fbc09600640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 0x7fbbf006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.570+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbc0008b2b0 con 0x7fbc0c0cd600 2024-04-16T13:04:43.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.570+0000 7fbc11a00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 0x7fbbf006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:43.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.571+0000 7fbc11a00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 0x7fbbf006ee00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc034000 tx=0x7fbbfc009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:43.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.574+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc00059b10 con 0x7fbc0c0cd600 2024-04-16T13:04:43.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.778+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbc0c0d10e0 con 0x7fbc0c0cd600 2024-04-16T13:04:43.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.953+0000 7fbc09600640 1 -- 172.21.15.67:0/3420663910 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fbc00059410 con 0x7fbc0c0cd600 2024-04-16T13:04:43.955 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-04-16T13:04:43.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 msgr2=0x7fbbf006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 0x7fbbf006ee00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc034000 tx=0x7fbbfc009030 comp rx=0 tx=0).stop 2024-04-16T13:04:43.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 msgr2=0x7fbc0c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c530 tx=0x7fbc0000c9f0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 shutdown_connections 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbbf006c940 0x7fbbf006ee00 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc034000 tx=0x7fbbfc009030 comp rx=0 tx=0).stop 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc0c0c9890 0x7fbc0c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc0c0cd600 0x7fbc0c0cb7c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 --2- 172.21.15.67:0/3420663910 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbbf40039e0 0x7fbc0c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.957+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 >> 172.21.15.67:0/3420663910 conn(0x7fbc0c09da60 msgr2=0x7fbc0c0b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.958+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 shutdown_connections 2024-04-16T13:04:43.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:43.958+0000 7fbc12e00640 1 -- 172.21.15.67:0/3420663910 wait complete. 2024-04-16T13:04:43.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-16T13:04:44.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.196+0000 7f412ce00640 1 Processor -- start 2024-04-16T13:04:44.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.196+0000 7f412ce00640 1 -- start start 2024-04-16T13:04:44.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.198+0000 7f412ce00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f412815c860 0x7f41280c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:44.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.198+0000 7f412ce00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41280cce80 con 0x7f41280b3700 2024-04-16T13:04:44.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.198+0000 7f412ce00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41280c6e70 con 0x7f41280cc9f0 2024-04-16T13:04:44.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.198+0000 7f412ce00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f41280c7710 con 0x7f412815c860 2024-04-16T13:04:44.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.199+0000 7f4126800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f41280b3700 0x7f41280cf360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36412/0 (socket says 172.21.15.67:36412) 2024-04-16T13:04:44.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.199+0000 7f4126800640 1 -- 172.21.15.67:0/249304698 learned_addr learned my addr 172.21.15.67:0/249304698 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:44.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.199+0000 7f4125e00640 1 --2- 172.21.15.67:0/249304698 >> v2:172.21.15.82:3300/0 conn(0x7f412815c860 0x7f41280c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:44.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.199+0000 7f4124a00640 1 -- 172.21.15.67:0/249304698 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603900949 0 0) 0x7f41280cce80 con 0x7f41280b3700 2024-04-16T13:04:44.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.199+0000 7f4124a00640 1 -- 172.21.15.67:0/249304698 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f410c003520 con 0x7f41280b3700 2024-04-16T13:04:44.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.200+0000 7f4125e00640 1 -- 172.21.15.67:0/249304698 >> v1:172.21.15.82:6789/0 conn(0x7f41280cc9f0 legacy=0x7f4128160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.200+0000 7f4125e00640 1 -- 172.21.15.67:0/249304698 >> v1:172.21.15.67:6789/0 conn(0x7f41280b3700 legacy=0x7f41280cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.200+0000 7f4125e00640 1 -- 172.21.15.67:0/249304698 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280c7150 con 0x7f412815c860 2024-04-16T13:04:44.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.201+0000 7f4125e00640 1 --2- 172.21.15.67:0/249304698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f412815c860 0x7f41280c6890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba98c38d1c3cbbff server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:44.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.201+0000 7f4124a00640 1 -- 172.21.15.67:0/249304698 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118034070 con 0x7f412815c860 2024-04-16T13:04:44.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.201+0000 7f4124a00640 1 -- 172.21.15.67:0/249304698 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118030610 con 0x7f412815c860 2024-04-16T13:04:44.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.201+0000 7f4124a00640 1 -- 172.21.15.67:0/249304698 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41180309c0 con 0x7f412815c860 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.202+0000 7f412ce00640 1 -- 172.21.15.67:0/249304698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f412815c860 msgr2=0x7f41280c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.202+0000 7f412ce00640 1 --2- 172.21.15.67:0/249304698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f412815c860 0x7f41280c6890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802b960 comp rx=0 tx=0).stop 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.202+0000 7f412ce00640 1 -- 172.21.15.67:0/249304698 shutdown_connections 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.202+0000 7f412ce00640 1 --2- 172.21.15.67:0/249304698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f412815c860 0x7f41280c6890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.202+0000 7f412ce00640 1 -- 172.21.15.67:0/249304698 >> 172.21.15.67:0/249304698 conn(0x7f4128067d90 msgr2=0x7f412806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.203+0000 7f412ce00640 1 -- 172.21.15.67:0/249304698 shutdown_connections 2024-04-16T13:04:44.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.203+0000 7f412ce00640 1 -- 172.21.15.67:0/249304698 wait complete. 2024-04-16T13:04:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.205+0000 7f412ce00640 1 Processor -- start 2024-04-16T13:04:44.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.205+0000 7f412ce00640 1 -- start start 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41280b3700 0x7f41280cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 0x7f4128150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f412815cc40 con 0x7f412815c860 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41281605c0 con 0x7f41280cc9f0 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f412ce00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f41281611f0 con 0x7f41280b3700 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f4126800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f4126800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45696/0 (socket says 172.21.15.67:45696) 2024-04-16T13:04:44.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f4126800640 1 -- 172.21.15.67:0/2364319871 learned_addr learned my addr 172.21.15.67:0/2364319871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f4125400640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 0x7f4128150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.207+0000 7f4125e00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41280b3700 0x7f41280cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 -- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41280b3700 msgr2=0x7f41280cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41280b3700 0x7f41280cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 -- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 msgr2=0x7f4128150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 0x7f4128150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 -- 172.21.15.67:0/2364319871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41280cd6c0 con 0x7f412815c860 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4125400640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 0x7f4128150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:44.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f4126800640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f412000cb40 tx=0x7f412000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120017070 con 0x7f412815c860 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412000aca0 con 0x7f412815c860 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120012620 con 0x7f412815c860 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.208+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41280cd9a0 con 0x7f412815c860 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.209+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281591f0 con 0x7f412815c860 2024-04-16T13:04:44.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.210+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41280ce020 con 0x7f412815c860 2024-04-16T13:04:44.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.211+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f412001a070 con 0x7f412815c860 2024-04-16T13:04:44.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.212+0000 7f411e000640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 0x7f410806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:44.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.212+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f412008b870 con 0x7f412815c860 2024-04-16T13:04:44.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.213+0000 7f4125e00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 0x7f410806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:44.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.214+0000 7f4125e00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 0x7f410806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4118036000 tx=0x7f4118008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:44.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.218+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4120059de0 con 0x7f412815c860 2024-04-16T13:04:44.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.425+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4128068a70 con 0x7f412815c860 2024-04-16T13:04:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.970+0000 7f411e000640 1 -- 172.21.15.67:0/2364319871 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f41200596e0 con 0x7f412815c860 2024-04-16T13:04:44.972 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-04-16T13:04:44.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 msgr2=0x7f410806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 0x7f410806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4118036000 tx=0x7f4118008030 comp rx=0 tx=0).stop 2024-04-16T13:04:44.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 msgr2=0x7f4128155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:44.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f412000cb40 tx=0x7f412000a060 comp rx=0 tx=0).stop 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 shutdown_connections 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f410806c8f0 0x7f410806edb0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4118036000 tx=0x7f4118008030 comp rx=0 tx=0).stop 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f412815c860 0x7f4128155dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41280cc9f0 0x7f4128150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 --2- 172.21.15.67:0/2364319871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f41280b3700 0x7f41280cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.974+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 >> 172.21.15.67:0/2364319871 conn(0x7f4128067d90 msgr2=0x7f412806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.975+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 shutdown_connections 2024-04-16T13:04:44.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:44.975+0000 7f412ce00640 1 -- 172.21.15.67:0/2364319871 wait complete. 2024-04-16T13:04:45.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T13:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.200+0000 7fd5bb800640 1 Processor -- start 2024-04-16T13:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.200+0000 7fd5bb800640 1 -- start start 2024-04-16T13:04:45.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5bb800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5b415c860 0x7fd5b40c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5bb800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 0x7fd5b40b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5bb800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40cce80 con 0x7fd5b40cc9f0 2024-04-16T13:04:45.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5bb800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b40c7710 con 0x7fd5b415c860 2024-04-16T13:04:45.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5bb800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b40c6e70 con 0x7fd5b40b3700 2024-04-16T13:04:45.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5b8e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5b415c860 0x7fd5b40c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5b3e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd5b40cc9f0 0x7fd5b4160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36428/0 (socket says 172.21.15.67:36428) 2024-04-16T13:04:45.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5b3e00640 1 -- 172.21.15.67:0/1663834385 learned_addr learned my addr 172.21.15.67:0/1663834385 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:45.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.202+0000 7fd5b9800640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 0x7fd5b40b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b8e00640 1 -- 172.21.15.67:0/1663834385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 msgr2=0x7fd5b40b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b3400640 1 -- 172.21.15.67:0/1663834385 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289893927 0 0) 0x7fd5b40cce80 con 0x7fd5b40cc9f0 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 0x7fd5b40b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b8e00640 1 -- 172.21.15.67:0/1663834385 >> v1:172.21.15.67:6789/0 conn(0x7fd5b40cc9f0 legacy=0x7fd5b4160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b8e00640 1 -- 172.21.15.67:0/1663834385 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40c7150 con 0x7fd5b415c860 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.203+0000 7fd5b9800640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 0x7fd5b40b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:45.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.204+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b40c6890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80097a0 tx=0x7fd5a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ec924a2d40e2e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:45.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5b3400640 1 -- 172.21.15.67:0/1663834385 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8035020 con 0x7fd5b415c860 2024-04-16T13:04:45.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5b3400640 1 -- 172.21.15.67:0/1663834385 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a8031830 con 0x7fd5b415c860 2024-04-16T13:04:45.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5b3400640 1 -- 172.21.15.67:0/1663834385 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8031c00 con 0x7fd5b415c860 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 -- 172.21.15.67:0/1663834385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 msgr2=0x7fd5b40c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b40c6890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80097a0 tx=0x7fd5a802b8d0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 -- 172.21.15.67:0/1663834385 shutdown_connections 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40b3700 0x7fd5b40b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 --2- 172.21.15.67:0/1663834385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b40c6890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 -- 172.21.15.67:0/1663834385 >> 172.21.15.67:0/1663834385 conn(0x7fd5b4067d90 msgr2=0x7fd5b406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 -- 172.21.15.67:0/1663834385 shutdown_connections 2024-04-16T13:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.205+0000 7fd5bb800640 1 -- 172.21.15.67:0/1663834385 wait complete. 2024-04-16T13:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.207+0000 7fd5bb800640 1 Processor -- start 2024-04-16T13:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.207+0000 7fd5bb800640 1 -- start start 2024-04-16T13:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 0x7fd5b4143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40cc9f0 0x7fd5b41430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b415cc40 con 0x7fd5b415c860 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b41605c0 con 0x7fd5b40b3700 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5bb800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b41611f0 con 0x7fd5b40cc9f0 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.208+0000 7fd5b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45718/0 (socket says 172.21.15.67:45718) 2024-04-16T13:04:45.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 -- 172.21.15.67:0/50397217 learned_addr learned my addr 172.21.15.67:0/50397217 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:45.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b3e00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40cc9f0 0x7fd5b41430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 -- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40cc9f0 msgr2=0x7fd5b41430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40cc9f0 0x7fd5b41430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 0x7fd5b4143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 -- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 msgr2=0x7fd5b4143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 0x7fd5b4143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 -- 172.21.15.67:0/50397217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b41441d0 con 0x7fd5b415c860 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 0x7fd5b4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.209+0000 7fd5b9800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac007f20 tx=0x7fd5ac00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.210+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac01a070 con 0x7fd5b415c860 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.210+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ac003b90 con 0x7fd5b415c860 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.210+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac004030 con 0x7fd5b415c860 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.210+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b41444b0 con 0x7fd5b415c860 2024-04-16T13:04:45.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.210+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b4144a70 con 0x7fd5b415c860 2024-04-16T13:04:45.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.211+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b40c7b90 con 0x7fd5b415c860 2024-04-16T13:04:45.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.212+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5ac01d070 con 0x7fd5b415c860 2024-04-16T13:04:45.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.213+0000 7fd5b0c00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 0x7fd59406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:45.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.213+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fd5ac08be20 con 0x7fd5b415c860 2024-04-16T13:04:45.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.213+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 0x7fd59406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:45.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.215+0000 7fd5b8e00640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 0x7fd59406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8036000 tx=0x7fd5a8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:45.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.218+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5b40c7b90 con 0x7fd5b415c860 2024-04-16T13:04:45.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.467+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd5b4068a70 con 0x7fd5b415c860 2024-04-16T13:04:45.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:45.997+0000 7fd5b0c00640 1 -- 172.21.15.67:0/50397217 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd5ac010070 con 0x7fd5b415c860 2024-04-16T13:04:46.001 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2024-04-16T13:04:46.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.012+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 msgr2=0x7fd59406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.012+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 0x7fd59406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8036000 tx=0x7fd5a8008030 comp rx=0 tx=0).stop 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.012+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 msgr2=0x7fd5b413e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.012+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac007f20 tx=0x7fd5ac00d560 comp rx=0 tx=0).stop 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 shutdown_connections 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd59406c8f0 0x7fd59406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5b415c860 0x7fd5b413e3d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5b40cc9f0 0x7fd5b41430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 --2- 172.21.15.67:0/50397217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5b40b3700 0x7fd5b4143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.013+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 >> 172.21.15.67:0/50397217 conn(0x7fd5b4067d90 msgr2=0x7fd5b40729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:46.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.014+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 shutdown_connections 2024-04-16T13:04:46.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.014+0000 7fd5bb800640 1 -- 172.21.15.67:0/50397217 wait complete. 2024-04-16T13:04:46.044 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-16T13:04:46.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-16T13:04:46.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.236+0000 7f6b6ec00640 1 Processor -- start 2024-04-16T13:04:46.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.237+0000 7f6b6ec00640 1 -- start start 2024-04-16T13:04:46.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ec00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b6809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ec00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b680ce340 0x7f6b6809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ec00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b680d03a0 con 0x7f6b6815cae0 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ec00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680d0150 con 0x7f6b680ce340 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ec00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680b63e0 con 0x7f6b6815c700 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ce00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6b6815cae0 0x7f6b680cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36434/0 (socket says 172.21.15.67:36434) 2024-04-16T13:04:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.238+0000 7f6b6ce00640 1 -- 172.21.15.67:0/2877611001 learned_addr learned my addr 172.21.15.67:0/2877611001 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b6d800640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b6809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2877611001 >> v2:172.21.15.82:3300/0 conn(0x7f6b680ce340 0x7f6b6809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469587725 0 0) 0x7f6b680d03a0 con 0x7f6b6815cae0 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b4c003520 con 0x7f6b6815cae0 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 425666589 0 0) 0x7f6b4c003520 con 0x7f6b6815cae0 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 msgr2=0x7f6b6809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b6809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 >> v2:172.21.15.82:3300/0 conn(0x7f6b680ce340 msgr2=0x7f6b6809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 --2- 172.21.15.67:0/2877611001 >> v2:172.21.15.82:3300/0 conn(0x7f6b680ce340 0x7f6b6809afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.239+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680d0680 con 0x7f6b6815cae0 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f6b540019f0 con 0x7f6b6815cae0 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 >> v1:172.21.15.67:6789/0 conn(0x7f6b6815cae0 legacy=0x7f6b680cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c003f30 0x7f6b4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c004d40 0x7f6b4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0150 con 0x7f6b4c003f30 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680b63e0 con 0x7f6b4c004d40 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c00b9c0 con 0x7f6b6815c700 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c003f30 0x7f6b4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c004d40 0x7f6b4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6d800640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 -- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 msgr2=0x7f6b4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b6815c700 0x7f6b4c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 -- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c004d40 msgr2=0x7f6b4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c004d40 0x7f6b4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6ce00640 1 -- 172.21.15.67:0/2877611001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c003520 con 0x7f6b4c003f30 2024-04-16T13:04:46.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.240+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c004d40 0x7f6b4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:46.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.241+0000 7f6b6ce00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c003f30 0x7f6b4c004800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400a870 tx=0x7f6b4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34af7ded082c6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:46.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400a4c0 con 0x7f6b4c003f30 2024-04-16T13:04:46.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b54034650 con 0x7f6b4c003f30 2024-04-16T13:04:46.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b67e00640 1 -- 172.21.15.67:0/2877611001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54034a80 con 0x7f6b4c003f30 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2877611001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c003f30 msgr2=0x7f6b4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2877611001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b4c003f30 0x7f6b4c004800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400a870 tx=0x7f6b4c005830 comp rx=0 tx=0).stop 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6e200640 1 -- 172.21.15.67:0/2877611001 reap_dead start 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2877611001 shutdown_connections 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2877611001 >> 172.21.15.67:0/2877611001 conn(0x7f6b680b4070 msgr2=0x7f6b680b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2877611001 shutdown_connections 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.242+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2877611001 wait complete. 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.244+0000 7f6b6ec00640 1 Processor -- start 2024-04-16T13:04:46.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.244+0000 7f6b6ec00640 1 -- start start 2024-04-16T13:04:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c003f30 0x7f6b681570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b681592c0 0x7f6b680c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0f20 con 0x7f6b680c6780 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0c40 con 0x7f6b4c003f30 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.245+0000 7f6b6ec00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6b680d1440 con 0x7f6b681592c0 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45738/0 (socket says 172.21.15.67:45738) 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 -- 172.21.15.67:0/2113344182 learned_addr learned my addr 172.21.15.67:0/2113344182 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6ce00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b681592c0 0x7f6b680c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 -- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b681592c0 msgr2=0x7f6b680c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b681592c0 0x7f6b680c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 -- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c003f30 msgr2=0x7f6b681570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c003f30 0x7f6b681570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 -- 172.21.15.67:0/2113344182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b681580d0 con 0x7f6b680c6780 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.246+0000 7f6b6e200640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b680ce770 tx=0x7f6b60010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.247+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000f040 con 0x7f6b680c6780 2024-04-16T13:04:46.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.247+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6000e8d0 con 0x7f6b680c6780 2024-04-16T13:04:46.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.247+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b68159780 con 0x7f6b680c6780 2024-04-16T13:04:46.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.247+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000eca0 con 0x7f6b680c6780 2024-04-16T13:04:46.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.247+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b68159d40 con 0x7f6b680c6780 2024-04-16T13:04:46.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.248+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6806c5b0 con 0x7f6b680c6780 2024-04-16T13:04:46.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.249+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b6001c400 con 0x7f6b680c6780 2024-04-16T13:04:46.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.250+0000 7f6b65600640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 0x7f6b4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:46.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.250+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f6b6008be50 con 0x7f6b680c6780 2024-04-16T13:04:46.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.251+0000 7f6b6d800640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 0x7f6b4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:46.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.252+0000 7f6b6d800640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 0x7f6b4806ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b6815a5f0 tx=0x7f6b58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.255+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b681580d0 con 0x7f6b680c6780 2024-04-16T13:04:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.468+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6b68075bd0 con 0x7f6b680c6780 2024-04-16T13:04:46.722 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-04-16T13:04:46.721+0000 7f9df4000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T13:04:46.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.965+0000 7f6b65600640 1 -- 172.21.15.67:0/2113344182 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f6b60018030 con 0x7f6b680c6780 2024-04-16T13:04:46.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 msgr2=0x7f6b4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 0x7f6b4806ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b6815a5f0 tx=0x7f6b58008040 comp rx=0 tx=0).stop 2024-04-16T13:04:46.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 msgr2=0x7f6b680c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:46.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b680ce770 tx=0x7f6b60010c20 comp rx=0 tx=0).stop 2024-04-16T13:04:46.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 shutdown_connections 2024-04-16T13:04:46.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6b4806c920 0x7f6b4806ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b680c6780 0x7f6b680c6c30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6b681592c0 0x7f6b680c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 --2- 172.21.15.67:0/2113344182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b4c003f30 0x7f6b681570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:46.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 >> 172.21.15.67:0/2113344182 conn(0x7f6b680b4070 msgr2=0x7f6b680cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:46.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 shutdown_connections 2024-04-16T13:04:46.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:46.969+0000 7f6b6ec00640 1 -- 172.21.15.67:0/2113344182 wait complete. 2024-04-16T13:04:46.994 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T13:04:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.212+0000 7f1a96e00640 1 Processor -- start 2024-04-16T13:04:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.213+0000 7f1a96e00640 1 -- start start 2024-04-16T13:04:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.214+0000 7f1a96e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a90159f10 0x7f1a900b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.214+0000 7f1a96e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.214+0000 7f1a96e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9006f860 con 0x7f1a900b4bd0 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.214+0000 7f1a96e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9006fb40 con 0x7f1a90159f10 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.214+0000 7f1a96e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900b3bb0 con 0x7f1a9015a2f0 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.215+0000 7f1a95a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a90159f10 0x7f1a900b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.215+0000 7f1a95000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.215+0000 7f1a95000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:34904/0 (socket says 172.21.15.67:34904) 2024-04-16T13:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.215+0000 7f1a95000640 1 -- 172.21.15.67:0/1572978419 learned_addr learned my addr 172.21.15.67:0/1572978419 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.216+0000 7f1a95000640 1 -- 172.21.15.67:0/1572978419 >> v2:172.21.15.82:3300/0 conn(0x7f1a90159f10 msgr2=0x7f1a900b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.216+0000 7f1a95000640 1 --2- 172.21.15.67:0/1572978419 >> v2:172.21.15.82:3300/0 conn(0x7f1a90159f10 0x7f1a900b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.216+0000 7f1a95000640 1 -- 172.21.15.67:0/1572978419 >> v1:172.21.15.82:6789/0 conn(0x7f1a900b4bd0 legacy=0x7f1a900ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:47.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.216+0000 7f1a95000640 1 -- 172.21.15.67:0/1572978419 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900b3e90 con 0x7f1a9015a2f0 2024-04-16T13:04:47.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.217+0000 7f1a95000640 1 --2- 172.21.15.67:0/1572978419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009870 tx=0x7f1a7c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea8fdd13ebbae685 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:47.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a8fe00640 1 -- 172.21.15.67:0/1572978419 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c034070 con 0x7f1a9015a2f0 2024-04-16T13:04:47.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a8fe00640 1 -- 172.21.15.67:0/1572978419 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7c030840 con 0x7f1a9015a2f0 2024-04-16T13:04:47.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a8fe00640 1 -- 172.21.15.67:0/1572978419 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c030c10 con 0x7f1a9015a2f0 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a96e00640 1 -- 172.21.15.67:0/1572978419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 msgr2=0x7f1a900ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a96e00640 1 --2- 172.21.15.67:0/1572978419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009870 tx=0x7f1a7c02b980 comp rx=0 tx=0).stop 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a96e00640 1 -- 172.21.15.67:0/1572978419 shutdown_connections 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a96e00640 1 --2- 172.21.15.67:0/1572978419 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a900ca8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.218+0000 7f1a96e00640 1 --2- 172.21.15.67:0/1572978419 >> v2:172.21.15.82:3300/0 conn(0x7f1a90159f10 0x7f1a900b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.219+0000 7f1a96e00640 1 -- 172.21.15.67:0/1572978419 >> 172.21.15.67:0/1572978419 conn(0x7f1a9006ba20 msgr2=0x7f1a9006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.219+0000 7f1a96e00640 1 -- 172.21.15.67:0/1572978419 shutdown_connections 2024-04-16T13:04:47.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.219+0000 7f1a96e00640 1 -- 172.21.15.67:0/1572978419 wait complete. 2024-04-16T13:04:47.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.220+0000 7f1a96e00640 1 Processor -- start 2024-04-16T13:04:47.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.221+0000 7f1a96e00640 1 -- start start 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a90159f10 0x7f1a90158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a901588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900cd500 con 0x7f1a900b4bd0 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900cd380 con 0x7f1a90159f10 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900cadf0 con 0x7f1a9015a2f0 2024-04-16T13:04:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a95a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a95a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45740/0 (socket says 172.21.15.67:45740) 2024-04-16T13:04:47.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a95a00640 1 -- 172.21.15.67:0/3351571387 learned_addr learned my addr 172.21.15.67:0/3351571387 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a95000640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a90159f10 0x7f1a90158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.222+0000 7f1a96400640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a901588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 -- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 msgr2=0x7f1a901588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a901588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 -- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a90159f10 msgr2=0x7f1a90158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a90159f10 0x7f1a90158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 -- 172.21.15.67:0/3351571387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900d0920 con 0x7f1a900b4bd0 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a95a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e9b0 tx=0x7f1a8400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:47.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84017070 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8400c9a0 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400cd90 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a96e00640 1 -- 172.21.15.67:0/3351571387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a900cf340 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.223+0000 7f1a96e00640 1 -- 172.21.15.67:0/3351571387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a900cf900 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.225+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a90075bd0 con 0x7f1a900b4bd0 2024-04-16T13:04:47.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.226+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a8401a070 con 0x7f1a900b4bd0 2024-04-16T13:04:47.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.226+0000 7f1a8d600640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 0x7f1a7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:47.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.227+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f1a8408bc00 con 0x7f1a900b4bd0 2024-04-16T13:04:47.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.227+0000 7f1a95000640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 0x7f1a7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:47.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.228+0000 7f1a95000640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 0x7f1a7006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c036000 tx=0x7f1a7c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:47.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.231+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a84092080 con 0x7f1a900b4bd0 2024-04-16T13:04:47.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:47.441+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1a900cd140 con 0x7f1a900b4bd0 2024-04-16T13:04:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.111+0000 7f1a8d600640 1 -- 172.21.15.67:0/3351571387 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f1a84059f90 con 0x7f1a900b4bd0 2024-04-16T13:04:49.114 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' created 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 msgr2=0x7f1a7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 0x7f1a7006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c036000 tx=0x7f1a7c03b040 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 msgr2=0x7f1a900d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400e9b0 tx=0x7f1a8400ee70 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 shutdown_connections 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a7006c8f0 0x7f1a7006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a9015a2f0 0x7f1a901588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a90159f10 0x7f1a90158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 --2- 172.21.15.67:0/3351571387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a900b4bd0 0x7f1a900d03e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 >> 172.21.15.67:0/3351571387 conn(0x7f1a9006ba20 msgr2=0x7f1a9015dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 shutdown_connections 2024-04-16T13:04:49.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.116+0000 7f1a82a00640 1 -- 172.21.15.67:0/3351571387 wait complete. 2024-04-16T13:04:49.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-16T13:04:49.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.340+0000 7f581ce00640 1 Processor -- start 2024-04-16T13:04:49.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.340+0000 7f581ce00640 1 -- start start 2024-04-16T13:04:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f581ce00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 0x7f5818160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f581ce00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f581806f7c0 0x7f58180cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f581ce00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5818161290 con 0x7f58180cf230 2024-04-16T13:04:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f581ce00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f58180cfbd0 con 0x7f581806f7c0 2024-04-16T13:04:49.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f581ce00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5818072210 con 0x7f5818145340 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f5816800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f581806f7c0 0x7f58180cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f5816800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f581806f7c0 0x7f58180cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45756/0 (socket says 172.21.15.67:45756) 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.342+0000 7f5816800640 1 -- 172.21.15.67:0/3186986158 learned_addr learned my addr 172.21.15.67:0/3186986158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5815e00640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 0x7f5818160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5816800640 1 -- 172.21.15.67:0/3186986158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 msgr2=0x7f5818160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:49.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5816800640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 0x7f5818160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5816800640 1 -- 172.21.15.67:0/3186986158 >> v1:172.21.15.67:6789/0 conn(0x7f58180cf230 legacy=0x7f58180c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5816800640 1 -- 172.21.15.67:0/3186986158 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58180724f0 con 0x7f581806f7c0 2024-04-16T13:04:49.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.343+0000 7f5815e00640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 0x7f5818160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.344+0000 7f5816800640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f581806f7c0 0x7f58180cf690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5810009e50 tx=0x7f581002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208f56dfc2e41fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.344+0000 7f5814a00640 1 -- 172.21.15.67:0/3186986158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581002cb00 con 0x7f581806f7c0 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.344+0000 7f5814a00640 1 -- 172.21.15.67:0/3186986158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581002cca0 con 0x7f581806f7c0 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.344+0000 7f5814a00640 1 -- 172.21.15.67:0/3186986158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810034610 con 0x7f581806f7c0 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 -- 172.21.15.67:0/3186986158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f581806f7c0 msgr2=0x7f58180cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f581806f7c0 0x7f58180cf690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5810009e50 tx=0x7f581002bf60 comp rx=0 tx=0).stop 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 -- 172.21.15.67:0/3186986158 shutdown_connections 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f581806f7c0 0x7f58180cf690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 --2- 172.21.15.67:0/3186986158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5818145340 0x7f5818160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 -- 172.21.15.67:0/3186986158 >> 172.21.15.67:0/3186986158 conn(0x7f581806c050 msgr2=0x7f58180b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 -- 172.21.15.67:0/3186986158 shutdown_connections 2024-04-16T13:04:49.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.345+0000 7f581ce00640 1 -- 172.21.15.67:0/3186986158 wait complete. 2024-04-16T13:04:49.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.347+0000 7f581ce00640 1 Processor -- start 2024-04-16T13:04:49.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.347+0000 7f581ce00640 1 -- start start 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 0x7f581815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5818145340 0x7f58180cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5818072d90 con 0x7f58180cf230 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5818072ab0 con 0x7f5818145340 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f581ce00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5818071ea0 con 0x7f581806f7c0 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45766/0 (socket says 172.21.15.67:45766) 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 -- 172.21.15.67:0/3178029066 learned_addr learned my addr 172.21.15.67:0/3178029066 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5816800640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5818145340 0x7f58180cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815e00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 0x7f581815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 -- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 msgr2=0x7f581815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 0x7f581815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 -- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5818145340 msgr2=0x7f58180cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.348+0000 7f5815400640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5818145340 0x7f58180cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f5815400640 1 -- 172.21.15.67:0/3178029066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581815cec0 con 0x7f58180cf230 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f5815e00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 0x7f581815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:49.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f5815400640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f580000c430 tx=0x7f580000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58000052d0 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800005490 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581815d160 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800007260 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.349+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581815d720 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.350+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818068a70 con 0x7f58180cf230 2024-04-16T13:04:49.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.352+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5800007400 con 0x7f58180cf230 2024-04-16T13:04:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.353+0000 7f580e000640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 0x7f57f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.353+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f580008b340 con 0x7f58180cf230 2024-04-16T13:04:49.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.354+0000 7f5815e00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 0x7f57f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:49.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.355+0000 7f5815e00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 0x7f57f406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f5808008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:49.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.358+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58000594e0 con 0x7f58180cf230 2024-04-16T13:04:49.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:49.561+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f581806f3a0 con 0x7f58180cf230 2024-04-16T13:04:50.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.124+0000 7f580e000640 1 -- 172.21.15.67:0/3178029066 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f5800058de0 con 0x7f58180cf230 2024-04-16T13:04:50.127 INFO:teuthology.orchestra.run.smithi067.stderr:set pool 4 allow_ec_overwrites to true 2024-04-16T13:04:50.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.128+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 msgr2=0x7f57f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:50.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.128+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 0x7f57f406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5808006fd0 tx=0x7f5808008040 comp rx=0 tx=0).stop 2024-04-16T13:04:50.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.128+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 msgr2=0x7f581813ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:50.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.128+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f580000c430 tx=0x7f580000c8f0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 shutdown_connections 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f57f406c8f0 0x7f57f406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5818145340 0x7f58180cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f58180cf230 0x7f581813ae40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 --2- 172.21.15.67:0/3178029066 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f581806f7c0 0x7f581815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 >> 172.21.15.67:0/3178029066 conn(0x7f581806c050 msgr2=0x7f58181602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 shutdown_connections 2024-04-16T13:04:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.129+0000 7f581ce00640 1 -- 172.21.15.67:0/3178029066 wait complete. 2024-04-16T13:04:50.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-16T13:04:50.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.354+0000 7fba08e00640 1 Processor -- start 2024-04-16T13:04:50.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.354+0000 7fba08e00640 1 -- start start 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba08e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba04072050 0x7fba040b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba08e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba0406f040 0x7fba0406e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba08e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba041641f0 con 0x7fba0406f9d0 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba08e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fba040b3970 con 0x7fba04072050 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba08e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba041635e0 con 0x7fba0406f040 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba03400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba04072050 0x7fba040b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba03400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba04072050 0x7fba040b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45772/0 (socket says 172.21.15.67:45772) 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.356+0000 7fba03400640 1 -- 172.21.15.67:0/749788441 learned_addr learned my addr 172.21.15.67:0/749788441 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.357+0000 7fba03400640 1 -- 172.21.15.67:0/749788441 >> v2:172.21.15.82:3300/0 conn(0x7fba0406f040 msgr2=0x7fba0406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.357+0000 7fba03400640 1 --2- 172.21.15.67:0/749788441 >> v2:172.21.15.82:3300/0 conn(0x7fba0406f040 0x7fba0406e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.357+0000 7fba03400640 1 -- 172.21.15.67:0/749788441 >> v1:172.21.15.82:6789/0 conn(0x7fba0406f9d0 legacy=0x7fba0406e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.357+0000 7fba03400640 1 -- 172.21.15.67:0/749788441 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0406ed50 con 0x7fba04072050 2024-04-16T13:04:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.358+0000 7fba03400640 1 --2- 172.21.15.67:0/749788441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba04072050 0x7fba040b3430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b302811806dedb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.358+0000 7fba02a00640 1 -- 172.21.15.67:0/749788441 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4035020 con 0x7fba04072050 2024-04-16T13:04:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.358+0000 7fba02a00640 1 -- 172.21.15.67:0/749788441 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f4031870 con 0x7fba04072050 2024-04-16T13:04:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.358+0000 7fba02a00640 1 -- 172.21.15.67:0/749788441 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4031c40 con 0x7fba04072050 2024-04-16T13:04:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 -- 172.21.15.67:0/749788441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba04072050 msgr2=0x7fba040b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 --2- 172.21.15.67:0/749788441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba04072050 0x7fba040b3430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f402b910 comp rx=0 tx=0).stop 2024-04-16T13:04:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 -- 172.21.15.67:0/749788441 shutdown_connections 2024-04-16T13:04:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 --2- 172.21.15.67:0/749788441 >> v2:172.21.15.82:3300/0 conn(0x7fba0406f040 0x7fba0406e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 --2- 172.21.15.67:0/749788441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba04072050 0x7fba040b3430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 -- 172.21.15.67:0/749788441 >> 172.21.15.67:0/749788441 conn(0x7fba04067d90 msgr2=0x7fba0406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 -- 172.21.15.67:0/749788441 shutdown_connections 2024-04-16T13:04:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.359+0000 7fba08e00640 1 -- 172.21.15.67:0/749788441 wait complete. 2024-04-16T13:04:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.361+0000 7fba08e00640 1 Processor -- start 2024-04-16T13:04:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.361+0000 7fba08e00640 1 -- start start 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 0x7fba041527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba04072050 0x7fba041609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fba04163e80 con 0x7fba0406f040 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba04163ba0 con 0x7fba0406f9d0 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba08e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba04072430 con 0x7fba04072050 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba03400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba03400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45786/0 (socket says 172.21.15.67:45786) 2024-04-16T13:04:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.362+0000 7fba03400640 1 -- 172.21.15.67:0/3783630075 learned_addr learned my addr 172.21.15.67:0/3783630075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fb9faa00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 0x7fba041527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba04072050 0x7fba041609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 -- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba04072050 msgr2=0x7fba041609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba04072050 0x7fba041609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 -- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 msgr2=0x7fba041527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 0x7fba041527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 -- 172.21.15.67:0/3783630075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba04160ee0 con 0x7fba0406f040 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fb9faa00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 0x7fba041527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fba03400640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.363+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403ad60 con 0x7fba0406f040 2024-04-16T13:04:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.364+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f40443f0 con 0x7fba0406f040 2024-04-16T13:04:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.364+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40447e0 con 0x7fba0406f040 2024-04-16T13:04:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.364+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba040a9b60 con 0x7fba0406f040 2024-04-16T13:04:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.364+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba040aa120 con 0x7fba0406f040 2024-04-16T13:04:50.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.365+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba04075bd0 con 0x7fba0406f040 2024-04-16T13:04:50.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.366+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9f404b060 con 0x7fba0406f040 2024-04-16T13:04:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.367+0000 7fb9fbe00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 0x7fb9e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.367+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fb9f40ae0c0 con 0x7fba0406f040 2024-04-16T13:04:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.367+0000 7fb9faa00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 0x7fb9e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:50.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.368+0000 7fb9faa00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 0x7fb9e006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec006fd0 tx=0x7fb9ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.371+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba04160ee0 con 0x7fba0406f040 2024-04-16T13:04:50.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:50.617+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fba040afbb0 con 0x7fba0406f040 2024-04-16T13:04:51.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.141+0000 7fb9fbe00640 1 -- 172.21.15.67:0/3783630075 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fb9f403f070 con 0x7fba0406f040 2024-04-16T13:04:51.144 INFO:teuthology.orchestra.run.smithi067.stderr:added data pool 4 to fsmap 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.144+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 msgr2=0x7fb9e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.144+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 0x7fb9e006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec006fd0 tx=0x7fb9ec008040 comp rx=0 tx=0).stop 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.144+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 msgr2=0x7fba040a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.144+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f40046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 shutdown_connections 2024-04-16T13:04:51.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9e006c8f0 0x7fb9e006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba04072050 0x7fba041609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba0406f9d0 0x7fba041527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 --2- 172.21.15.67:0/3783630075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba0406f040 0x7fba040a94d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 >> 172.21.15.67:0/3783630075 conn(0x7fba04067d90 msgr2=0x7fba04165400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 shutdown_connections 2024-04-16T13:04:51.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.145+0000 7fba08e00640 1 -- 172.21.15.67:0/3783630075 wait complete. 2024-04-16T13:04:51.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:04:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.377+0000 7fa5fb200640 1 Processor -- start 2024-04-16T13:04:51.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.378+0000 7fa5fb200640 1 -- start start 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 0x7fa5fc0d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc0d5220 0x7fa5fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 0x7fa5fc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0d0c10 con 0x7fa5fc0d5220 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0d0000 con 0x7fa5fc06d8a0 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5fb200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d02e0 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.379+0000 7fa5f9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc0d5220 0x7fa5fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc0d5220 0x7fa5fc06d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45792/0 (socket says 172.21.15.67:45792) 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 -- 172.21.15.67:0/1645440555 learned_addr learned my addr 172.21.15.67:0/1645440555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9e00640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 0x7fa5fc0d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 -- 172.21.15.67:0/1645440555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 msgr2=0x7fa5fc0d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 0x7fa5fc0d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 -- 172.21.15.67:0/1645440555 >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 msgr2=0x7fa5fc0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5fa800640 1 --2- 172.21.15.67:0/1645440555 >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 0x7fa5fc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 --2- 172.21.15.67:0/1645440555 >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 0x7fa5fc0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9400640 1 -- 172.21.15.67:0/1645440555 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0d05c0 con 0x7fa5fc0d5220 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5f9e00640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 0x7fa5fc0d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:51.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.380+0000 7fa5fa800640 1 --2- 172.21.15.67:0/1645440555 >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 0x7fa5fc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:51.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.381+0000 7fa5f9400640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d5220 0x7fa5fc06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0ba620 tx=0x7fa5e402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28047f75de86a4cf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5f8a00640 1 -- 172.21.15.67:0/1645440555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e402e070 con 0x7fa5fc0d5220 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5f8a00640 1 -- 172.21.15.67:0/1645440555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e4037070 con 0x7fa5fc0d5220 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5f8a00640 1 -- 172.21.15.67:0/1645440555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4031a00 con 0x7fa5fc0d5220 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 -- 172.21.15.67:0/1645440555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d5220 msgr2=0x7fa5fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d5220 0x7fa5fc06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0ba620 tx=0x7fa5e402b880 comp rx=0 tx=0).stop 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 -- 172.21.15.67:0/1645440555 shutdown_connections 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 --2- 172.21.15.67:0/1645440555 >> v2:172.21.15.82:3300/0 conn(0x7fa5fc06d8a0 0x7fa5fc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d5220 0x7fa5fc06d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 --2- 172.21.15.67:0/1645440555 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc15eaa0 0x7fa5fc0d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 -- 172.21.15.67:0/1645440555 >> 172.21.15.67:0/1645440555 conn(0x7fa5fc08c000 msgr2=0x7fa5fc0d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 -- 172.21.15.67:0/1645440555 shutdown_connections 2024-04-16T13:04:51.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.382+0000 7fa5fb200640 1 -- 172.21.15.67:0/1645440555 wait complete. 2024-04-16T13:04:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.384+0000 7fa5fb200640 1 Processor -- start 2024-04-16T13:04:51.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.384+0000 7fa5fb200640 1 -- start start 2024-04-16T13:04:51.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc06d8a0 0x7fa5fc1f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 0x7fa5fc1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc06ceb0 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc15ee80 con 0x7fa5fc06d8a0 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.385+0000 7fa5fb200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d1500 con 0x7fa5fc0d5220 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45800/0 (socket says 172.21.15.67:45800) 2024-04-16T13:04:51.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 -- 172.21.15.67:0/2582002586 learned_addr learned my addr 172.21.15.67:0/2582002586 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5f9400640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 0x7fa5fc1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5f9e00640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc06d8a0 0x7fa5fc1f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 -- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 msgr2=0x7fa5fc1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 0x7fa5fc1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 -- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc06d8a0 msgr2=0x7fa5fc1f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc06d8a0 0x7fa5fc1f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5fa800640 1 -- 172.21.15.67:0/2582002586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc160d80 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.386+0000 7fa5f9400640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 0x7fa5fc1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5fa800640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c820 tx=0x7fa5f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4015070 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f4007a30 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4007e20 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc161060 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.387+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc161620 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.388+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5fc075bd0 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.389+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5f4018070 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.390+0000 7fa5f2000640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.390+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa5f408be70 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.391+0000 7fa5f9e00640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.392+0000 7fa5f9e00640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007510 tx=0x7fa5ec0074a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.396+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5f4059f80 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.640+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5fc06bad0 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.641+0000 7fa5f2000640 1 -- 172.21.15.67:0/2582002586 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5168 (secure 0 0 0) 0x7fa5f4059880 con 0x7fa5fc15eaa0 2024-04-16T13:04:51.644 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:51.644 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:04:50.620742+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:04:51.644 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 6 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.645+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 msgr2=0x7fa5d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.645+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007510 tx=0x7fa5ec0074a0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.645+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 msgr2=0x7fa5fc1f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.645+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400c820 tx=0x7fa5f400cce0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 shutdown_connections 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15eaa0 0x7fa5fc1f7b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d5220 0x7fa5fc1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 --2- 172.21.15.67:0/2582002586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc06d8a0 0x7fa5fc1f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 >> 172.21.15.67:0/2582002586 conn(0x7fa5fc08c000 msgr2=0x7fa5fc0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 shutdown_connections 2024-04-16T13:04:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.646+0000 7fa5fb200640 1 -- 172.21.15.67:0/2582002586 wait complete. 2024-04-16T13:04:51.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:51.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.882+0000 7fc3bcc00640 1 Processor -- start 2024-04-16T13:04:51.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.883+0000 7fc3bcc00640 1 -- start start 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.884+0000 7fc3bcc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.884+0000 7fc3bcc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b80d05b0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.884+0000 7fc3bcc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b80d2f60 con 0x7fc3b80d0ed0 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.884+0000 7fc3bcc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80d3240 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53786/0 (socket says 172.21.15.67:53786) 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 -- 172.21.15.67:0/174826414 learned_addr learned my addr 172.21.15.67:0/174826414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:51.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b7e00640 1 --1- 172.21.15.67:0/174826414 >> v1:172.21.15.67:6789/0 conn(0x7fc3b80b4f60 0x7fc3b80b53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47878/0 (socket says 172.21.15.67:47878) 2024-04-16T13:04:51.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 -- 172.21.15.67:0/174826414 >> v1:172.21.15.82:6789/0 conn(0x7fc3b80d0ed0 legacy=0x7fc3b80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 -- 172.21.15.67:0/174826414 >> v1:172.21.15.67:6789/0 conn(0x7fc3b80b4f60 legacy=0x7fc3b80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6000640 1 -- 172.21.15.67:0/174826414 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000585566 0 0) 0x7fc3b80d05b0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.885+0000 7fc3b6a00640 1 -- 172.21.15.67:0/174826414 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b80d3520 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.886+0000 7fc3b6a00640 1 --2- 172.21.15.67:0/174826414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009e50 tx=0x7fc3a002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739b939c87837f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3b6000640 1 -- 172.21.15.67:0/174826414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a002cbb0 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3b6000640 1 -- 172.21.15.67:0/174826414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a002cd50 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3b6000640 1 -- 172.21.15.67:0/174826414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0034610 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3bcc00640 1 -- 172.21.15.67:0/174826414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80d4cc0 msgr2=0x7fc3b80b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/174826414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009e50 tx=0x7fc3a002c010 comp rx=0 tx=0).stop 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3bcc00640 1 -- 172.21.15.67:0/174826414 shutdown_connections 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/174826414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80d4cc0 0x7fc3b80b4a20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.887+0000 7fc3bcc00640 1 -- 172.21.15.67:0/174826414 >> 172.21.15.67:0/174826414 conn(0x7fc3b808c000 msgr2=0x7fc3b80d45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.888+0000 7fc3bcc00640 1 -- 172.21.15.67:0/174826414 shutdown_connections 2024-04-16T13:04:51.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.888+0000 7fc3bcc00640 1 -- 172.21.15.67:0/174826414 wait complete. 2024-04-16T13:04:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.889+0000 7fc3bcc00640 1 Processor -- start 2024-04-16T13:04:51.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.889+0000 7fc3bcc00640 1 -- start start 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 0x7fc3b8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 0x7fc3b80c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b80d0210 con 0x7fc3b80b4f60 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b80d0890 con 0x7fc3b80d0ed0 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3bcc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b80d0390 con 0x7fc3b80d4cc0 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.890+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53796/0 (socket says 172.21.15.67:53796) 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 -- 172.21.15.67:0/2315469208 learned_addr learned my addr 172.21.15.67:0/2315469208 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:51.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b6a00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 0x7fc3b8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7e00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 0x7fc3b80c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 -- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 msgr2=0x7fc3b80c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 0x7fc3b80c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 -- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 msgr2=0x7fc3b8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 0x7fc3b8157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 -- 172.21.15.67:0/2315469208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81f9480 con 0x7fc3b80b4f60 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7e00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 0x7fc3b80c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b6a00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 0x7fc3b8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.891+0000 7fc3b7400640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c450 tx=0x7fc3a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.892+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80052d0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.892+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a8005470 con 0x7fc3b80b4f60 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.892+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8012870 con 0x7fc3b80b4f60 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.892+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b80c98c0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.892+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b80b89b0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.893+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8075bd0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.894+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3a8012a10 con 0x7fc3b80b4f60 2024-04-16T13:04:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.895+0000 7fc3af400640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 0x7fc39406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.895+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc3a808b9f0 con 0x7fc3b80b4f60 2024-04-16T13:04:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.896+0000 7fc3b6a00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 0x7fc39406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:51.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.897+0000 7fc3b6a00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 0x7fc39406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:51.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:51.900+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3a8059b70 con 0x7fc3b80b4f60 2024-04-16T13:04:52.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.105+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3b80d54c0 con 0x7fc3b80b4f60 2024-04-16T13:04:52.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.107+0000 7fc3af400640 1 -- 172.21.15.67:0/2315469208 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18431 (secure 0 0 0) 0x7fc3a8059470 con 0x7fc3b80b4f60 2024-04-16T13:04:52.109 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:52.110 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:50.620216+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 msgr2=0x7fc39406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 0x7fc39406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0035000 tx=0x7fc3a0030000 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 msgr2=0x7fc3b81f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800c450 tx=0x7fc3a800c910 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 shutdown_connections 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c920 0x7fc39406ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b80d4cc0 0x7fc3b80c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b80d0ed0 0x7fc3b8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 --2- 172.21.15.67:0/2315469208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b80b4f60 0x7fc3b81f5010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.109+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 >> 172.21.15.67:0/2315469208 conn(0x7fc3b808c000 msgr2=0x7fc3b80d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:52.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.110+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 shutdown_connections 2024-04-16T13:04:52.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.110+0000 7fc3bcc00640 1 -- 172.21.15.67:0/2315469208 wait complete. 2024-04-16T13:04:52.132 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.343+0000 7f9354a00640 1 Processor -- start 2024-04-16T13:04:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.344+0000 7f9354a00640 1 -- start start 2024-04-16T13:04:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f9354a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f93500b5570 0x7f9350071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f9354a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9350072390 0x7f93500ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f9354a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93500727a0 con 0x7f9350162ef0 2024-04-16T13:04:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f9354a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f935006dc70 con 0x7f93500b5570 2024-04-16T13:04:52.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f9354a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f935006df50 con 0x7f9350072390 2024-04-16T13:04:52.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f934de00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9350162ef0 0x7f935006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47894/0 (socket says 172.21.15.67:47894) 2024-04-16T13:04:52.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f934de00640 1 -- 172.21.15.67:0/4283921528 learned_addr learned my addr 172.21.15.67:0/4283921528 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.345+0000 7f934d400640 1 --2- 172.21.15.67:0/4283921528 >> v2:172.21.15.67:3300/0 conn(0x7f93500b5570 0x7f9350071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022073809 0 0) 0x7f9340001490 con 0x7f9350162ef0 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9334003520 con 0x7f9350162ef0 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934e800640 1 --2- 172.21.15.67:0/4283921528 >> v2:172.21.15.82:3300/0 conn(0x7f9350072390 0x7f93500ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934d400640 1 -- 172.21.15.67:0/4283921528 >> v2:172.21.15.82:3300/0 conn(0x7f9350072390 msgr2=0x7f93500ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934d400640 1 --2- 172.21.15.67:0/4283921528 >> v2:172.21.15.82:3300/0 conn(0x7f9350072390 0x7f93500ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934d400640 1 -- 172.21.15.67:0/4283921528 >> v1:172.21.15.67:6789/0 conn(0x7f9350162ef0 legacy=0x7f935006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1096185463 0 0) 0x7f9334003520 con 0x7f9350162ef0 2024-04-16T13:04:52.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.346+0000 7f934d400640 1 -- 172.21.15.67:0/4283921528 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935006e230 con 0x7f93500b5570 2024-04-16T13:04:52.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.347+0000 7f934d400640 1 --2- 172.21.15.67:0/4283921528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f9350071e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93500cdba0 tx=0x7f933802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35ce8c363fb1ec7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.347+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338038070 con 0x7f93500b5570 2024-04-16T13:04:52.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.347+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9338033440 con 0x7f93500b5570 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.347+0000 7f934ca00640 1 -- 172.21.15.67:0/4283921528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340001bc0 con 0x7f93500b5570 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 -- 172.21.15.67:0/4283921528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 msgr2=0x7f9350071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 --2- 172.21.15.67:0/4283921528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f9350071e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93500cdba0 tx=0x7f933802b7a0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 -- 172.21.15.67:0/4283921528 shutdown_connections 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 --2- 172.21.15.67:0/4283921528 >> v2:172.21.15.82:3300/0 conn(0x7f9350072390 0x7f93500ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 --2- 172.21.15.67:0/4283921528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f9350071e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 -- 172.21.15.67:0/4283921528 >> 172.21.15.67:0/4283921528 conn(0x7f93500b2210 msgr2=0x7f93500b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 -- 172.21.15.67:0/4283921528 shutdown_connections 2024-04-16T13:04:52.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.348+0000 7f9354a00640 1 -- 172.21.15.67:0/4283921528 wait complete. 2024-04-16T13:04:52.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.350+0000 7f9354a00640 1 Processor -- start 2024-04-16T13:04:52.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.350+0000 7f9354a00640 1 -- start start 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 0x7f9350141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 0x7f9350161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f935006ed10 con 0x7f93500b5570 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f935006e7f0 con 0x7f9350162ef0 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f9354a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f935006f8d0 con 0x7f9350072390 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f934d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f934d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53824/0 (socket says 172.21.15.67:53824) 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f934d400640 1 -- 172.21.15.67:0/2434047744 learned_addr learned my addr 172.21.15.67:0/2434047744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:52.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f934e800640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 0x7f9350161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.351+0000 7f934de00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 0x7f9350141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 -- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 msgr2=0x7f9350141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 0x7f9350141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 -- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 msgr2=0x7f9350161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 0x7f9350161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 -- 172.21.15.67:0/2434047744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9350144760 con 0x7f93500b5570 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934de00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 0x7f9350141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934e800640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 0x7f9350161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:52.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f934d400640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c00 tx=0x7f93380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338042020 con 0x7f93500b5570 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93380308c0 con 0x7f93500b5570 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9350144a40 con 0x7f93500b5570 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338038040 con 0x7f93500b5570 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.352+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350145000 con 0x7f93500b5570 2024-04-16T13:04:52.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.353+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9350075bd0 con 0x7f93500b5570 2024-04-16T13:04:52.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.354+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9338045020 con 0x7f93500b5570 2024-04-16T13:04:52.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.355+0000 7f9346000640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.355+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93380ad740 con 0x7f93500b5570 2024-04-16T13:04:52.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.356+0000 7f934de00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.357+0000 7f934de00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 0x7f932c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9340001d30 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.360+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f933804c030 con 0x7f93500b5570 2024-04-16T13:04:52.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.567+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9350166630 con 0x7f93500b5570 2024-04-16T13:04:52.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.570+0000 7f9346000640 1 -- 172.21.15.67:0/2434047744 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f933807b790 con 0x7f93500b5570 2024-04-16T13:04:52.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:52.573 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:52.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 msgr2=0x7f932c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 0x7f932c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9340001d30 tx=0x7f9340009040 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 msgr2=0x7f93501614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c00 tx=0x7f93380046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 shutdown_connections 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f932c06c8f0 0x7f932c06edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9350162ef0 0x7f9350161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93500b5570 0x7f93501614f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 --2- 172.21.15.67:0/2434047744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9350072390 0x7f9350141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 >> 172.21.15.67:0/2434047744 conn(0x7f93500b2210 msgr2=0x7f93500b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 shutdown_connections 2024-04-16T13:04:52.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.573+0000 7f9354a00640 1 -- 172.21.15.67:0/2434047744 wait complete. 2024-04-16T13:04:52.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:04:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.826+0000 7fb7d8c00640 1 Processor -- start 2024-04-16T13:04:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.826+0000 7fb7d8c00640 1 -- start start 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb7d415c420 0x7fb7d41601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d415c800 0x7fb7d40c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb7d40c5100 0x7fb7d40c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d4161110 con 0x7fb7d40c5100 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d4160870 con 0x7fb7d415c420 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.827+0000 7fb7d8c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d4160b50 con 0x7fb7d415c800 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb7d40c5100 0x7fb7d40c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb7d40c5100 0x7fb7d40c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53838/0 (socket says 172.21.15.67:53838) 2024-04-16T13:04:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 -- 172.21.15.67:0/2736957158 learned_addr learned my addr 172.21.15.67:0/2736957158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3400640 1 --2- 172.21.15.67:0/2736957158 >> v2:172.21.15.82:3300/0 conn(0x7fb7d415c420 0x7fb7d41601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d2a00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d415c800 0x7fb7d40c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 -- 172.21.15.67:0/2736957158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d415c800 msgr2=0x7fb7d40c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d415c800 0x7fb7d40c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 -- 172.21.15.67:0/2736957158 >> v2:172.21.15.82:3300/0 conn(0x7fb7d415c420 msgr2=0x7fb7d41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/2736957158 >> v2:172.21.15.82:3300/0 conn(0x7fb7d415c420 0x7fb7d41601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.828+0000 7fb7d3e00640 1 -- 172.21.15.67:0/2736957158 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d4160e30 con 0x7fb7d40c5100 2024-04-16T13:04:52.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.829+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d40c5100 0x7fb7d40c6760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40cd9a0 tx=0x7fb7cc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cd6150c82b4bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d2000640 1 -- 172.21.15.67:0/2736957158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc02c950 con 0x7fb7d40c5100 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d2000640 1 -- 172.21.15.67:0/2736957158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc02caf0 con 0x7fb7d40c5100 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d2000640 1 -- 172.21.15.67:0/2736957158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0343f0 con 0x7fb7d40c5100 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 -- 172.21.15.67:0/2736957158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d40c5100 msgr2=0x7fb7d40c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d40c5100 0x7fb7d40c6760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40cd9a0 tx=0x7fb7cc02bdb0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 -- 172.21.15.67:0/2736957158 shutdown_connections 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d40c5100 0x7fb7d40c6760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/2736957158 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d415c800 0x7fb7d40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/2736957158 >> v2:172.21.15.82:3300/0 conn(0x7fb7d415c420 0x7fb7d41601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 -- 172.21.15.67:0/2736957158 >> 172.21.15.67:0/2736957158 conn(0x7fb7d40b2070 msgr2=0x7fb7d40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:52.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 -- 172.21.15.67:0/2736957158 shutdown_connections 2024-04-16T13:04:52.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.830+0000 7fb7d8c00640 1 -- 172.21.15.67:0/2736957158 wait complete. 2024-04-16T13:04:52.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.832+0000 7fb7d8c00640 1 Processor -- start 2024-04-16T13:04:52.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.832+0000 7fb7d8c00640 1 -- start start 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d40c5100 0x7fb7d414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 0x7fb7d40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d406bba0 con 0x7fb7d415c800 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d406ba20 con 0x7fb7d415c420 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d8c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d406bd20 con 0x7fb7d40c5100 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53850/0 (socket says 172.21.15.67:53850) 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.833+0000 7fb7d3e00640 1 -- 172.21.15.67:0/1869411641 learned_addr learned my addr 172.21.15.67:0/1869411641 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3400640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d40c5100 0x7fb7d414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d2a00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 0x7fb7d40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 -- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d40c5100 msgr2=0x7fb7d414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d40c5100 0x7fb7d414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 -- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 msgr2=0x7fb7d40b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 0x7fb7d40b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 -- 172.21.15.67:0/1869411641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d414bc30 con 0x7fb7d415c800 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d2a00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 0x7fb7d40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.834+0000 7fb7d3e00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009f40 tx=0x7fb7cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.835+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc043020 con 0x7fb7d415c800 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.835+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc03e450 con 0x7fb7d415c800 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.835+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d40ad310 con 0x7fb7d415c800 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.835+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc03e840 con 0x7fb7d415c800 2024-04-16T13:04:52.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.835+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d40ad8d0 con 0x7fb7d415c800 2024-04-16T13:04:52.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.836+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d4075bd0 con 0x7fb7d415c800 2024-04-16T13:04:52.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.837+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7cc046020 con 0x7fb7d415c800 2024-04-16T13:04:52.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.838+0000 7fb7cb400640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 0x7fb7b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:52.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.838+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7cc0ae7c0 con 0x7fb7d415c800 2024-04-16T13:04:52.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.838+0000 7fb7d3400640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 0x7fb7b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:52.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.839+0000 7fb7d3400640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 0x7fb7b406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4006fd0 tx=0x7fb7c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:52.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:52.842+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7cc04d030 con 0x7fb7d415c800 2024-04-16T13:04:53.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.095+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7d40ccea0 con 0x7fb7d415c800 2024-04-16T13:04:53.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.096+0000 7fb7cb400640 1 -- 172.21.15.67:0/1869411641 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5168 (secure 0 0 0) 0x7fb7d414bc30 con 0x7fb7d415c800 2024-04-16T13:04:53.099 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:53.099 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:04:50.620742+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:04:53.099 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 6 2024-04-16T13:04:53.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 msgr2=0x7fb7b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 0x7fb7b406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4006fd0 tx=0x7fb7c4008040 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 msgr2=0x7fb7d40b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009f40 tx=0x7fb7cc004a40 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 shutdown_connections 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb7b406c8f0 0x7fb7b406edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d415c800 0x7fb7d40b12b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7d415c420 0x7fb7d40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 --2- 172.21.15.67:0/1869411641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb7d40c5100 0x7fb7d414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 >> 172.21.15.67:0/1869411641 conn(0x7fb7d40b2070 msgr2=0x7fb7d406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 shutdown_connections 2024-04-16T13:04:53.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.099+0000 7fb7d8c00640 1 -- 172.21.15.67:0/1869411641 wait complete. 2024-04-16T13:04:53.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:53.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.328+0000 7fe6f0a00640 1 Processor -- start 2024-04-16T13:04:53.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.328+0000 7fe6f0a00640 1 -- start start 2024-04-16T13:04:53.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.330+0000 7fe6f0a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6ec15c420 0x7fe6ec1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.330+0000 7fe6f0a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec161110 con 0x7fe6ec15c800 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.330+0000 7fe6f0a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec160870 con 0x7fe6ec0c6930 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.330+0000 7fe6f0a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec160b50 con 0x7fe6ec15c420 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.330+0000 7fe6ea800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6ec15c420 0x7fe6ec1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6ea800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe6ec15c420 0x7fe6ec1601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53854/0 (socket says 172.21.15.67:53854) 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6e3e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe6ec15c800 0x7fe6ec0c6220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47906/0 (socket says 172.21.15.67:47906) 2024-04-16T13:04:53.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6ea800640 1 -- 172.21.15.67:0/3987140765 learned_addr learned my addr 172.21.15.67:0/3987140765 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:53.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6ea800640 1 -- 172.21.15.67:0/3987140765 >> v1:172.21.15.82:6789/0 conn(0x7fe6ec0c6930 legacy=0x7fe6ec0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:53.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6ea800640 1 -- 172.21.15.67:0/3987140765 >> v1:172.21.15.67:6789/0 conn(0x7fe6ec15c800 legacy=0x7fe6ec0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.331+0000 7fe6ea800640 1 -- 172.21.15.67:0/3987140765 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec160e30 con 0x7fe6ec15c420 2024-04-16T13:04:53.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.332+0000 7fe6ea800640 1 --2- 172.21.15.67:0/3987140765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec1601e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009870 tx=0x7fe6dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e806dcc2950da8f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:53.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.332+0000 7fe6e9e00640 1 -- 172.21.15.67:0/3987140765 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc035020 con 0x7fe6ec15c420 2024-04-16T13:04:53.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.332+0000 7fe6e9e00640 1 -- 172.21.15.67:0/3987140765 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc031870 con 0x7fe6ec15c420 2024-04-16T13:04:53.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.332+0000 7fe6e9e00640 1 -- 172.21.15.67:0/3987140765 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc031c40 con 0x7fe6ec15c420 2024-04-16T13:04:53.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 -- 172.21.15.67:0/3987140765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 msgr2=0x7fe6ec1601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/3987140765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec1601e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009870 tx=0x7fe6dc02b910 comp rx=0 tx=0).stop 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 -- 172.21.15.67:0/3987140765 shutdown_connections 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/3987140765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec1601e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 -- 172.21.15.67:0/3987140765 >> 172.21.15.67:0/3987140765 conn(0x7fe6ec0b2070 msgr2=0x7fe6ec0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 -- 172.21.15.67:0/3987140765 shutdown_connections 2024-04-16T13:04:53.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.333+0000 7fe6f0a00640 1 -- 172.21.15.67:0/3987140765 wait complete. 2024-04-16T13:04:53.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.335+0000 7fe6f0a00640 1 Processor -- start 2024-04-16T13:04:53.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.335+0000 7fe6f0a00640 1 -- start start 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 0x7fe6ec15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 0x7fe6ec0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0c5280 con 0x7fe6ec15c420 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0c5100 con 0x7fe6ec0c6930 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6f0a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0c5400 con 0x7fe6ec15c800 2024-04-16T13:04:53.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.336+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53864/0 (socket says 172.21.15.67:53864) 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 -- 172.21.15.67:0/708527190 learned_addr learned my addr 172.21.15.67:0/708527190 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6ea800640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 0x7fe6ec15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6eb200640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 0x7fe6ec0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 -- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 msgr2=0x7fe6ec0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 0x7fe6ec0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 -- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 msgr2=0x7fe6ec15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 0x7fe6ec15b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 -- 172.21.15.67:0/708527190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1e6590 con 0x7fe6ec15c420 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6eb200640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 0x7fe6ec0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6ea800640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 0x7fe6ec15b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.337+0000 7fe6e3e00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400c440 tx=0x7fe6d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.338+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40074e0 con 0x7fe6ec15c420 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.338+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d4007680 con 0x7fe6ec15c420 2024-04-16T13:04:53.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.338+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4004a20 con 0x7fe6ec15c420 2024-04-16T13:04:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.338+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec1e6870 con 0x7fe6ec15c420 2024-04-16T13:04:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.338+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1e6e30 con 0x7fe6ec15c420 2024-04-16T13:04:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.339+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec075bd0 con 0x7fe6ec15c420 2024-04-16T13:04:53.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.340+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6d401a020 con 0x7fe6ec15c420 2024-04-16T13:04:53.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.341+0000 7fe6e2a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:53.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.341+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe6d408b7b0 con 0x7fe6ec15c420 2024-04-16T13:04:53.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.342+0000 7fe6ea800640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:53.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.343+0000 7fe6ea800640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 0x7fe6c806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:53.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.346+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6d40597b0 con 0x7fe6ec15c420 2024-04-16T13:04:53.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.554+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6ec0b3dc0 con 0x7fe6ec15c420 2024-04-16T13:04:53.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.557+0000 7fe6e2a00640 1 -- 172.21.15.67:0/708527190 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fe6d40590b0 con 0x7fe6ec15c420 2024-04-16T13:04:53.560 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:53.560 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 msgr2=0x7fe6c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 0x7fe6c806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc036000 tx=0x7fe6dc03c040 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 msgr2=0x7fe6ec0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400c440 tx=0x7fe6d4001e70 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 shutdown_connections 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe6c806c8f0 0x7fe6c806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe6ec15c800 0x7fe6ec0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6ec15c420 0x7fe6ec0ae5e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 --2- 172.21.15.67:0/708527190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6ec0c6930 0x7fe6ec15b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 >> 172.21.15.67:0/708527190 conn(0x7fe6ec0b2070 msgr2=0x7fe6ec0c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 shutdown_connections 2024-04-16T13:04:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:53.560+0000 7fe6f0a00640 1 -- 172.21.15.67:0/708527190 wait complete. 2024-04-16T13:04:53.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T13:04:45.468405+0000', 'modified': '2024-04-16T13:04:50.620742+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/427491398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 427491398}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 427491398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-04-16T13:04:53.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T13:04:53.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-16T13:04:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.206+0000 7facc6800640 1 Processor -- start 2024-04-16T13:04:54.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.206+0000 7facc6800640 1 -- start start 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc6800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facc015e7e0 0x7facc00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc6800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc00d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc6800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00d2b10 con 0x7facc00d1620 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc6800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7facc00d1a80 con 0x7facc015e7e0 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc6800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7facc00d2df0 con 0x7facc00d22c0 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc5400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facc015e7e0 0x7facc00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc4a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc00d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc5400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7facc015e7e0 0x7facc00d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:57108/0 (socket says 172.21.15.67:57108) 2024-04-16T13:04:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.208+0000 7facc5400640 1 -- 172.21.15.67:0/3701098113 learned_addr learned my addr 172.21.15.67:0/3701098113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.209+0000 7facc5400640 1 -- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 msgr2=0x7facc00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.209+0000 7facc5400640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc00d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.209+0000 7facc5400640 1 -- 172.21.15.67:0/3701098113 >> v1:172.21.15.82:6789/0 conn(0x7facc00d1620 legacy=0x7facc00d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.209+0000 7facc5400640 1 -- 172.21.15.67:0/3701098113 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00d30d0 con 0x7facc015e7e0 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.209+0000 7facc4a00640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc00d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:04:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.210+0000 7facc5400640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc00d0240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facb4009850 tx=0x7facb402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d6ce1ddb90e4402 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.211+0000 7facbfe00640 1 -- 172.21.15.67:0/3701098113 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4004230 con 0x7facc015e7e0 2024-04-16T13:04:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.211+0000 7facbfe00640 1 -- 172.21.15.67:0/3701098113 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb40043d0 con 0x7facc015e7e0 2024-04-16T13:04:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.211+0000 7facbfe00640 1 -- 172.21.15.67:0/3701098113 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4003810 con 0x7facc015e7e0 2024-04-16T13:04:54.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 -- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 msgr2=0x7facc00d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc00d0240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facb4009850 tx=0x7facb402b960 comp rx=0 tx=0).stop 2024-04-16T13:04:54.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 -- 172.21.15.67:0/3701098113 shutdown_connections 2024-04-16T13:04:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc00d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 --2- 172.21.15.67:0/3701098113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc00d0240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 -- 172.21.15.67:0/3701098113 >> 172.21.15.67:0/3701098113 conn(0x7facc009da60 msgr2=0x7facc008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 -- 172.21.15.67:0/3701098113 shutdown_connections 2024-04-16T13:04:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.212+0000 7facc6800640 1 -- 172.21.15.67:0/3701098113 wait complete. 2024-04-16T13:04:54.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.214+0000 7facc6800640 1 Processor -- start 2024-04-16T13:04:54.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.214+0000 7facc6800640 1 -- start start 2024-04-16T13:04:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.215+0000 7facc6800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc6800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc0161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc6800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facc00d2720 con 0x7facc00d1620 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc6800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facc00d3690 con 0x7facc015e7e0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc6800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7facc00d28a0 con 0x7facc00d22c0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53868/0 (socket says 172.21.15.67:53868) 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 -- 172.21.15.67:0/34308438 learned_addr learned my addr 172.21.15.67:0/34308438 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5e00640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc0161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc4a00640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 -- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 msgr2=0x7facc01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 -- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 msgr2=0x7facc0161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc0161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.216+0000 7facc5400640 1 -- 172.21.15.67:0/34308438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0154e30 con 0x7facc00d1620 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facc5400640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7facb4009970 tx=0x7facb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facbd600640 1 -- 172.21.15.67:0/34308438 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4047070 con 0x7facc00d1620 2024-04-16T13:04:54.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facbd600640 1 -- 172.21.15.67:0/34308438 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb4003bd0 con 0x7facc00d1620 2024-04-16T13:04:54.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facbd600640 1 -- 172.21.15.67:0/34308438 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4006040 con 0x7facc00d1620 2024-04-16T13:04:54.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc00cc9b0 con 0x7facc00d1620 2024-04-16T13:04:54.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.217+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc00ccf70 con 0x7facc00d1620 2024-04-16T13:04:54.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.220+0000 7facbd600640 1 -- 172.21.15.67:0/34308438 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facb404a070 con 0x7facc00d1620 2024-04-16T13:04:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.221+0000 7facbd600640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 0x7faca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.221+0000 7facbd600640 1 -- 172.21.15.67:0/34308438 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7facb40ad730 con 0x7facc00d1620 2024-04-16T13:04:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.222+0000 7faccaa7a740 1 Processor -- start 2024-04-16T13:04:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.222+0000 7facc4a00640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 0x7faca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.222+0000 7faccaa7a740 1 -- start start 2024-04-16T13:04:54.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d79159d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 0x55d791557570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d7914bc9c0 con 0x55d791557ab0 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d791463560 con 0x55d79157ec70 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d7914b8980 con 0x55d79157e890 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc4a00640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 0x7faca006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facac009560 tx=0x7facac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53878/0 (socket says 172.21.15.67:53878) 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc5e00640 1 -- 172.21.15.67:0/2975788548 learned_addr learned my addr 172.21.15.67:0/2975788548 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc4a00640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 0x55d791557570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.223+0000 7facc5400640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d79159d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 -- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 msgr2=0x55d79159d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d79159d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 -- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 msgr2=0x55d791557570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 0x55d791557570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 -- 172.21.15.67:0/2975788548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7911cf2d0 con 0x55d791557ab0 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc4a00640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 0x55d791557570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facc5e00640 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7facb8001c70 tx=0x7facb8002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300b8825ca018191 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facb1c00640 1 -- 172.21.15.67:0/2975788548 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8019070 con 0x55d791557ab0 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facb1c00640 1 -- 172.21.15.67:0/2975788548 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb8003b80 con 0x55d791557ab0 2024-04-16T13:04:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.224+0000 7facb1c00640 1 -- 172.21.15.67:0/2975788548 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb800e7a0 con 0x55d791557ab0 2024-04-16T13:04:54.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 -- 172.21.15.67:0/2975788548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 msgr2=0x55d791555440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7facb8001c70 tx=0x7facb8002130 comp rx=0 tx=0).stop 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 -- 172.21.15.67:0/2975788548 shutdown_connections 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d791557ab0 0x55d791555440 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ec70 0x55d791557570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 --2- 172.21.15.67:0/2975788548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d79159d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 -- 172.21.15.67:0/2975788548 >> 172.21.15.67:0/2975788548 conn(0x55d791553b50 msgr2=0x55d79159c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 -- 172.21.15.67:0/2975788548 shutdown_connections 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.225+0000 7faccaa7a740 1 -- 172.21.15.67:0/2975788548 wait complete. 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.226+0000 7faccaa7a740 1 -- start start 2024-04-16T13:04:54.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.226+0000 7faccaa7a740 1 Processor -- start 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d791580210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d79157b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d791551980 con 0x55d79157ec70 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d791476920 con 0x55d79157ad40 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d791557f30 con 0x55d79157e890 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7faccaa7a740 10 client.0 _ll_register_callbacks cb 0x55d791476310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7facc4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7facc4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53884/0 (socket says 172.21.15.67:53884) 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.227+0000 7facc4a00640 1 -- 172.21.15.67:0/658403133 learned_addr learned my addr 172.21.15.67:0/658403133 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc5e00640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d79157b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc5400640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d791580210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 -- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 msgr2=0x55d791580210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d791580210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 -- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 msgr2=0x55d79157b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d79157b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 -- 172.21.15.67:0/658403133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7912996b0 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc5e00640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d79157b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7facc4a00640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facac015770 tx=0x7facac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129eef43366108c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7faca6000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac026070 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.228+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7facac0147f0 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb8003b80 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7facac031050 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 10 client.4398 fetch_fsmap learned FSMap version 6 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d79159be70 con 0x55d79157ec70 2024-04-16T13:04:54.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb8003b80 con 0x55d79157ec70 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7facac034020 con 0x55d79157ec70 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 10 client.4398 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 10 client.4398 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 20 client.4398 populate_metadata read hostname 'smithi067' 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d791598880 0x55d7915bb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 4 client.4398 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.229+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 --> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d791462b70 con 0x55d791598880 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.230+0000 7facc5400640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d791598880 0x55d7915bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.230+0000 7facc5400640 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d791598880 0x55d7915bb510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd10539bc1847257 server_cookie=39e8999043d213f8 in_seq=0 out_seq=0 2024-04-16T13:04:54.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.230+0000 7faca6000640 10 client.4398 ms_handle_connect on v2:172.21.15.67:6834/427491398 2024-04-16T13:04:54.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faca6000640 1 -- 172.21.15.67:0/658403133 <== mds.0 v2:172.21.15.67:6834/427491398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d791462b70 con 0x55d791598880 2024-04-16T13:04:54.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faca6000640 10 client.4398 handle_command_reply: tid=0 2024-04-16T13:04:54.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 client.4398 shutdown 2024-04-16T13:04:54.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 msgr2=0x55d79159b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facac015770 tx=0x7facac0046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 shutdown_connections 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d791598880 0x55d7915bb510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d79157b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159b320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 --2- 172.21.15.67:0/658403133 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157e890 0x55d791580210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faca6000640 0 client.4398 ms_handle_reset on v2:172.21.15.67:6834/427491398 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 >> 172.21.15.67:0/658403133 conn(0x55d791557ab0 msgr2=0x55d791550790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 shutdown_connections 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.231+0000 7faccaa7a740 1 -- 172.21.15.67:0/658403133 wait complete. 2024-04-16T13:04:54.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.232+0000 7faccaa7a740 20 client.4398 trim_cache size 0 max 16384 2024-04-16T13:04:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.252+0000 7faccaa7a740 1 Processor -- start 2024-04-16T13:04:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.252+0000 7faccaa7a740 1 -- start start 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ad40 0x55d79159a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157e890 0x55d79159c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facc0201410 con 0x55d79157ec70 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facc0200810 con 0x55d79157e890 2024-04-16T13:04:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7facc0200dc0 con 0x55d79157ad40 2024-04-16T13:04:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7facc5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7facc5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53896/0 (socket says 172.21.15.67:53896) 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.253+0000 7facc5e00640 1 -- 172.21.15.67:0/3482821475 learned_addr learned my addr 172.21.15.67:0/3482821475 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 -- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ad40 msgr2=0x55d79159a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ad40 0x55d79159a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 -- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157e890 msgr2=0x55d79159c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157e890 0x55d79159c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 -- 172.21.15.67:0/3482821475 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d791597b40 con 0x55d79157ec70 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facc5e00640 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facb8009010 tx=0x7facb800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da62ace29f01931e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facb1200640 1 -- 172.21.15.67:0/3482821475 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8019030 con 0x55d79157ec70 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facb1200640 1 -- 172.21.15.67:0/3482821475 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb8023070 con 0x55d79157ec70 2024-04-16T13:04:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.254+0000 7facb1200640 1 -- 172.21.15.67:0/3482821475 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8006d90 con 0x55d79157ec70 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 -- 172.21.15.67:0/3482821475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 msgr2=0x55d79159cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facb8009010 tx=0x7facb800a000 comp rx=0 tx=0).stop 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 -- 172.21.15.67:0/3482821475 shutdown_connections 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157ec70 0x55d79159cba0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157e890 0x55d79159c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3482821475 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ad40 0x55d79159a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 -- 172.21.15.67:0/3482821475 >> 172.21.15.67:0/3482821475 conn(0x55d791557ab0 msgr2=0x55d791580020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 -- 172.21.15.67:0/3482821475 shutdown_connections 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.255+0000 7faccaa7a740 1 -- 172.21.15.67:0/3482821475 wait complete. 2024-04-16T13:04:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.256+0000 7faccaa7a740 1 -- start start 2024-04-16T13:04:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.256+0000 7faccaa7a740 1 Processor -- start 2024-04-16T13:04:54.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d791619b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ec70 0x55d7915bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d7915b05a0 con 0x55d79157e890 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d79159c150 con 0x55d79157ad40 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d7915b0bf0 con 0x55d79157ec70 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7faccaa7a740 10 client.0 _ll_register_callbacks cb 0x7facac011e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7facc4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7facc4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53902/0 (socket says 172.21.15.67:53902) 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.257+0000 7facc4a00640 1 -- 172.21.15.67:0/3073212380 learned_addr learned my addr 172.21.15.67:0/3073212380 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 -- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ec70 msgr2=0x55d7915bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ec70 0x55d7915bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 -- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 msgr2=0x55d791619b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d791619b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 -- 172.21.15.67:0/3073212380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d791597040 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7facc4a00640 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facac000c00 tx=0x7facac009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc92e4002d24f844 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7faca6000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac03b070 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7facac014e00 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.258+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb8023070 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7facac046050 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 10 client.4404 fetch_fsmap learned FSMap version 6 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d79157d890 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb8023070 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7facac049020 con 0x55d79157e890 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 10 client.4404 fetch_fsmap finished waiting for FSMap version 6 2024-04-16T13:04:54.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 10 client.4404 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 20 client.4404 populate_metadata read hostname 'smithi067' 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d79159f340 0x55d79159f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 4 client.4404 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 --> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] -- command(tid 0: {"prefix": "status"}) -- 0x55d791552f60 con 0x55d79159f340 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.259+0000 7facc5400640 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d79159f340 0x55d79159f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7facc5400640 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d79159f340 0x55d79159f720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa278609e906989e server_cookie=17988e07e2c7802b in_seq=0 out_seq=0 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faca6000640 10 client.4404 ms_handle_connect on v2:172.21.15.67:6834/427491398 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faca6000640 1 -- 172.21.15.67:0/3073212380 <== mds.0 v2:172.21.15.67:6834/427491398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d791552f60 con 0x55d79159f340 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faca6000640 10 client.4404 handle_command_reply: tid=0 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faccaa7a740 1 client.4404 shutdown 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 msgr2=0x55d79157e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.260+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7facac000c00 tx=0x7facac009190 comp rx=0 tx=0).stop 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 shutdown_connections 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d79159f340 0x55d79159f720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d79157ec70 0x55d7915bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d79157e890 0x55d79157e030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 --2- 172.21.15.67:0/3073212380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d79157ad40 0x55d791619b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faca6000640 0 client.4404 ms_handle_reset on v2:172.21.15.67:6834/427491398 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 >> 172.21.15.67:0/3073212380 conn(0x55d791557ab0 msgr2=0x55d79159c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 shutdown_connections 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 1 -- 172.21.15.67:0/3073212380 wait complete. 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7faccaa7a740 20 client.4404 trim_cache size 0 max 16384 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dc50e499-96cc-43d1-bcde-ee8dfcd0732f", 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-04-16T13:04:54.267 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4282, 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 8.2590056399999998, 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 6, 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 25, 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 24, 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 13.557473355000001 2024-04-16T13:04:54.268 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 msgr2=0x7faca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 0x7faca006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facac009560 tx=0x7facac008040 comp rx=0 tx=0).stop 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 msgr2=0x7facc00cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.261+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7facb4009970 tx=0x7facb40046c0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 shutdown_connections 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faca006c8f0 0x7faca006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facc015e7e0 0x7facc0161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7facc00d22c0 0x7facc01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 --2- 172.21.15.67:0/34308438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facc00d1620 0x7facc00cda50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 >> 172.21.15.67:0/34308438 conn(0x7facc009da60 msgr2=0x7facc006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 shutdown_connections 2024-04-16T13:04:54.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.262+0000 7facc6800640 1 -- 172.21.15.67:0/34308438 wait complete. 2024-04-16T13:04:54.281 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T13:04:54.282 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:54.282 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T13:04:54.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.483+0000 7fd223e00640 1 Processor -- start 2024-04-16T13:04:54.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.483+0000 7fd223e00640 1 -- start start 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.484+0000 7fd223e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd22415c4f0 0x7fd22415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2240b2850 0x7fd2240b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2241605d0 con 0x7fd2240ccf00 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd2240b0b00 con 0x7fd2240b2850 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd2241608b0 con 0x7fd22415c4f0 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2240b2850 0x7fd2240b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd2240b2850 0x7fd2240b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53906/0 (socket says 172.21.15.67:53906) 2024-04-16T13:04:54.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 -- 172.21.15.67:0/664639252 learned_addr learned my addr 172.21.15.67:0/664639252 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd222a00640 1 --2- 172.21.15.67:0/664639252 >> v2:172.21.15.82:3300/0 conn(0x7fd22415c4f0 0x7fd22415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 -- 172.21.15.67:0/664639252 >> v2:172.21.15.82:3300/0 conn(0x7fd22415c4f0 msgr2=0x7fd22415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 --2- 172.21.15.67:0/664639252 >> v2:172.21.15.82:3300/0 conn(0x7fd22415c4f0 0x7fd22415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 -- 172.21.15.67:0/664639252 >> v1:172.21.15.82:6789/0 conn(0x7fd2240ccf00 legacy=0x7fd2240b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:54.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.485+0000 7fd223400640 1 -- 172.21.15.67:0/664639252 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd224160b90 con 0x7fd2240b2850 2024-04-16T13:04:54.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.486+0000 7fd223400640 1 --2- 172.21.15.67:0/664639252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240b2850 0x7fd2240b0f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ced90 tx=0x7fd21c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed8f6de310d022d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.487+0000 7fd221600640 1 -- 172.21.15.67:0/664639252 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c02ca80 con 0x7fd2240b2850 2024-04-16T13:04:54.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.487+0000 7fd221600640 1 -- 172.21.15.67:0/664639252 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21c02cc20 con 0x7fd2240b2850 2024-04-16T13:04:54.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.487+0000 7fd221600640 1 -- 172.21.15.67:0/664639252 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0343f0 con 0x7fd2240b2850 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.487+0000 7fd223e00640 1 -- 172.21.15.67:0/664639252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240b2850 msgr2=0x7fd2240b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.487+0000 7fd223e00640 1 --2- 172.21.15.67:0/664639252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240b2850 0x7fd2240b0f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ced90 tx=0x7fd21c02bee0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 -- 172.21.15.67:0/664639252 shutdown_connections 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 --2- 172.21.15.67:0/664639252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240b2850 0x7fd2240b0f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 --2- 172.21.15.67:0/664639252 >> v2:172.21.15.82:3300/0 conn(0x7fd22415c4f0 0x7fd22415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 -- 172.21.15.67:0/664639252 >> 172.21.15.67:0/664639252 conn(0x7fd22409aa70 msgr2=0x7fd2240b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 -- 172.21.15.67:0/664639252 shutdown_connections 2024-04-16T13:04:54.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.488+0000 7fd223e00640 1 -- 172.21.15.67:0/664639252 wait complete. 2024-04-16T13:04:54.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.489+0000 7fd223e00640 1 Processor -- start 2024-04-16T13:04:54.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.490+0000 7fd223e00640 1 -- start start 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2240b2850 0x7fd22415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22415c4f0 0x7fd2241f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd2240b3960 con 0x7fd2240ccf00 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd22415ce10 con 0x7fd22415c4f0 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd2240b3ae0 con 0x7fd2240b2850 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53910/0 (socket says 172.21.15.67:53910) 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 -- 172.21.15.67:0/704496394 learned_addr learned my addr 172.21.15.67:0/704496394 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd223400640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22415c4f0 0x7fd2241f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222a00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2240b2850 0x7fd22415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 -- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2240b2850 msgr2=0x7fd22415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2240b2850 0x7fd22415f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 -- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22415c4f0 msgr2=0x7fd2241f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22415c4f0 0x7fd2241f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.491+0000 7fd222000640 1 -- 172.21.15.67:0/704496394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2240c9190 con 0x7fd2240ccf00 2024-04-16T13:04:54.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd222000640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c400 tx=0x7fd20c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011790 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c017070 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c011bb0 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2240c9470 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.492+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2240c9a30 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.493+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd224075bd0 con 0x7fd2240ccf00 2024-04-16T13:04:54.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.494+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd20c01c460 con 0x7fd2240ccf00 2024-04-16T13:04:54.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.495+0000 7fd21aa00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 0x7fd20006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:54.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.495+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd20c08bd90 con 0x7fd2240ccf00 2024-04-16T13:04:54.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.496+0000 7fd222a00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 0x7fd20006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:54.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.497+0000 7fd222a00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 0x7fd20006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd214006fd0 tx=0x7fd214008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:54.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.500+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd20c059de0 con 0x7fd2240ccf00 2024-04-16T13:04:54.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.746+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd22406dcd0 con 0x7fd2240ccf00 2024-04-16T13:04:54.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.747+0000 7fd21aa00640 1 -- 172.21.15.67:0/704496394 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fd20c0596e0 con 0x7fd2240ccf00 2024-04-16T13:04:54.750 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 msgr2=0x7fd20006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 0x7fd20006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd214006fd0 tx=0x7fd214008040 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 msgr2=0x7fd2240caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c400 tx=0x7fd20c00c8c0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 shutdown_connections 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd20006c8f0 0x7fd20006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd22415c4f0 0x7fd2241f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2240ccf00 0x7fd2240caa60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 --2- 172.21.15.67:0/704496394 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd2240b2850 0x7fd22415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.750+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 >> 172.21.15.67:0/704496394 conn(0x7fd22409aa70 msgr2=0x7fd22415df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.751+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 shutdown_connections 2024-04-16T13:04:54.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54.751+0000 7fd223e00640 1 -- 172.21.15.67:0/704496394 wait complete. 2024-04-16T13:04:54.772 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-16T13:04:54.772 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T13:04:54.772 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-16T13:04:54.772 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-16T13:04:54.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:54.773 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-16T13:04:54.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T13:04:54.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T13:04:54.773 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T13:04:54.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:54.773 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-16T13:04:54.829 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:04:54.829 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:04:54.829 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-16T13:04:54.830 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T13:04:54.831 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-16T13:04:54.831 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-16T13:04:54.831 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42525sec preferred_lft 42525sec 2024-04-16T13:04:54.831 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-04-16T13:04:54.831 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:04:54.832 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T13:04:54.832 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:04:54.832 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:04:54.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-04-16T13:04:54.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-04-16T13:04:54.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-04-16T13:04:54.833 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T13:04:54.833 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:04:54.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:04:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:55.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:55.390 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T13:04:55.469 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-16T13:04:55.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:55.472 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-16T13:04:55.528 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-16T13:04:55.528 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T13:04:55.528 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T13:04:55.528 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T13:04:55.528 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T13:04:55.529 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:04:55.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:04:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:56.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:56.265 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:04:56.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:56.314 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-04-16T13:04:56.406 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:04:56.406 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:04:56.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:04:56.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-16T13:04:56.407 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:04:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:04:56.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:56.606 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-16T13:04:56.606 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:04:56.606 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-16T13:04:56.607 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:04:56.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:04:57.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:57.686 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:04:57.686 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:04:57.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-04-16T13:04:57.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T13:04:57.686 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:04:57.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:04:57.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:57.918 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-16T13:04:57.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:04:57.918 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:57.967 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-16T13:04:57.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:04:57.968 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:58.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-04-16T13:04:58.103 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-04-16T13:04:58.160 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/selinux 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-04-16T13:04:58.161 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:04:58.162 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:04:58.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:58.163 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-04-16T13:04:58.217 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-16T13:04:58.218 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-16T13:04:58.222 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-04-16T13:04:58.297 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-04-16T13:04:58.339 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/selinux 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysctl.service 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-16T13:04:58.340 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/nfs/rpc_pipefs 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:04:58.341 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:04:58.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:58.342 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-04-16T13:04:58.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:2024-04-16T13:04:58.412+0000 7fa8c124c480 -1 init, newargv = 0x5625746cc0c0 newargc=15 2024-04-16T13:04:58.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[43421]: starting ceph client 2024-04-16T13:04:58.428 INFO:teuthology.orchestra.run.smithi067.stdout:41 2024-04-16T13:04:58.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[43421]: starting fuse 2024-04-16T13:04:58.429 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-16T13:04:58.429 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-04-16T13:04:58.430 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-04-16T13:04:58.431 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-16T13:04:58.431 DEBUG:teuthology.orchestra.run.smithi067:> 2024-04-16T13:04:58.431 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.admin")) 2024-04-16T13:04:58.431 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-04-16T13:04:58.629 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.admin.43421.asok 2024-04-16T13:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:58.646 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43421.asok 2024-04-16T13:04:58.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:58.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43421.asok status 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f", 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev)", 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "admin", 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-16T13:04:58.884 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "43421", 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4419, 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 4419 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-04-16T13:04:58.885 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 351174507 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 351174507 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.4419 192.168.0.1:0/351174507", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/351174507", 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-04-16T13:04:58.886 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 6, 2024-04-16T13:04:58.887 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 25, 2024-04-16T13:04:58.887 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-04-16T13:04:58.887 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-04-16T13:04:58.887 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-04-16T13:04:58.887 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:04:58.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:58.899 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-04-16T13:04:58.899 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:58.956 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-04-16T13:04:58.956 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:04:58.956 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:04:59.055 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-16T13:04:59.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:04:59.207 INFO:teuthology.orchestra.run.smithi067.stdout:# file: . 2024-04-16T13:04:59.207 INFO:teuthology.orchestra.run.smithi067.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-16T13:04:59.207 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:59.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:04:59.218 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:04:59.218 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:04:59.272 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:04:59.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.544+0000 7fd78fe00640 1 Processor -- start 2024-04-16T13:04:59.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.545+0000 7fd78fe00640 1 -- start start 2024-04-16T13:04:59.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.546+0000 7fd78fe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd79006d360 0x7fd79006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.546+0000 7fd78fe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7900d0000 con 0x7fd7900d27b0 2024-04-16T13:04:59.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.546+0000 7fd78fe00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7900d02e0 con 0x7fd79015eaa0 2024-04-16T13:04:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.546+0000 7fd78fe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd79006dd00 con 0x7fd79006d360 2024-04-16T13:04:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.547+0000 7fd78f400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7900d27b0 0x7fd7900d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47914/0 (socket says 172.21.15.67:47914) 2024-04-16T13:04:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.547+0000 7fd78f400640 1 -- 172.21.15.67:0/4161837747 learned_addr learned my addr 172.21.15.67:0/4161837747 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:04:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.547+0000 7fd78e000640 1 --2- 172.21.15.67:0/4161837747 >> v2:172.21.15.82:3300/0 conn(0x7fd79006d360 0x7fd79006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.547+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044810893 0 0) 0x7fd7900d0000 con 0x7fd7900d27b0 2024-04-16T13:04:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.547+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd774003520 con 0x7fd7900d27b0 2024-04-16T13:04:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2670815554 0 0) 0x7fd774003520 con 0x7fd7900d27b0 2024-04-16T13:04:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 >> v2:172.21.15.82:3300/0 conn(0x7fd79006d360 msgr2=0x7fd79006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 --2- 172.21.15.67:0/4161837747 >> v2:172.21.15.82:3300/0 conn(0x7fd79006d360 0x7fd79006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 >> v1:172.21.15.82:6789/0 conn(0x7fd79015eaa0 legacy=0x7fd7900d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7900d05c0 con 0x7fd7900d27b0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fd7880019f0 con 0x7fd7900d27b0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 >> v1:172.21.15.67:6789/0 conn(0x7fd7900d27b0 legacy=0x7fd7900d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7740051c0 0x7fd77400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd77400c130 con 0x7fd774004800 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd77400c2e0 con 0x7fd7740039b0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd77400c4e0 con 0x7fd7740051c0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78e000640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.548+0000 7fd78ea00640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78e000640 1 -- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7740051c0 msgr2=0x7fd77400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78e000640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7740051c0 0x7fd77400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78e000640 1 -- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740039b0 msgr2=0x7fd774003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:04:59.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78e000640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78e000640 1 -- 172.21.15.67:0/4161837747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774003520 con 0x7fd774004800 2024-04-16T13:04:59.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.549+0000 7fd78f400640 1 -- 172.21.15.67:0/4161837747 reap_dead start 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.550+0000 7fd78e000640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 0x7fd774004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3394ff49a7b51ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.550+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c039070 con 0x7fd774004800 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.550+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c02c6b0 con 0x7fd774004800 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.550+0000 7fd78d600640 1 -- 172.21.15.67:0/4161837747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c009690 con 0x7fd774004800 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 -- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 msgr2=0x7fd774004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 0x7fd774004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd774005830 comp rx=0 tx=0).stop 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 -- 172.21.15.67:0/4161837747 shutdown_connections 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 --2- 172.21.15.67:0/4161837747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 -- 172.21.15.67:0/4161837747 >> 172.21.15.67:0/4161837747 conn(0x7fd79008c000 msgr2=0x7fd7900d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 -- 172.21.15.67:0/4161837747 shutdown_connections 2024-04-16T13:04:59.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.551+0000 7fd78fe00640 1 -- 172.21.15.67:0/4161837747 wait complete. 2024-04-16T13:04:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.553+0000 7fd78fe00640 1 Processor -- start 2024-04-16T13:04:59.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.553+0000 7fd78fe00640 1 -- start start 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 0x7fd7900c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7900b9ae0 0x7fd790160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd79015ee80 con 0x7fd7900b7580 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7900d0c10 con 0x7fd7900b9ae0 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78fe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd79006ceb0 con 0x7fd774004800 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53928/0 (socket says 172.21.15.67:53928) 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78f400640 1 -- 172.21.15.67:0/3175205359 learned_addr learned my addr 172.21.15.67:0/3175205359 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.554+0000 7fd78e000640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7900b9ae0 0x7fd790160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78ea00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 0x7fd7900c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 -- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 msgr2=0x7fd7900c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 0x7fd7900c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 -- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7900b9ae0 msgr2=0x7fd790160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7900b9ae0 0x7fd790160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 -- 172.21.15.67:0/3175205359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7901540d0 con 0x7fd7900b7580 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78ea00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 0x7fd7900c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:04:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78f400640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd788000f80 tx=0x7fd78800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78800a5b0 con 0x7fd7900b7580 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78800a750 con 0x7fd7900b7580 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78800ab40 con 0x7fd7900b7580 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7900c86e0 con 0x7fd7900b7580 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.555+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd790160550 con 0x7fd7900b7580 2024-04-16T13:04:59.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.557+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd790075bd0 con 0x7fd7900b7580 2024-04-16T13:04:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.558+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd788011070 con 0x7fd7900b7580 2024-04-16T13:04:59.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.558+0000 7fd786a00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 0x7fd77006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:04:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.559+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd78808b530 con 0x7fd7900b7580 2024-04-16T13:04:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.559+0000 7fd78ea00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 0x7fd77006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:04:59.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.560+0000 7fd78ea00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 0x7fd77006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd780001630 tx=0x7fd780009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:04:59.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.563+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd788059580 con 0x7fd7900b7580 2024-04-16T13:04:59.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.777+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7900d3fe0 con 0x7fd7900b7580 2024-04-16T13:04:59.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.779+0000 7fd786a00640 1 -- 172.21.15.67:0/3175205359 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fd788058e80 con 0x7fd7900b7580 2024-04-16T13:04:59.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:04:59.782 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:04:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 msgr2=0x7fd77006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 0x7fd77006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd780001630 tx=0x7fd780009040 comp rx=0 tx=0).stop 2024-04-16T13:04:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 msgr2=0x7fd7900b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:04:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd788000f80 tx=0x7fd78800cf00 comp rx=0 tx=0).stop 2024-04-16T13:04:59.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 shutdown_connections 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd77006c8f0 0x7fd77006edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7900b7580 0x7fd7900b7a00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7900b9ae0 0x7fd790160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 --2- 172.21.15.67:0/3175205359 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd774004800 0x7fd7900c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 >> 172.21.15.67:0/3175205359 conn(0x7fd79008c000 msgr2=0x7fd7900b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 shutdown_connections 2024-04-16T13:04:59.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:04:59.783+0000 7fd78fe00640 1 -- 172.21.15.67:0/3175205359 wait complete. 2024-04-16T13:04:59.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:04:59.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:00.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.029+0000 7fe080a00640 1 Processor -- start 2024-04-16T13:05:00.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.029+0000 7fe080a00640 1 -- start start 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe080a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe07c15d3f0 0x7fe07c1673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe080a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c1638f0 0x7fe07c0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe080a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe07c1641b0 con 0x7fe07c0d04b0 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe080a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe07c163ed0 con 0x7fe07c15d3f0 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe080a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c1668e0 con 0x7fe07c1638f0 2024-04-16T13:05:00.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe07a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe07c15d3f0 0x7fe07c1673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe079e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe07c0d04b0 0x7fe07c1631e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47922/0 (socket says 172.21.15.67:47922) 2024-04-16T13:05:00.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe079e00640 1 -- 172.21.15.67:0/2203607744 learned_addr learned my addr 172.21.15.67:0/2203607744 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:00.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.031+0000 7fe07b200640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c1638f0 0x7fe07c0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.032+0000 7fe07a800640 1 -- 172.21.15.67:0/2203607744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c1638f0 msgr2=0x7fe07c0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.032+0000 7fe07a800640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c1638f0 0x7fe07c0d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.032+0000 7fe079400640 1 -- 172.21.15.67:0/2203607744 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797398128 0 0) 0x7fe07c1641b0 con 0x7fe07c0d04b0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.032+0000 7fe07a800640 1 -- 172.21.15.67:0/2203607744 >> v1:172.21.15.67:6789/0 conn(0x7fe07c0d04b0 legacy=0x7fe07c1631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.032+0000 7fe07a800640 1 -- 172.21.15.67:0/2203607744 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c166bc0 con 0x7fe07c15d3f0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.034+0000 7fe07a800640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c15d3f0 0x7fe07c1673c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009d90 tx=0x7fe06c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7390ec1910b6c903 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.034+0000 7fe079400640 1 -- 172.21.15.67:0/2203607744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c039070 con 0x7fe07c15d3f0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.034+0000 7fe079400640 1 -- 172.21.15.67:0/2203607744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c02cc50 con 0x7fe07c15d3f0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.034+0000 7fe079400640 1 -- 172.21.15.67:0/2203607744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c034440 con 0x7fe07c15d3f0 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 -- 172.21.15.67:0/2203607744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c15d3f0 msgr2=0x7fe07c1673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c15d3f0 0x7fe07c1673c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009d90 tx=0x7fe06c02bea0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 -- 172.21.15.67:0/2203607744 shutdown_connections 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c1638f0 0x7fe07c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 --2- 172.21.15.67:0/2203607744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c15d3f0 0x7fe07c1673c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 -- 172.21.15.67:0/2203607744 >> 172.21.15.67:0/2203607744 conn(0x7fe07c06bc00 msgr2=0x7fe07c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 -- 172.21.15.67:0/2203607744 shutdown_connections 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.035+0000 7fe080a00640 1 -- 172.21.15.67:0/2203607744 wait complete. 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.037+0000 7fe080a00640 1 Processor -- start 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.037+0000 7fe080a00640 1 -- start start 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 0x7fe07c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c15d3f0 0x7fe07c09d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c0b43b0 con 0x7fe07c1638f0 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c0b4230 con 0x7fe07c0d04b0 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe080a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c0b4530 con 0x7fe07c15d3f0 2024-04-16T13:05:00.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe07b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe07b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53954/0 (socket says 172.21.15.67:53954) 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.038+0000 7fe07b200640 1 -- 172.21.15.67:0/2329873201 learned_addr learned my addr 172.21.15.67:0/2329873201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe079e00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c15d3f0 0x7fe07c09d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 -- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c15d3f0 msgr2=0x7fe07c09d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07a800640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 0x7fe07c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c15d3f0 0x7fe07c09d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 -- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 msgr2=0x7fe07c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 0x7fe07c152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 -- 172.21.15.67:0/2329873201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c09ddf0 con 0x7fe07c1638f0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07a800640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 0x7fe07c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe07b200640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e7f0 tx=0x7fe07400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074017070 con 0x7fe07c1638f0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07400ee40 con 0x7fe07c1638f0 2024-04-16T13:05:00.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07400cb80 con 0x7fe07c1638f0 2024-04-16T13:05:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.039+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c09e0d0 con 0x7fe07c1638f0 2024-04-16T13:05:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.040+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c06e1c0 con 0x7fe07c1638f0 2024-04-16T13:05:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.041+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c075bd0 con 0x7fe07c1638f0 2024-04-16T13:05:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.042+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe07401a070 con 0x7fe07c1638f0 2024-04-16T13:05:00.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.042+0000 7fe072a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.043+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe07408c0b0 con 0x7fe07c1638f0 2024-04-16T13:05:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.043+0000 7fe07a800640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.044+0000 7fe07a800640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 0x7fe05c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe06c036000 tx=0x7fe06c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.047+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe07405a100 con 0x7fe07c1638f0 2024-04-16T13:05:00.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.251+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe07c073d10 con 0x7fe07c1638f0 2024-04-16T13:05:00.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.251+0000 7fe072a00640 1 -- 172.21.15.67:0/2329873201 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe074059a00 con 0x7fe07c1638f0 2024-04-16T13:05:00.254 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 msgr2=0x7fe05c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 0x7fe05c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe06c036000 tx=0x7fe06c030000 comp rx=0 tx=0).stop 2024-04-16T13:05:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 msgr2=0x7fe07c165350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e7f0 tx=0x7fe07400ebf0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 shutdown_connections 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe05c06c8f0 0x7fe05c06edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe07c1638f0 0x7fe07c165350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe07c15d3f0 0x7fe07c09d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 --2- 172.21.15.67:0/2329873201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe07c0d04b0 0x7fe07c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 >> 172.21.15.67:0/2329873201 conn(0x7fe07c06bc00 msgr2=0x7fe07c1647d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 shutdown_connections 2024-04-16T13:05:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.254+0000 7fe080a00640 1 -- 172.21.15.67:0/2329873201 wait complete. 2024-04-16T13:05:00.276 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:00.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.491+0000 7fbd39a00640 1 Processor -- start 2024-04-16T13:05:00.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.492+0000 7fbd39a00640 1 -- start start 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.493+0000 7fbd39a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd340ce990 0x7fbd3406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd39a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3406dec0 con 0x7fbd34071de0 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd39a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3406e1a0 con 0x7fbd3415d4d0 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd39a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbd3406e7f0 con 0x7fbd340ce990 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd2be00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbd34071de0 0x7fbd3415cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47936/0 (socket says 172.21.15.67:47936) 2024-04-16T13:05:00.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd2be00640 1 -- 172.21.15.67:0/644733942 learned_addr learned my addr 172.21.15.67:0/644733942 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd33e00640 1 --2- 172.21.15.67:0/644733942 >> v2:172.21.15.82:3300/0 conn(0x7fbd340ce990 0x7fbd3406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982518376 0 0) 0x7fbd3406dec0 con 0x7fbd34071de0 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.494+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd18003520 con 0x7fbd34071de0 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3272204714 0 0) 0x7fbd18003520 con 0x7fbd34071de0 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 >> v2:172.21.15.82:3300/0 conn(0x7fbd340ce990 msgr2=0x7fbd3406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 --2- 172.21.15.67:0/644733942 >> v2:172.21.15.82:3300/0 conn(0x7fbd340ce990 0x7fbd3406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 >> v1:172.21.15.82:6789/0 conn(0x7fbd3415d4d0 legacy=0x7fbd3415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3406e480 con 0x7fbd34071de0 2024-04-16T13:05:00.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fbd1c001670 con 0x7fbd34071de0 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 >> v1:172.21.15.67:6789/0 conn(0x7fbd34071de0 legacy=0x7fbd3415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd18003a00 0x7fbd18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd18005210 0x7fbd1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3406e7f0 con 0x7fbd18004800 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1800c160 con 0x7fbd18005210 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1800c360 con 0x7fbd18003a00 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.495+0000 7fbd2be00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd33e00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd18003a00 0x7fbd18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd39000640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd18005210 0x7fbd1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd2be00640 1 -- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd18003a00 msgr2=0x7fbd18003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd2be00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd18003a00 0x7fbd18003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd2be00640 1 -- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd18005210 msgr2=0x7fbd1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:00.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd2be00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd18005210 0x7fbd1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd2be00640 1 -- 172.21.15.67:0/644733942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd18003520 con 0x7fbd18004800 2024-04-16T13:05:00.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.496+0000 7fbd39000640 1 -- 172.21.15.67:0/644733942 reap_dead start 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.497+0000 7fbd2be00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd18004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c007fd0 tx=0x7fbd18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d657bfd65c8ba3db server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.497+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c007c20 con 0x7fbd18004800 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.497+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c030070 con 0x7fbd18004800 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.497+0000 7fbd33400640 1 -- 172.21.15.67:0/644733942 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c005d70 con 0x7fbd18004800 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 -- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 msgr2=0x7fbd18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd18004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c007fd0 tx=0x7fbd18005830 comp rx=0 tx=0).stop 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 -- 172.21.15.67:0/644733942 shutdown_connections 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 --2- 172.21.15.67:0/644733942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd18004c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 -- 172.21.15.67:0/644733942 >> 172.21.15.67:0/644733942 conn(0x7fbd34067d90 msgr2=0x7fbd3406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 -- 172.21.15.67:0/644733942 shutdown_connections 2024-04-16T13:05:00.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.498+0000 7fbd39a00640 1 -- 172.21.15.67:0/644733942 wait complete. 2024-04-16T13:05:00.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.500+0000 7fbd39a00640 1 Processor -- start 2024-04-16T13:05:00.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.500+0000 7fbd39a00640 1 -- start start 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd340c6d90 0x7fbd34148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd34148ab0 0x7fbd34148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3406ec80 con 0x7fbd18004800 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3415db10 con 0x7fbd340c6d90 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd39a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3406ee00 con 0x7fbd34148ab0 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd33e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd33e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53960/0 (socket says 172.21.15.67:53960) 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.501+0000 7fbd33e00640 1 -- 172.21.15.67:0/3047130356 learned_addr learned my addr 172.21.15.67:0/3047130356 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd39000640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd34148ab0 0x7fbd34148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd2be00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd340c6d90 0x7fbd34148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 -- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd34148ab0 msgr2=0x7fbd34148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd34148ab0 0x7fbd34148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 -- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd340c6d90 msgr2=0x7fbd34148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd340c6d90 0x7fbd34148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 -- 172.21.15.67:0/3047130356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd341efad0 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd33e00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd24011510 tx=0x7fbd240119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24015870 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd24015a10 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24015dc0 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.502+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd340c7e70 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.503+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd340c78b0 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.504+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd34075bd0 con 0x7fbd18004800 2024-04-16T13:05:00.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.505+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd24013400 con 0x7fbd18004800 2024-04-16T13:05:00.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.506+0000 7fbd30c00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 0x7fbd1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.506+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd2408c710 con 0x7fbd18004800 2024-04-16T13:05:00.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.506+0000 7fbd2be00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 0x7fbd1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.507+0000 7fbd2be00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 0x7fbd1006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.510+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd24019030 con 0x7fbd18004800 2024-04-16T13:05:00.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.713+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbd3406bba0 con 0x7fbd18004800 2024-04-16T13:05:00.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.714+0000 7fbd30c00640 1 -- 172.21.15.67:0/3047130356 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fbd2405a1a0 con 0x7fbd18004800 2024-04-16T13:05:00.717 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 msgr2=0x7fbd1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 0x7fbd1006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c039040 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 msgr2=0x7fbd340c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd24011510 tx=0x7fbd240119d0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 shutdown_connections 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbd1006c920 0x7fbd1006ede0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbd34148ab0 0x7fbd34148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd340c6d90 0x7fbd34148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 --2- 172.21.15.67:0/3047130356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18004800 0x7fbd340c6850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.717+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 >> 172.21.15.67:0/3047130356 conn(0x7fbd34067d90 msgr2=0x7fbd3415bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.718+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 shutdown_connections 2024-04-16T13:05:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.718+0000 7fbd39a00640 1 -- 172.21.15.67:0/3047130356 wait complete. 2024-04-16T13:05:00.740 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.961+0000 7f199f000640 1 Processor -- start 2024-04-16T13:05:00.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.961+0000 7f199f000640 1 -- start start 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199f000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19981621b0 0x7f199809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199f000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19980ccd20 0x7f199809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1998162590 con 0x7f199809b610 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199f000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f19980d1090 con 0x7f19981621b0 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199f000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f19980d1370 con 0x7f19980ccd20 2024-04-16T13:05:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f1997e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19981621b0 0x7f199809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f1997e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19981621b0 0x7f199809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53970/0 (socket says 172.21.15.67:53970) 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f1997e00640 1 -- 172.21.15.67:0/1555052994 learned_addr learned my addr 172.21.15.67:0/1555052994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f1997400640 1 --1- 172.21.15.67:0/1555052994 >> v1:172.21.15.67:6789/0 conn(0x7f199809b610 0x7f199806daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:47940/0 (socket says 172.21.15.67:47940) 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.963+0000 7f199d000640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19980ccd20 0x7f199809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.964+0000 7f1997e00640 1 -- 172.21.15.67:0/1555052994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19980ccd20 msgr2=0x7f199809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:00.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.964+0000 7f1997e00640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19980ccd20 0x7f199809afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.964+0000 7f1997e00640 1 -- 172.21.15.67:0/1555052994 >> v1:172.21.15.67:6789/0 conn(0x7f199809b610 legacy=0x7f199806daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.964+0000 7f1997e00640 1 -- 172.21.15.67:0/1555052994 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980d1650 con 0x7f19981621b0 2024-04-16T13:05:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.964+0000 7f1996a00640 1 -- 172.21.15.67:0/1555052994 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240238194 0 0) 0x7f1980001110 con 0x7f199809b610 2024-04-16T13:05:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.965+0000 7f1997e00640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19981621b0 0x7f199809aa70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1988009870 tx=0x7f198802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239ff2ffa595a432 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.965+0000 7f1996a00640 1 -- 172.21.15.67:0/1555052994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198802f840 con 0x7f19981621b0 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.965+0000 7f1996a00640 1 -- 172.21.15.67:0/1555052994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198802f9e0 con 0x7f19981621b0 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.965+0000 7f1996a00640 1 -- 172.21.15.67:0/1555052994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198802fdb0 con 0x7f19981621b0 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 -- 172.21.15.67:0/1555052994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19981621b0 msgr2=0x7f199809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19981621b0 0x7f199809aa70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1988009870 tx=0x7f198802ba20 comp rx=0 tx=0).stop 2024-04-16T13:05:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 -- 172.21.15.67:0/1555052994 shutdown_connections 2024-04-16T13:05:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19980ccd20 0x7f199809afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 --2- 172.21.15.67:0/1555052994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19981621b0 0x7f199809aa70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 -- 172.21.15.67:0/1555052994 >> 172.21.15.67:0/1555052994 conn(0x7f19980b41c0 msgr2=0x7f19980b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 -- 172.21.15.67:0/1555052994 shutdown_connections 2024-04-16T13:05:00.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.966+0000 7f199f000640 1 -- 172.21.15.67:0/1555052994 wait complete. 2024-04-16T13:05:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.968+0000 7f199f000640 1 Processor -- start 2024-04-16T13:05:00.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.968+0000 7f199f000640 1 -- start start 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 0x7f1998149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19981621b0 0x7f19980c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19980d0e30 con 0x7f19980ccd20 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19980d0cb0 con 0x7f199809b610 2024-04-16T13:05:00.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199f000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f199806d1a0 con 0x7f19981621b0 2024-04-16T13:05:00.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f1997400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f1997400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53986/0 (socket says 172.21.15.67:53986) 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f1997400640 1 -- 172.21.15.67:0/1682971042 learned_addr learned my addr 172.21.15.67:0/1682971042 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f199d000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19981621b0 0x7f19980c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.969+0000 7f1997e00640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 0x7f1998149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 -- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19981621b0 msgr2=0x7f19980c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19981621b0 0x7f19980c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 -- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 msgr2=0x7f1998149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 0x7f1998149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 -- 172.21.15.67:0/1682971042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980b6d60 con 0x7f19980ccd20 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997e00640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 0x7f1998149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f1997400640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f198000c410 tx=0x7f198000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19800074e0 con 0x7f19980ccd20 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19800047e0 con 0x7f19980ccd20 2024-04-16T13:05:00.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980004bd0 con 0x7f19980ccd20 2024-04-16T13:05:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.970+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19980b7040 con 0x7f19980ccd20 2024-04-16T13:05:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.971+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19980b78e0 con 0x7f19980ccd20 2024-04-16T13:05:00.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.972+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1998068a70 con 0x7f19980ccd20 2024-04-16T13:05:00.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.973+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1980011070 con 0x7f19980ccd20 2024-04-16T13:05:00.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.974+0000 7f198fe00640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 0x7f197406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:00.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.974+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f198008ba90 con 0x7f19980ccd20 2024-04-16T13:05:00.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.974+0000 7f1997e00640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 0x7f197406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:00.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.975+0000 7f1997e00640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 0x7f197406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1988036000 tx=0x7f1988008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:00.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:00.978+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1998162590 con 0x7f19980ccd20 2024-04-16T13:05:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.188+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f19980b7ab0 con 0x7f19980ccd20 2024-04-16T13:05:01.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.191+0000 7f198fe00640 1 -- 172.21.15.67:0/1682971042 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f1980059b20 con 0x7f19980ccd20 2024-04-16T13:05:01.193 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 msgr2=0x7f197406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 0x7f197406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1988036000 tx=0x7f1988008030 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 msgr2=0x7f19980b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f198000c410 tx=0x7f198000c8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 shutdown_connections 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f197406c8f0 0x7f197406edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19981621b0 0x7f19980c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19980ccd20 0x7f19980b62c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 --2- 172.21.15.67:0/1682971042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f199809b610 0x7f1998149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.194+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 >> 172.21.15.67:0/1682971042 conn(0x7f19980b41c0 msgr2=0x7f19980d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.195+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 shutdown_connections 2024-04-16T13:05:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.195+0000 7f199f000640 1 -- 172.21.15.67:0/1682971042 wait complete. 2024-04-16T13:05:01.214 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:01.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.412+0000 7fd903600640 1 Processor -- start 2024-04-16T13:05:01.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.412+0000 7fd903600640 1 -- start start 2024-04-16T13:05:01.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd903600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8fc15c860 0x7fd8fc0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd903600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8fc0b3700 0x7fd8fc0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd903600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8fc0cce80 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd903600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc0b4070 con 0x7fd8fc15c860 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd903600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc0c7710 con 0x7fd8fc0b3700 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd900c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8fc15c860 0x7fd8fc0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd900c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8fc15c860 0x7fd8fc0c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53998/0 (socket says 172.21.15.67:53998) 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.414+0000 7fd900c00640 1 -- 172.21.15.67:0/940986219 learned_addr learned my addr 172.21.15.67:0/940986219 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.415+0000 7fd901600640 1 --2- 172.21.15.67:0/940986219 >> v2:172.21.15.82:3300/0 conn(0x7fd8fc0b3700 0x7fd8fc0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.415+0000 7fd900c00640 1 -- 172.21.15.67:0/940986219 >> v2:172.21.15.82:3300/0 conn(0x7fd8fc0b3700 msgr2=0x7fd8fc0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:01.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.415+0000 7fd900c00640 1 --2- 172.21.15.67:0/940986219 >> v2:172.21.15.82:3300/0 conn(0x7fd8fc0b3700 0x7fd8fc0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.415+0000 7fd900c00640 1 -- 172.21.15.67:0/940986219 >> v1:172.21.15.82:6789/0 conn(0x7fd8fc0cc9f0 legacy=0x7fd8fc160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:01.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.415+0000 7fd900c00640 1 -- 172.21.15.67:0/940986219 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc0c6e70 con 0x7fd8fc15c860 2024-04-16T13:05:01.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.416+0000 7fd900c00640 1 --2- 172.21.15.67:0/940986219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc15c860 0x7fd8fc0c6890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d0440 tx=0x7fd8ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f359f17c5e964f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.417+0000 7fd8fbe00640 1 -- 172.21.15.67:0/940986219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec035020 con 0x7fd8fc15c860 2024-04-16T13:05:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.417+0000 7fd8fbe00640 1 -- 172.21.15.67:0/940986219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec031870 con 0x7fd8fc15c860 2024-04-16T13:05:01.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.417+0000 7fd8fbe00640 1 -- 172.21.15.67:0/940986219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec031c40 con 0x7fd8fc15c860 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.417+0000 7fd903600640 1 -- 172.21.15.67:0/940986219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc15c860 msgr2=0x7fd8fc0c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.417+0000 7fd903600640 1 --2- 172.21.15.67:0/940986219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc15c860 0x7fd8fc0c6890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0d0440 tx=0x7fd8ec02b910 comp rx=0 tx=0).stop 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 -- 172.21.15.67:0/940986219 shutdown_connections 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 --2- 172.21.15.67:0/940986219 >> v2:172.21.15.82:3300/0 conn(0x7fd8fc0b3700 0x7fd8fc0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 --2- 172.21.15.67:0/940986219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc15c860 0x7fd8fc0c6890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 -- 172.21.15.67:0/940986219 >> 172.21.15.67:0/940986219 conn(0x7fd8fc067d90 msgr2=0x7fd8fc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 -- 172.21.15.67:0/940986219 shutdown_connections 2024-04-16T13:05:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.418+0000 7fd903600640 1 -- 172.21.15.67:0/940986219 wait complete. 2024-04-16T13:05:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.419+0000 7fd903600640 1 Processor -- start 2024-04-16T13:05:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.420+0000 7fd903600640 1 -- start start 2024-04-16T13:05:01.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b3700 0x7fd8fc15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8fc15c860 0x7fd8fc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc1605c0 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc0c7430 con 0x7fd8fc0b3700 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd903600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc15cc40 con 0x7fd8fc15c860 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54000/0 (socket says 172.21.15.67:54000) 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 -- 172.21.15.67:0/3982511153 learned_addr learned my addr 172.21.15.67:0/3982511153 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd900c00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b3700 0x7fd8fc15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd901600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8fc15c860 0x7fd8fc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 -- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8fc15c860 msgr2=0x7fd8fc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8fc15c860 0x7fd8fc156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 -- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b3700 msgr2=0x7fd8fc15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b3700 0x7fd8fc15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.421+0000 7fd8f3e00640 1 -- 172.21.15.67:0/3982511153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc159690 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd8f3e00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c460 tx=0x7fd8e400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4016020 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e4012870 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4012c60 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc159970 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.422+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc159f30 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.423+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc068a70 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.424+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8e4019020 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.425+0000 7fd8f9600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 0x7fd8d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.425+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd8e408bae0 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.426+0000 7fd900c00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 0x7fd8d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.427+0000 7fd900c00640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 0x7fd8d806ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec036000 tx=0x7fd8ec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.430+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd8e4020030 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.630+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd8fc0c66a0 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.631+0000 7fd8f9600640 1 -- 172.21.15.67:0/3982511153 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fd8e4019310 con 0x7fd8fc0cc9f0 2024-04-16T13:05:01.634 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:01.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 msgr2=0x7fd8d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 0x7fd8d806ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec036000 tx=0x7fd8ec008030 comp rx=0 tx=0).stop 2024-04-16T13:05:01.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 msgr2=0x7fd8fc158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c460 tx=0x7fd8e400c920 comp rx=0 tx=0).stop 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 shutdown_connections 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8d806c940 0x7fd8d806ee00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8fc15c860 0x7fd8fc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8fc0cc9f0 0x7fd8fc158e40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 --2- 172.21.15.67:0/3982511153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b3700 0x7fd8fc15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 >> 172.21.15.67:0/3982511153 conn(0x7fd8fc067d90 msgr2=0x7fd8fc0c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 shutdown_connections 2024-04-16T13:05:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.634+0000 7fd903600640 1 -- 172.21.15.67:0/3982511153 wait complete. 2024-04-16T13:05:01.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:05:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.866+0000 7f714be00640 1 Processor -- start 2024-04-16T13:05:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.866+0000 7f714be00640 1 -- start start 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.867+0000 7f714be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f714c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.867+0000 7f714be00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c06dec0 con 0x7f714c0724f0 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f714be00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c06e1a0 con 0x7f714c0ce990 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f714be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f714c06e7f0 con 0x7f714c15d4d0 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f714a000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f714c0724f0 0x7f714c15cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34136/0 (socket says 172.21.15.67:34136) 2024-04-16T13:05:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f714a000640 1 -- 172.21.15.67:0/2960301758 learned_addr learned my addr 172.21.15.67:0/2960301758 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f714b400640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f714c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856229512 0 0) 0x7f714c06dec0 con 0x7f714c0724f0 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.868+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7130003520 con 0x7f714c0724f0 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2196643179 0 0) 0x7f7130003520 con 0x7f714c0724f0 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 msgr2=0x7f714c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f714c06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 >> v1:172.21.15.82:6789/0 conn(0x7f714c0ce990 legacy=0x7f714c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c06e480 con 0x7f714c0724f0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f7138001670 con 0x7f714c0724f0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 >> v1:172.21.15.67:6789/0 conn(0x7f714c0724f0 legacy=0x7f714c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f7130003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f7130004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7130004d40 0x7f71300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f714c06e7f0 con 0x7f71300039e0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f713000bb50 con 0x7f7130004d40 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f713000bd50 con 0x7f714c15d4d0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f714aa00640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f7130003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f714a000640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f7130004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f714aa00640 1 -- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 msgr2=0x7f7130004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f714aa00640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c15d4d0 0x7f7130004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.869+0000 7f714b400640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7130004d40 0x7f71300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.870+0000 7f714aa00640 1 -- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7130004d40 msgr2=0x7f71300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:01.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.870+0000 7f714aa00640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7130004d40 0x7f71300051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.870+0000 7f714aa00640 1 -- 172.21.15.67:0/2960301758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7130003520 con 0x7f71300039e0 2024-04-16T13:05:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f714aa00640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f7130003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f713c001750 tx=0x7f7130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4f516bfb9b3eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c001370 con 0x7f71300039e0 2024-04-16T13:05:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c0052d0 con 0x7f71300039e0 2024-04-16T13:05:01.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f7149600640 1 -- 172.21.15.67:0/2960301758 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c003830 con 0x7f71300039e0 2024-04-16T13:05:01.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f714be00640 1 -- 172.21.15.67:0/2960301758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 msgr2=0x7f7130003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f714be00640 1 --2- 172.21.15.67:0/2960301758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f7130003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f713c001750 tx=0x7f7130005830 comp rx=0 tx=0).stop 2024-04-16T13:05:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f714b400640 1 -- 172.21.15.67:0/2960301758 reap_dead start 2024-04-16T13:05:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.871+0000 7f714be00640 1 -- 172.21.15.67:0/2960301758 shutdown_connections 2024-04-16T13:05:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.872+0000 7f714be00640 1 -- 172.21.15.67:0/2960301758 >> 172.21.15.67:0/2960301758 conn(0x7f714c067d90 msgr2=0x7f714c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.872+0000 7f714be00640 1 -- 172.21.15.67:0/2960301758 shutdown_connections 2024-04-16T13:05:01.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.872+0000 7f714be00640 1 -- 172.21.15.67:0/2960301758 wait complete. 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.873+0000 7f714be00640 1 Processor -- start 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.873+0000 7f714be00640 1 -- start start 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714c1e4d30 0x7f714c1e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c155c10 0x7f714c1e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f714c06ec80 con 0x7f71300039e0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f714c15db10 con 0x7f714c1e4d30 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.874+0000 7f714be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f714c06ee00 con 0x7f714c155c10 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54136/0 (socket says 172.21.15.67:54136) 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 -- 172.21.15.67:0/3346698932 learned_addr learned my addr 172.21.15.67:0/3346698932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714a000640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714c1e4d30 0x7f714c1e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 -- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c155c10 msgr2=0x7f714c1e7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714b400640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c155c10 0x7f714c1e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c155c10 0x7f714c1e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 -- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714c1e4d30 msgr2=0x7f714c1e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714c1e4d30 0x7f714c1e6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 -- 172.21.15.67:0/3346698932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c1e5280 con 0x7f71300039e0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.875+0000 7f714aa00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f713c005040 tx=0x7f713c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.876+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c041070 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.876+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c000ed0 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.876+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c007a30 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.876+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c1e5560 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.876+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c1e5b20 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.877+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c075bd0 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.878+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f713c044070 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.879+0000 7f7142a00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 0x7f712c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.879+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f713c0ad900 con 0x7f71300039e0 2024-04-16T13:05:01.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.880+0000 7f714a000640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 0x7f712c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:01.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.881+0000 7f714a000640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 0x7f712c06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f714c1e64b0 tx=0x7f7138009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:01.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:01.883+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f713c07b950 con 0x7f71300039e0 2024-04-16T13:05:02.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.096+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f714c06f610 con 0x7f71300039e0 2024-04-16T13:05:02.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.097+0000 7f7142a00640 1 -- 172.21.15.67:0/3346698932 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f713c07b250 con 0x7f71300039e0 2024-04-16T13:05:02.099 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 msgr2=0x7f712c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 0x7f712c06edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f714c1e64b0 tx=0x7f7138009040 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 msgr2=0x7f714c153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f713c005040 tx=0x7f713c001120 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 shutdown_connections 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f712c06c8f0 0x7f712c06edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f714c155c10 0x7f714c1e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714c1e4d30 0x7f714c1e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 --2- 172.21.15.67:0/3346698932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71300039e0 0x7f714c153e80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 >> 172.21.15.67:0/3346698932 conn(0x7f714c067d90 msgr2=0x7f714c15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.099+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 shutdown_connections 2024-04-16T13:05:02.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.100+0000 7f714be00640 1 -- 172.21.15.67:0/3346698932 wait complete. 2024-04-16T13:05:02.121 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:02.121 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:02.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:02.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.379+0000 7fba49000640 1 Processor -- start 2024-04-16T13:05:02.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.380+0000 7fba49000640 1 -- start start 2024-04-16T13:05:02.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.381+0000 7fba49000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba4415c420 0x7fba441601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.381+0000 7fba49000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba440c6930 0x7fba440cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.381+0000 7fba49000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba44161110 con 0x7fba4415c800 2024-04-16T13:05:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.381+0000 7fba49000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fba44160870 con 0x7fba440c6930 2024-04-16T13:05:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.381+0000 7fba49000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fba44160b50 con 0x7fba4415c420 2024-04-16T13:05:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba440c6930 0x7fba440cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fba440c6930 0x7fba440cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54146/0 (socket says 172.21.15.67:54146) 2024-04-16T13:05:02.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 -- 172.21.15.67:0/3270996359 learned_addr learned my addr 172.21.15.67:0/3270996359 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43400640 1 --2- 172.21.15.67:0/3270996359 >> v2:172.21.15.82:3300/0 conn(0x7fba4415c420 0x7fba441601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 -- 172.21.15.67:0/3270996359 >> v2:172.21.15.82:3300/0 conn(0x7fba4415c420 msgr2=0x7fba441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 --2- 172.21.15.67:0/3270996359 >> v2:172.21.15.82:3300/0 conn(0x7fba4415c420 0x7fba441601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 -- 172.21.15.67:0/3270996359 >> v1:172.21.15.82:6789/0 conn(0x7fba4415c800 legacy=0x7fba440c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.382+0000 7fba43e00640 1 -- 172.21.15.67:0/3270996359 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba44160e30 con 0x7fba440c6930 2024-04-16T13:05:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.384+0000 7fba43e00640 1 --2- 172.21.15.67:0/3270996359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba440c6930 0x7fba440cbf70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba440cd9a0 tx=0x7fba3c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5333db0f996e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.384+0000 7fba42a00640 1 -- 172.21.15.67:0/3270996359 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c02c9f0 con 0x7fba440c6930 2024-04-16T13:05:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.384+0000 7fba42a00640 1 -- 172.21.15.67:0/3270996359 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c02cb90 con 0x7fba440c6930 2024-04-16T13:05:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.384+0000 7fba42a00640 1 -- 172.21.15.67:0/3270996359 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0343f0 con 0x7fba440c6930 2024-04-16T13:05:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 -- 172.21.15.67:0/3270996359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba440c6930 msgr2=0x7fba440cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 --2- 172.21.15.67:0/3270996359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba440c6930 0x7fba440cbf70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba440cd9a0 tx=0x7fba3c02be50 comp rx=0 tx=0).stop 2024-04-16T13:05:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 -- 172.21.15.67:0/3270996359 shutdown_connections 2024-04-16T13:05:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 --2- 172.21.15.67:0/3270996359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba440c6930 0x7fba440cbf70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 --2- 172.21.15.67:0/3270996359 >> v2:172.21.15.82:3300/0 conn(0x7fba4415c420 0x7fba441601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 -- 172.21.15.67:0/3270996359 >> 172.21.15.67:0/3270996359 conn(0x7fba440b2070 msgr2=0x7fba440b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:02.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 -- 172.21.15.67:0/3270996359 shutdown_connections 2024-04-16T13:05:02.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.385+0000 7fba49000640 1 -- 172.21.15.67:0/3270996359 wait complete. 2024-04-16T13:05:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.387+0000 7fba49000640 1 Processor -- start 2024-04-16T13:05:02.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.387+0000 7fba49000640 1 -- start start 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba440c6930 0x7fba440ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba4415c420 0x7fba4414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fba440c5280 con 0x7fba4415c800 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba440c5100 con 0x7fba440c6930 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba49000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fba440c5400 con 0x7fba4415c420 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba43e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba43e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54150/0 (socket says 172.21.15.67:54150) 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba43e00640 1 -- 172.21.15.67:0/2544601376 learned_addr learned my addr 172.21.15.67:0/2544601376 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.388+0000 7fba3be00640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba4415c420 0x7fba4414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43400640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba440c6930 0x7fba440ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 -- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba4415c420 msgr2=0x7fba4414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba4415c420 0x7fba4414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 -- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba440c6930 msgr2=0x7fba440ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba440c6930 0x7fba440ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 -- 172.21.15.67:0/2544601376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440ad6b0 con 0x7fba4415c800 2024-04-16T13:05:02.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.389+0000 7fba43e00640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009f40 tx=0x7fba3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.390+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c043020 con 0x7fba4415c800 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.390+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c03e450 con 0x7fba4415c800 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.390+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c009510 con 0x7fba4415c800 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.390+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba440ad930 con 0x7fba4415c800 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.390+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba440adef0 con 0x7fba4415c800 2024-04-16T13:05:02.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.391+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba440ae0f0 con 0x7fba4415c800 2024-04-16T13:05:02.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.392+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba3c046020 con 0x7fba4415c800 2024-04-16T13:05:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.393+0000 7fba3b400640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 0x7fba2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.393+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba3c0ae780 con 0x7fba4415c800 2024-04-16T13:05:02.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.394+0000 7fba43400640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 0x7fba2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.395+0000 7fba43400640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 0x7fba2006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba34006fd0 tx=0x7fba34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.397+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba440ae0f0 con 0x7fba4415c800 2024-04-16T13:05:02.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.611+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba440b3dc0 con 0x7fba4415c800 2024-04-16T13:05:02.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.614+0000 7fba3b400640 1 -- 172.21.15.67:0/2544601376 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fba3c04d030 con 0x7fba4415c800 2024-04-16T13:05:02.617 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:02.617 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:02.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 msgr2=0x7fba2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 0x7fba2006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fba34006fd0 tx=0x7fba34008040 comp rx=0 tx=0).stop 2024-04-16T13:05:02.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 msgr2=0x7fba4415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009f40 tx=0x7fba3c004a40 comp rx=0 tx=0).stop 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 shutdown_connections 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fba2006c8f0 0x7fba2006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fba4415c800 0x7fba4415d570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fba4415c420 0x7fba4414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 --2- 172.21.15.67:0/2544601376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba440c6930 0x7fba440ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 >> 172.21.15.67:0/2544601376 conn(0x7fba440b2070 msgr2=0x7fba440b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 shutdown_connections 2024-04-16T13:05:02.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.617+0000 7fba49000640 1 -- 172.21.15.67:0/2544601376 wait complete. 2024-04-16T13:05:02.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:02.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:02.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.867+0000 7ff0ddc00640 1 Processor -- start 2024-04-16T13:05:02.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.867+0000 7ff0ddc00640 1 -- start start 2024-04-16T13:05:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.869+0000 7ff0ddc00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0d815e760 0x7ff0d806e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.869+0000 7ff0ddc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.869+0000 7ff0ddc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d80b5320 con 0x7ff0d8072230 2024-04-16T13:05:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.869+0000 7ff0ddc00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d80b3300 con 0x7ff0d815e760 2024-04-16T13:05:02.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.869+0000 7ff0ddc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d80b3e80 con 0x7ff0d81479f0 2024-04-16T13:05:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.870+0000 7ff0d7e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0d815e760 0x7ff0d806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.870+0000 7ff0d7e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0d815e760 0x7ff0d806e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:38980/0 (socket says 172.21.15.67:38980) 2024-04-16T13:05:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.870+0000 7ff0d7e00640 1 -- 172.21.15.67:0/3590567647 learned_addr learned my addr 172.21.15.67:0/3590567647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.870+0000 7ff0dd200640 1 --1- 172.21.15.67:0/3590567647 >> v1:172.21.15.82:6789/0 conn(0x7ff0d8072230 0x7ff0d81622c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:46578/0 (socket says 172.21.15.67:46578) 2024-04-16T13:05:02.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.870+0000 7ff0cf400640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7400640 1 -- 172.21.15.67:0/3590567647 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919685918 0 0) 0x7ff0d80b5320 con 0x7ff0d8072230 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7400640 1 -- 172.21.15.67:0/3590567647 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0bc003520 con 0x7ff0d8072230 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7e00640 1 -- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 msgr2=0x7ff0d8071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7e00640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7e00640 1 -- 172.21.15.67:0/3590567647 >> v1:172.21.15.82:6789/0 conn(0x7ff0d8072230 legacy=0x7ff0d81622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.871+0000 7ff0d7e00640 1 -- 172.21.15.67:0/3590567647 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d815eb40 con 0x7ff0d815e760 2024-04-16T13:05:02.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.873+0000 7ff0d7e00640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815e760 0x7ff0d806e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009870 tx=0x7ff0c802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29d9079a27ca39d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.873+0000 7ff0d7400640 1 -- 172.21.15.67:0/3590567647 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8035020 con 0x7ff0d815e760 2024-04-16T13:05:02.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.873+0000 7ff0d7400640 1 -- 172.21.15.67:0/3590567647 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8031640 con 0x7ff0d815e760 2024-04-16T13:05:02.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.873+0000 7ff0d7400640 1 -- 172.21.15.67:0/3590567647 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c802d040 con 0x7ff0d815e760 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815e760 msgr2=0x7ff0d806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815e760 0x7ff0d806e760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009870 tx=0x7ff0c802b8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3590567647 shutdown_connections 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3590567647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d815e760 0x7ff0d806e760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3590567647 >> 172.21.15.67:0/3590567647 conn(0x7ff0d80b21e0 msgr2=0x7ff0d80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3590567647 shutdown_connections 2024-04-16T13:05:02.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.874+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3590567647 wait complete. 2024-04-16T13:05:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.876+0000 7ff0ddc00640 1 Processor -- start 2024-04-16T13:05:02.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.876+0000 7ff0ddc00640 1 -- start start 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d8072230 0x7ff0d80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d80b3830 con 0x7ff0d815e760 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8148290 con 0x7ff0d8072230 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0ddc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d80b3b10 con 0x7ff0d81479f0 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.877+0000 7ff0dd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54166/0 (socket says 172.21.15.67:54166) 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 -- 172.21.15.67:0/3714405306 learned_addr learned my addr 172.21.15.67:0/3714405306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0d7e00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d8072230 0x7ff0d80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0cf400640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 -- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 msgr2=0x7ff0d8158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 -- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d8072230 msgr2=0x7ff0d80b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d8072230 0x7ff0d80b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 -- 172.21.15.67:0/3714405306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d81f6240 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.878+0000 7ff0dd200640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0001460 tx=0x7ff0d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.879+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0018070 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.879+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004d60 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.879+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000a860 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.879+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d81f6520 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.879+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d81f6ae0 con 0x7ff0d815e760 2024-04-16T13:05:02.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.880+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d80afce0 con 0x7ff0d815e760 2024-04-16T13:05:02.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.881+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0d000aa00 con 0x7ff0d815e760 2024-04-16T13:05:02.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.883+0000 7ff0d4c00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 0x7ff0b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:02.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.883+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff0d008b300 con 0x7ff0d815e760 2024-04-16T13:05:02.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.883+0000 7ff0d7e00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 0x7ff0b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:02.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.884+0000 7ff0d7e00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 0x7ff0b406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8036000 tx=0x7ff0c803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:02.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:02.887+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0d80afce0 con 0x7ff0d815e760 2024-04-16T13:05:03.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.091+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff0d8075bd0 con 0x7ff0d815e760 2024-04-16T13:05:03.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.092+0000 7ff0d4c00640 1 -- 172.21.15.67:0/3714405306 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff0d0058d90 con 0x7ff0d815e760 2024-04-16T13:05:03.094 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.094+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 msgr2=0x7ff0b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.094+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 0x7ff0b406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8036000 tx=0x7ff0c803c040 comp rx=0 tx=0).stop 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.094+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 msgr2=0x7ff0d8158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.094+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0001460 tx=0x7ff0d000cb90 comp rx=0 tx=0).stop 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 shutdown_connections 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff0b406c8f0 0x7ff0b406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff0d815e760 0x7ff0d8158850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff0d81479f0 0x7ff0d8158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 --2- 172.21.15.67:0/3714405306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0d8072230 0x7ff0d80b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 >> 172.21.15.67:0/3714405306 conn(0x7ff0d80b21e0 msgr2=0x7ff0d8145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:03.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 shutdown_connections 2024-04-16T13:05:03.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.095+0000 7ff0ddc00640 1 -- 172.21.15.67:0/3714405306 wait complete. 2024-04-16T13:05:03.118 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.345+0000 7fe8abe00640 1 Processor -- start 2024-04-16T13:05:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.345+0000 7fe8abe00640 1 -- start start 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.346+0000 7fe8abe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8ac15e7e0 0x7fe8ac0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.346+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac0d22c0 0x7fe8ac0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.346+0000 7fe8abe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac0d2b10 con 0x7fe8ac0d1620 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.346+0000 7fe8abe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ac0d1a80 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.346+0000 7fe8abe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac0d2df0 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aaa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8ac15e7e0 0x7fe8ac0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8ab400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe8ac0d1620 0x7fe8ac0d4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34146/0 (socket says 172.21.15.67:34146) 2024-04-16T13:05:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8ab400640 1 -- 172.21.15.67:0/2434680092 learned_addr learned my addr 172.21.15.67:0/2434680092 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aa000640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac0d22c0 0x7fe8ac0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aaa00640 1 -- 172.21.15.67:0/2434680092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac0d22c0 msgr2=0x7fe8ac0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aaa00640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac0d22c0 0x7fe8ac0d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aaa00640 1 -- 172.21.15.67:0/2434680092 >> v1:172.21.15.67:6789/0 conn(0x7fe8ac0d1620 legacy=0x7fe8ac0d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8aaa00640 1 -- 172.21.15.67:0/2434680092 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0d30d0 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.347+0000 7fe8a9600640 1 -- 172.21.15.67:0/2434680092 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691504524 0 0) 0x7fe8ac0d2b10 con 0x7fe8ac0d1620 2024-04-16T13:05:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.348+0000 7fe8aaa00640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac15e7e0 0x7fe8ac0d0240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009de0 tx=0x7fe89c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1625c72fbc044f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8a9600640 1 -- 172.21.15.67:0/2434680092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c039070 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8a9600640 1 -- 172.21.15.67:0/2434680092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c02cc90 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8a9600640 1 -- 172.21.15.67:0/2434680092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c034660 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 -- 172.21.15.67:0/2434680092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac15e7e0 msgr2=0x7fe8ac0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac15e7e0 0x7fe8ac0d0240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009de0 tx=0x7fe89c02bee0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 -- 172.21.15.67:0/2434680092 shutdown_connections 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac0d22c0 0x7fe8ac0d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2434680092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac15e7e0 0x7fe8ac0d0240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 -- 172.21.15.67:0/2434680092 >> 172.21.15.67:0/2434680092 conn(0x7fe8ac09da60 msgr2=0x7fe8ac08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.349+0000 7fe8abe00640 1 -- 172.21.15.67:0/2434680092 shutdown_connections 2024-04-16T13:05:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.350+0000 7fe8abe00640 1 -- 172.21.15.67:0/2434680092 wait complete. 2024-04-16T13:05:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.351+0000 7fe8abe00640 1 Processor -- start 2024-04-16T13:05:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.351+0000 7fe8abe00640 1 -- start start 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8ac0d1620 0x7fe8ac148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 0x7fe8ac14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0d2720 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0d3690 con 0x7fe8ac0d1620 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.352+0000 7fe8abe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac0d28a0 con 0x7fe8ac15e7e0 2024-04-16T13:05:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54178/0 (socket says 172.21.15.67:54178) 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 -- 172.21.15.67:0/2197763347 learned_addr learned my addr 172.21.15.67:0/2197763347 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aaa00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8ac0d1620 0x7fe8ac148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8ab400640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 0x7fe8ac14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 -- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 msgr2=0x7fe8ac14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 0x7fe8ac14e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 -- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8ac0d1620 msgr2=0x7fe8ac148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8ac0d1620 0x7fe8ac148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8aa000640 1 -- 172.21.15.67:0/2197763347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0ca910 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.353+0000 7fe8ab400640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 0x7fe8ac14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8aa000640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe89800d800 tx=0x7fe89800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800b6c0 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe898019070 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800ba80 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac0cabf0 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.354+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac161a70 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.355+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac075bd0 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.356+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe89800bc20 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.357+0000 7fe8a3400640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 0x7fe88c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.357+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe89808c3e0 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.358+0000 7fe8aaa00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 0x7fe88c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.359+0000 7fe8aaa00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 0x7fe88c06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe89c036000 tx=0x7fe89c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.361+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe89805a430 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.569+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe8ac148d90 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.570+0000 7fe8a3400640 1 -- 172.21.15.67:0/2197763347 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fe898059d30 con 0x7fe8ac0d22c0 2024-04-16T13:05:03.572 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 msgr2=0x7fe88c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 0x7fe88c06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe89c036000 tx=0x7fe89c030000 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 msgr2=0x7fe8ac14dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe89800d800 tx=0x7fe89800dcc0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 shutdown_connections 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe88c06c920 0x7fe88c06ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe8ac15e7e0 0x7fe8ac14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8ac0d22c0 0x7fe8ac14dd60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 --2- 172.21.15.67:0/2197763347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8ac0d1620 0x7fe8ac148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.572+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 >> 172.21.15.67:0/2197763347 conn(0x7fe8ac09da60 msgr2=0x7fe8ac0b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:03.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.573+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 shutdown_connections 2024-04-16T13:05:03.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.573+0000 7fe8abe00640 1 -- 172.21.15.67:0/2197763347 wait complete. 2024-04-16T13:05:03.594 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:03.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.817+0000 7fd842c00640 1 Processor -- start 2024-04-16T13:05:03.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.818+0000 7fd842c00640 1 -- start start 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd83c072050 0x7fd83c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd83c06f9d0 0x7fd83c06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c1641f0 con 0x7fd83c06f040 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd83c0b3970 con 0x7fd83c072050 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd83c1635e0 con 0x7fd83c06f9d0 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd841800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd83c072050 0x7fd83c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd840e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd83c06f040 0x7fd83c06e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34162/0 (socket says 172.21.15.67:34162) 2024-04-16T13:05:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd840e00640 1 -- 172.21.15.67:0/3208149816 learned_addr learned my addr 172.21.15.67:0/3208149816 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.820+0000 7fd842200640 1 --2- 172.21.15.67:0/3208149816 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06f9d0 0x7fd83c06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.821+0000 7fd841800640 1 -- 172.21.15.67:0/3208149816 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06f9d0 msgr2=0x7fd83c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.821+0000 7fd841800640 1 --2- 172.21.15.67:0/3208149816 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06f9d0 0x7fd83c06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.821+0000 7fd841800640 1 -- 172.21.15.67:0/3208149816 >> v1:172.21.15.67:6789/0 conn(0x7fd83c06f040 legacy=0x7fd83c06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.821+0000 7fd841800640 1 -- 172.21.15.67:0/3208149816 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c06ed50 con 0x7fd83c072050 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.822+0000 7fd841800640 1 --2- 172.21.15.67:0/3208149816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c0b3430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd8300097a0 tx=0x7fd83002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965dbaf26dc48761 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.822+0000 7fd83be00640 1 -- 172.21.15.67:0/3208149816 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830035020 con 0x7fd83c072050 2024-04-16T13:05:03.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.822+0000 7fd83be00640 1 -- 172.21.15.67:0/3208149816 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd830031830 con 0x7fd83c072050 2024-04-16T13:05:03.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.822+0000 7fd83be00640 1 -- 172.21.15.67:0/3208149816 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830031c00 con 0x7fd83c072050 2024-04-16T13:05:03.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 -- 172.21.15.67:0/3208149816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 msgr2=0x7fd83c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 --2- 172.21.15.67:0/3208149816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c0b3430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd8300097a0 tx=0x7fd83002b8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 -- 172.21.15.67:0/3208149816 shutdown_connections 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 --2- 172.21.15.67:0/3208149816 >> v2:172.21.15.82:3300/0 conn(0x7fd83c06f9d0 0x7fd83c06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 --2- 172.21.15.67:0/3208149816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c0b3430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 -- 172.21.15.67:0/3208149816 >> 172.21.15.67:0/3208149816 conn(0x7fd83c067d90 msgr2=0x7fd83c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 -- 172.21.15.67:0/3208149816 shutdown_connections 2024-04-16T13:05:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.823+0000 7fd842c00640 1 -- 172.21.15.67:0/3208149816 wait complete. 2024-04-16T13:05:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.825+0000 7fd842c00640 1 Processor -- start 2024-04-16T13:05:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.825+0000 7fd842c00640 1 -- start start 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 0x7fd83c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 0x7fd83c146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c163e80 con 0x7fd83c072050 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c163ba0 con 0x7fd83c06f040 2024-04-16T13:05:03.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd83c072430 con 0x7fd83c06f9d0 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54188/0 (socket says 172.21.15.67:54188) 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.826+0000 7fd842200640 1 -- 172.21.15.67:0/2317949428 learned_addr learned my addr 172.21.15.67:0/2317949428 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd841800640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 0x7fd83c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd840e00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 0x7fd83c146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 -- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 msgr2=0x7fd83c146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 0x7fd83c146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 -- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 msgr2=0x7fd83c14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 0x7fd83c14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 -- 172.21.15.67:0/2317949428 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c15be60 con 0x7fd83c072050 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd841800640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 0x7fd83c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:03.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd840e00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 0x7fd83c146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd842200640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd834007e40 tx=0x7fd83400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.827+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834014620 con 0x7fd83c072050 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.828+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd834019070 con 0x7fd83c072050 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.828+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834014a20 con 0x7fd83c072050 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.828+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c15e450 con 0x7fd83c072050 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.828+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c15c100 con 0x7fd83c072050 2024-04-16T13:05:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.829+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c167760 con 0x7fd83c072050 2024-04-16T13:05:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.830+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd834014bc0 con 0x7fd83c072050 2024-04-16T13:05:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.831+0000 7fd839600640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 0x7fd81c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.831+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd83408c840 con 0x7fd83c072050 2024-04-16T13:05:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.831+0000 7fd841800640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 0x7fd81c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.832+0000 7fd841800640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 0x7fd81c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd830036000 tx=0x7fd830008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:03.835+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd83c167760 con 0x7fd83c072050 2024-04-16T13:05:04.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.042+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd83c075bd0 con 0x7fd83c072050 2024-04-16T13:05:04.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.042+0000 7fd839600640 1 -- 172.21.15.67:0/2317949428 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fd83405a890 con 0x7fd83c072050 2024-04-16T13:05:04.045 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 msgr2=0x7fd81c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 0x7fd81c06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd830036000 tx=0x7fd830008030 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 msgr2=0x7fd83c15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd834007e40 tx=0x7fd83400e4b0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 shutdown_connections 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd81c06c8f0 0x7fd81c06edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd83c072050 0x7fd83c15c620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd83c06f9d0 0x7fd83c146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 --2- 172.21.15.67:0/2317949428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd83c06f040 0x7fd83c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 >> 172.21.15.67:0/2317949428 conn(0x7fd83c067d90 msgr2=0x7fd83c1648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 shutdown_connections 2024-04-16T13:05:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.045+0000 7fd842c00640 1 -- 172.21.15.67:0/2317949428 wait complete. 2024-04-16T13:05:04.068 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:04.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.290+0000 7f3c57200640 1 Processor -- start 2024-04-16T13:05:04.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.290+0000 7f3c57200640 1 -- start start 2024-04-16T13:05:04.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c57200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500b3e10 0x7f3c500cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c57200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c500c6e70 con 0x7f3c500c6890 2024-04-16T13:05:04.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c57200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c500c7150 con 0x7f3c5015c860 2024-04-16T13:05:04.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c57200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3c500c7710 con 0x7f3c500b3e10 2024-04-16T13:05:04.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c4f400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3c500c6890 0x7f3c500b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34174/0 (socket says 172.21.15.67:34174) 2024-04-16T13:05:04.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.292+0000 7f3c4f400640 1 -- 172.21.15.67:0/2630852595 learned_addr learned my addr 172.21.15.67:0/2630852595 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:04.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c55200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500b3e10 0x7f3c500cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552134363 0 0) 0x7f3c500c6e70 con 0x7f3c500c6890 2024-04-16T13:05:04.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c34003520 con 0x7f3c500c6890 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 677848620 0 0) 0x7f3c34003520 con 0x7f3c500c6890 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500b3e10 msgr2=0x7f3c500cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500b3e10 0x7f3c500cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 >> v1:172.21.15.82:6789/0 conn(0x7f3c5015c860 legacy=0x7f3c50160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c500c7430 con 0x7f3c500c6890 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f3c3c001690 con 0x7f3c500c6890 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 >> v1:172.21.15.67:6789/0 conn(0x7f3c500c6890 legacy=0x7f3c500b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c340039e0 0x7f3c34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.293+0000 7f3c4ea00640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c34004300 0x7f3c34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4ea00640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c500c7710 con 0x7f3c34004fe0 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3400bf00 con 0x7f3c34004300 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3400c080 con 0x7f3c340039e0 2024-04-16T13:05:04.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4f400640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c34004300 0x7f3c34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c4fe00640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c340039e0 0x7f3c34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 -- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c340039e0 msgr2=0x7f3c34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c340039e0 0x7f3c34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 -- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c34004300 msgr2=0x7f3c34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c34004300 0x7f3c34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.294+0000 7f3c55200640 1 -- 172.21.15.67:0/2630852595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c34003520 con 0x7f3c34004fe0 2024-04-16T13:05:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.295+0000 7f3c55200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c3400b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009f90 tx=0x7f3c34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7183a8c52f6d54a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48039070 con 0x7f3c34004fe0 2024-04-16T13:05:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4802cbd0 con 0x7f3c34004fe0 2024-04-16T13:05:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c4ea00640 1 -- 172.21.15.67:0/2630852595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48009c10 con 0x7f3c34004fe0 2024-04-16T13:05:04.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c57200640 1 -- 172.21.15.67:0/2630852595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 msgr2=0x7f3c3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c57200640 1 --2- 172.21.15.67:0/2630852595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c3400b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009f90 tx=0x7f3c34005830 comp rx=0 tx=0).stop 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c55200640 1 -- 172.21.15.67:0/2630852595 reap_dead start 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c57200640 1 -- 172.21.15.67:0/2630852595 shutdown_connections 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.296+0000 7f3c57200640 1 -- 172.21.15.67:0/2630852595 >> 172.21.15.67:0/2630852595 conn(0x7f3c50067d90 msgr2=0x7f3c5006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.297+0000 7f3c57200640 1 -- 172.21.15.67:0/2630852595 shutdown_connections 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.297+0000 7f3c57200640 1 -- 172.21.15.67:0/2630852595 wait complete. 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.298+0000 7f3c57200640 1 Processor -- start 2024-04-16T13:05:04.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 -- start start 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500cd150 0x7f3c501f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c501f42b0 0x7f3c501591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501611f0 con 0x7f3c34004fe0 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5015cc40 con 0x7f3c501f42b0 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.299+0000 7f3c57200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3c50161370 con 0x7f3c500cd150 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54208/0 (socket says 172.21.15.67:54208) 2024-04-16T13:05:04.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 -- 172.21.15.67:0/1294780406 learned_addr learned my addr 172.21.15.67:0/1294780406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:04.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 -- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500cd150 msgr2=0x7f3c501f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500cd150 0x7f3c501f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 -- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c501f42b0 msgr2=0x7f3c501591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c501f42b0 0x7f3c501591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.300+0000 7f3c4fe00640 1 -- 172.21.15.67:0/1294780406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5015e3a0 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c4fe00640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000e7d0 tx=0x7f3c4000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c400050d0 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c40018070 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000c6c0 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c501f47c0 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.301+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5015e640 con 0x7f3c34004fe0 2024-04-16T13:05:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.302+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5006c9b0 con 0x7f3c34004fe0 2024-04-16T13:05:04.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.303+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c4000c860 con 0x7f3c34004fe0 2024-04-16T13:05:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.304+0000 7f3c47e00640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 0x7f3c3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.304+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3c4008bbc0 con 0x7f3c34004fe0 2024-04-16T13:05:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.305+0000 7f3c4f400640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 0x7f3c3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.306+0000 7f3c4f400640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 0x7f3c3006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c50073a10 tx=0x7f3c3c000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.309+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c40059e00 con 0x7f3c34004fe0 2024-04-16T13:05:04.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.515+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3c500b49f0 con 0x7f3c34004fe0 2024-04-16T13:05:04.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.516+0000 7f3c47e00640 1 -- 172.21.15.67:0/1294780406 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f3c4001be40 con 0x7f3c34004fe0 2024-04-16T13:05:04.518 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:04.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 msgr2=0x7f3c3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 0x7f3c3006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c50073a10 tx=0x7f3c3c000ed0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 msgr2=0x7f3c500ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000e7d0 tx=0x7f3c4000ec90 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 shutdown_connections 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c3006c8f0 0x7f3c3006edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c501f42b0 0x7f3c501591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3c500cd150 0x7f3c501f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 --2- 172.21.15.67:0/1294780406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c34004fe0 0x7f3c500ce1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 >> 172.21.15.67:0/1294780406 conn(0x7f3c50067d90 msgr2=0x7f3c500cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 shutdown_connections 2024-04-16T13:05:04.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.519+0000 7f3c57200640 1 -- 172.21.15.67:0/1294780406 wait complete. 2024-04-16T13:05:04.542 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:05:04.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.766+0000 7fe4f6000640 1 Processor -- start 2024-04-16T13:05:04.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.766+0000 7fe4f6000640 1 -- start start 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f6000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe4f00724f0 0x7fe4f006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f6000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4f015d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f6000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f006dec0 con 0x7fe4f00ce990 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f6000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f006e7f0 con 0x7fe4f00724f0 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f6000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f006e1a0 con 0x7fe4f015cdc0 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f4c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4f00ce990 0x7fe4f0071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34178/0 (socket says 172.21.15.67:34178) 2024-04-16T13:05:04.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f4c00640 1 -- 172.21.15.67:0/208821918 learned_addr learned my addr 172.21.15.67:0/208821918 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4efe00640 1 --2- 172.21.15.67:0/208821918 >> v2:172.21.15.82:3300/0 conn(0x7fe4f00724f0 0x7fe4f006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4f5600640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4f015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.768+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571444702 0 0) 0x7fe4f006dec0 con 0x7fe4f00ce990 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d8003520 con 0x7fe4f00ce990 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 828520722 0 0) 0x7fe4d8003520 con 0x7fe4f00ce990 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 msgr2=0x7fe4f015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4f015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 >> v2:172.21.15.82:3300/0 conn(0x7fe4f00724f0 msgr2=0x7fe4f006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 --2- 172.21.15.67:0/208821918 >> v2:172.21.15.82:3300/0 conn(0x7fe4f00724f0 0x7fe4f006ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f006e480 con 0x7fe4f00ce990 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fe4e4001670 con 0x7fe4f00ce990 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 >> v1:172.21.15.67:6789/0 conn(0x7fe4f00ce990 legacy=0x7fe4f0071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4d80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4d8003f80 0x7fe4d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006e7f0 con 0x7fe4d8004d40 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006e1a0 con 0x7fe4d8003f80 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d800ba70 con 0x7fe4f015cdc0 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.769+0000 7fe4f5600640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4efe00640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4d8003f80 0x7fe4d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f4c00640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4d80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f5600640 1 -- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 msgr2=0x7fe4d80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f5600640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f015cdc0 0x7fe4d80039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f5600640 1 -- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4d8003f80 msgr2=0x7fe4d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:04.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f5600640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4d8003f80 0x7fe4d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.770+0000 7fe4f5600640 1 -- 172.21.15.67:0/208821918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d8003520 con 0x7fe4d8004d40 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.771+0000 7fe4f5600640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4d80051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009fc0 tx=0x7fe4d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91857df9e00fb914 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.771+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8039070 con 0x7fe4d8004d40 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.771+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e802cc20 con 0x7fe4d8004d40 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.771+0000 7fe4ef400640 1 -- 172.21.15.67:0/208821918 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8009c10 con 0x7fe4d8004d40 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 -- 172.21.15.67:0/208821918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 msgr2=0x7fe4d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 --2- 172.21.15.67:0/208821918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4d80051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009fc0 tx=0x7fe4d8005830 comp rx=0 tx=0).stop 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f5600640 1 -- 172.21.15.67:0/208821918 reap_dead start 2024-04-16T13:05:04.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 -- 172.21.15.67:0/208821918 shutdown_connections 2024-04-16T13:05:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 -- 172.21.15.67:0/208821918 >> 172.21.15.67:0/208821918 conn(0x7fe4f0067d90 msgr2=0x7fe4f006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 -- 172.21.15.67:0/208821918 shutdown_connections 2024-04-16T13:05:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.772+0000 7fe4f6000640 1 -- 172.21.15.67:0/208821918 wait complete. 2024-04-16T13:05:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.774+0000 7fe4f6000640 1 Processor -- start 2024-04-16T13:05:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.774+0000 7fe4f6000640 1 -- start start 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 0x7fe4f0142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f014dde0 0x7fe4f01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f015d250 con 0x7fe4d8004d40 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f015db10 con 0x7fe4f0152be0 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.775+0000 7fe4f6000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f015d3d0 con 0x7fe4f014dde0 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54232/0 (socket says 172.21.15.67:54232) 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 -- 172.21.15.67:0/2358243882 learned_addr learned my addr 172.21.15.67:0/2358243882 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4efe00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 0x7fe4f0142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f5600640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f014dde0 0x7fe4f01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 -- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f014dde0 msgr2=0x7fe4f01506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f014dde0 0x7fe4f01506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 -- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 msgr2=0x7fe4f0142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 0x7fe4f0142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 -- 172.21.15.67:0/2358243882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f01430a0 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4efe00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 0x7fe4f0142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.776+0000 7fe4f4c00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000c00 tx=0x7fe4e400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.777+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4019070 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.777+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e40074e0 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.777+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400de60 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.777+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f01530e0 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.777+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f01536a0 con 0x7fe4d8004d40 2024-04-16T13:05:04.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.778+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f0075bd0 con 0x7fe4d8004d40 2024-04-16T13:05:04.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.779+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4e4004a00 con 0x7fe4d8004d40 2024-04-16T13:05:04.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.780+0000 7fe4ecc00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 0x7fe4d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:04.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.780+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4e408b900 con 0x7fe4d8004d40 2024-04-16T13:05:04.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.781+0000 7fe4efe00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 0x7fe4d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:04.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.782+0000 7fe4efe00640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 0x7fe4d006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006f230 tx=0x7fe4dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:04.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.784+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4e4059950 con 0x7fe4d8004d40 2024-04-16T13:05:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:04.999+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4f006bea0 con 0x7fe4d8004d40 2024-04-16T13:05:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.000+0000 7fe4ecc00640 1 -- 172.21.15.67:0/2358243882 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fe4e4059250 con 0x7fe4d8004d40 2024-04-16T13:05:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:05:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 msgr2=0x7fe4d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 0x7fe4d006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006f230 tx=0x7fe4dc008040 comp rx=0 tx=0).stop 2024-04-16T13:05:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 msgr2=0x7fe4f0154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4000c00 tx=0x7fe4e400dc70 comp rx=0 tx=0).stop 2024-04-16T13:05:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 shutdown_connections 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe4d006c920 0x7fe4d006ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4f014dde0 0x7fe4f01506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4f0152be0 0x7fe4f0142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 --2- 172.21.15.67:0/2358243882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d8004d40 0x7fe4f0154180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 >> 172.21.15.67:0/2358243882 conn(0x7fe4f0067d90 msgr2=0x7fe4f015ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 shutdown_connections 2024-04-16T13:05:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.003+0000 7fe4f6000640 1 -- 172.21.15.67:0/2358243882 wait complete. 2024-04-16T13:05:05.024 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-04-16T13:05:05.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:05.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-16T13:05:05.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[43421]: fuse finished with error 0 and tester_r 0 2024-04-16T13:05:05.122 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:05:05.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:05:05.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:05.211 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-16T13:05:05.276 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.497+0000 7fc2fb200640 1 Processor -- start 2024-04-16T13:05:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.497+0000 7fc2fb200640 1 -- start start 2024-04-16T13:05:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.498+0000 7fc2fb200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2f415c420 0x7fc2f41601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.498+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f40c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.498+0000 7fc2fb200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f4161110 con 0x7fc2f40c5100 2024-04-16T13:05:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.498+0000 7fc2fb200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4160870 con 0x7fc2f415c420 2024-04-16T13:05:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.498+0000 7fc2fb200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f4160b50 con 0x7fc2f415c800 2024-04-16T13:05:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2f415c420 0x7fc2f41601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2f415c420 0x7fc2f41601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54248/0 (socket says 172.21.15.67:54248) 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 -- 172.21.15.67:0/2155736739 learned_addr learned my addr 172.21.15.67:0/2155736739 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2fa800640 1 --1- 172.21.15.67:0/2155736739 >> v1:172.21.15.67:6789/0 conn(0x7fc2f40c5100 0x7fc2f406ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34188/0 (socket says 172.21.15.67:34188) 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9400640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f40c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 -- 172.21.15.67:0/2155736739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 msgr2=0x7fc2f40c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f40c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 -- 172.21.15.67:0/2155736739 >> v1:172.21.15.67:6789/0 conn(0x7fc2f40c5100 legacy=0x7fc2f406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.499+0000 7fc2f9e00640 1 -- 172.21.15.67:0/2155736739 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f4160e30 con 0x7fc2f415c420 2024-04-16T13:05:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.500+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f41601e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009e50 tx=0x7fc2ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e485fcf2a2a94e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2f8a00640 1 -- 172.21.15.67:0/2155736739 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec02c9e0 con 0x7fc2f415c420 2024-04-16T13:05:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2f8a00640 1 -- 172.21.15.67:0/2155736739 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec02cb80 con 0x7fc2f415c420 2024-04-16T13:05:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2f8a00640 1 -- 172.21.15.67:0/2155736739 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0343f0 con 0x7fc2f415c420 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 -- 172.21.15.67:0/2155736739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 msgr2=0x7fc2f41601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f41601e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009e50 tx=0x7fc2ec02be40 comp rx=0 tx=0).stop 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 -- 172.21.15.67:0/2155736739 shutdown_connections 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 --2- 172.21.15.67:0/2155736739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f41601e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 -- 172.21.15.67:0/2155736739 >> 172.21.15.67:0/2155736739 conn(0x7fc2f40b2070 msgr2=0x7fc2f40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 -- 172.21.15.67:0/2155736739 shutdown_connections 2024-04-16T13:05:05.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.501+0000 7fc2fb200640 1 -- 172.21.15.67:0/2155736739 wait complete. 2024-04-16T13:05:05.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.503+0000 7fc2fb200640 1 Processor -- start 2024-04-16T13:05:05.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.503+0000 7fc2fb200640 1 -- start start 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 0x7fc2f41508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f4099160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40cd100 con 0x7fc2f415c420 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40ccf80 con 0x7fc2f40c5100 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.504+0000 7fc2fb200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40cd280 con 0x7fc2f415c800 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54264/0 (socket says 172.21.15.67:54264) 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 -- 172.21.15.67:0/3712042754 learned_addr learned my addr 172.21.15.67:0/3712042754 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2fa800640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f4099160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 0x7fc2f41508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 -- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 msgr2=0x7fc2f4099160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f4099160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 -- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 msgr2=0x7fc2f41508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 0x7fc2f41508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 -- 172.21.15.67:0/3712042754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40aec00 con 0x7fc2f415c420 2024-04-16T13:05:05.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 0x7fc2f41508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.505+0000 7fc2f9400640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400d830 tx=0x7fc2e400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.506+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400b6c0 con 0x7fc2f415c420 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.506+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e4019070 con 0x7fc2f415c420 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.506+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400ba80 con 0x7fc2f415c420 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.506+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f40aeee0 con 0x7fc2f415c420 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.506+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f40cdfb0 con 0x7fc2f415c420 2024-04-16T13:05:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.507+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4075bd0 con 0x7fc2f415c420 2024-04-16T13:05:05.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.508+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2e401e460 con 0x7fc2f415c420 2024-04-16T13:05:05.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.509+0000 7fc2ea000640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 0x7fc2d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.509+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2e408c5a0 con 0x7fc2f415c420 2024-04-16T13:05:05.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.509+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 0x7fc2d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.511+0000 7fc2f9e00640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 0x7fc2d806ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec035000 tx=0x7fc2ec030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.513+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2e405a680 con 0x7fc2f415c420 2024-04-16T13:05:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.720+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2f40b3dc0 con 0x7fc2f415c420 2024-04-16T13:05:05.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.721+0000 7fc2ea000640 1 -- 172.21.15.67:0/3712042754 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fc2e4059f80 con 0x7fc2f415c420 2024-04-16T13:05:05.724 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:05.724 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 msgr2=0x7fc2d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 0x7fc2d806ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec035000 tx=0x7fc2ec030000 comp rx=0 tx=0).stop 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 msgr2=0x7fc2f4098c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400d830 tx=0x7fc2e400dcf0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 shutdown_connections 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc2d806c920 0x7fc2d806ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2f415c800 0x7fc2f4099160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2f415c420 0x7fc2f4098c20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 --2- 172.21.15.67:0/3712042754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2f40c5100 0x7fc2f41508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.724+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 >> 172.21.15.67:0/3712042754 conn(0x7fc2f40b2070 msgr2=0x7fc2f415a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.725+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 shutdown_connections 2024-04-16T13:05:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.725+0000 7fc2fb200640 1 -- 172.21.15.67:0/3712042754 wait complete. 2024-04-16T13:05:05.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:05.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.968+0000 7f7396c00640 1 Processor -- start 2024-04-16T13:05:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.968+0000 7f7396c00640 1 -- start start 2024-04-16T13:05:05.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73900d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900d0000 con 0x7f739006da70 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396c00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73900d02e0 con 0x7f73900d5220 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73900d0c10 con 0x7f739015eaa0 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f739006da70 0x7f73900d27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34204/0 (socket says 172.21.15.67:34204) 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.970+0000 7f7396200640 1 -- 172.21.15.67:0/1930744504 learned_addr learned my addr 172.21.15.67:0/1930744504 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f7395800640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73900d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458561485 0 0) 0x7f73900d0000 con 0x7f739006da70 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7378003520 con 0x7f739006da70 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045223229 0 0) 0x7f7378003520 con 0x7f739006da70 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 msgr2=0x7f73900d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73900d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 >> v1:172.21.15.82:6789/0 conn(0x7f73900d5220 legacy=0x7f739006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73900d05c0 con 0x7f739006da70 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f73880019f0 con 0x7f739006da70 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 >> v1:172.21.15.67:6789/0 conn(0x7f739006da70 legacy=0x7f73900d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73780039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7378003f20 0x7f7378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7378004d40 0x7f73780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73900d0c10 con 0x7f7378004d40 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f737800bad0 con 0x7f7378003f20 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.971+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f737800bcd0 con 0x7f739015eaa0 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.972+0000 7f7394e00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7378003f20 0x7f7378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.972+0000 7f7395800640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73780039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.972+0000 7f7396200640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7378004d40 0x7f73780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.973+0000 7f7396200640 1 -- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 msgr2=0x7f73780039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.973+0000 7f7396200640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f739015eaa0 0x7f73780039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.973+0000 7f7396200640 1 -- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7378003f20 msgr2=0x7f7378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:05.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.973+0000 7f7396200640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7378003f20 0x7f7378004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.973+0000 7f7396200640 1 -- 172.21.15.67:0/1930744504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7378003520 con 0x7f7378004d40 2024-04-16T13:05:05.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.974+0000 7f7396200640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7378004d40 0x7f73780051c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f738800a7c0 tx=0x7f7378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b06b6badf97195 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.974+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738800a410 con 0x7f7378004d40 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.974+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7388034650 con 0x7f7378004d40 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.974+0000 7f738fe00640 1 -- 172.21.15.67:0/1930744504 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388034a80 con 0x7f7378004d40 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 -- 172.21.15.67:0/1930744504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7378004d40 msgr2=0x7f73780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 --2- 172.21.15.67:0/1930744504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7378004d40 0x7f73780051c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f738800a7c0 tx=0x7f7378005830 comp rx=0 tx=0).stop 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396200640 1 -- 172.21.15.67:0/1930744504 reap_dead start 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 -- 172.21.15.67:0/1930744504 shutdown_connections 2024-04-16T13:05:05.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 -- 172.21.15.67:0/1930744504 >> 172.21.15.67:0/1930744504 conn(0x7f739008c000 msgr2=0x7f73900d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:05.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 -- 172.21.15.67:0/1930744504 shutdown_connections 2024-04-16T13:05:05.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.975+0000 7f7396c00640 1 -- 172.21.15.67:0/1930744504 wait complete. 2024-04-16T13:05:05.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.977+0000 7f7396c00640 1 Processor -- start 2024-04-16T13:05:05.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.977+0000 7f7396c00640 1 -- start start 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7378004d40 0x7f73900a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 0x7f73900a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f739006ceb0 con 0x7f73900b2000 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f739015ee80 con 0x7f73900a0790 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73900d4ce0 con 0x7f7378004d40 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54278/0 (socket says 172.21.15.67:54278) 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 -- 172.21.15.67:0/1047065123 learned_addr learned my addr 172.21.15.67:0/1047065123 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7395800640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7378004d40 0x7f73900a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7396200640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 0x7f73900a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 -- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7378004d40 msgr2=0x7f73900a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7378004d40 0x7f73900a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.978+0000 7f7394e00640 1 -- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 msgr2=0x7f73900a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7394e00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 0x7f73900a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7394e00640 1 -- 172.21.15.67:0/1047065123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739009f6f0 con 0x7f73900b2000 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7396200640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 0x7f73900a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7394e00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f737c00f870 tx=0x7f737c00fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c01a070 con 0x7f73900b2000 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c005320 con 0x7f73900b2000 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c007270 con 0x7f73900b2000 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739009f9d0 con 0x7f73900b2000 2024-04-16T13:05:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.979+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739009ff90 con 0x7f73900b2000 2024-04-16T13:05:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.980+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7390075bd0 con 0x7f73900b2000 2024-04-16T13:05:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.981+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f737c01d070 con 0x7f73900b2000 2024-04-16T13:05:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.982+0000 7f738d600640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.982+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f737c08b7d0 con 0x7f73900b2000 2024-04-16T13:05:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.983+0000 7f7395800640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:05.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.984+0000 7f7395800640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 0x7f737006edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f73900a1300 tx=0x7f7384008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:05.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:05.987+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f737c059820 con 0x7f73900b2000 2024-04-16T13:05:06.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.200+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73900b54a0 con 0x7f73900b2000 2024-04-16T13:05:06.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.203+0000 7f738d600640 1 -- 172.21.15.67:0/1047065123 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f737c059120 con 0x7f73900b2000 2024-04-16T13:05:06.206 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:06.206 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 msgr2=0x7f737006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 0x7f737006edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f73900a1300 tx=0x7f7384008040 comp rx=0 tx=0).stop 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 msgr2=0x7f73900b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f737c00f870 tx=0x7f737c00fd30 comp rx=0 tx=0).stop 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 shutdown_connections 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f737006c8f0 0x7f737006edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73900a0790 0x7f73900a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73900b2000 0x7f73900b2480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 --2- 172.21.15.67:0/1047065123 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7378004d40 0x7f73900a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 >> 172.21.15.67:0/1047065123 conn(0x7f739008c000 msgr2=0x7f739015f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:06.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 shutdown_connections 2024-04-16T13:05:06.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.206+0000 7f7396c00640 1 -- 172.21.15.67:0/1047065123 wait complete. 2024-04-16T13:05:06.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T13:05:06.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.453+0000 7f07fb200640 1 Processor -- start 2024-04-16T13:05:06.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.453+0000 7f07fb200640 1 -- start start 2024-04-16T13:05:06.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07fb200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07fc0ce990 0x7f07fc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07fb200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc06dec0 con 0x7f07fc071de0 2024-04-16T13:05:06.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07fb200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc06e1a0 con 0x7f07fc15d4d0 2024-04-16T13:05:06.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07fb200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07fc06e7f0 con 0x7f07fc0ce990 2024-04-16T13:05:06.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f9400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f07fc071de0 0x7f07fc15cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34206/0 (socket says 172.21.15.67:34206) 2024-04-16T13:05:06.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f9400640 1 -- 172.21.15.67:0/1379961031 learned_addr learned my addr 172.21.15.67:0/1379961031 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f9e00640 1 --2- 172.21.15.67:0/1379961031 >> v2:172.21.15.82:3300/0 conn(0x7f07fc0ce990 0x7f07fc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583607647 0 0) 0x7f07fc06dec0 con 0x7f07fc071de0 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e0003520 con 0x7f07fc071de0 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1345324415 0 0) 0x7f07e0003520 con 0x7f07fc071de0 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 >> v2:172.21.15.82:3300/0 conn(0x7f07fc0ce990 msgr2=0x7f07fc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 --2- 172.21.15.67:0/1379961031 >> v2:172.21.15.82:3300/0 conn(0x7f07fc0ce990 0x7f07fc06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 >> v1:172.21.15.82:6789/0 conn(0x7f07fc15d4d0 legacy=0x7f07fc15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc06e480 con 0x7f07fc071de0 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f07e4001670 con 0x7f07fc071de0 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 >> v1:172.21.15.67:6789/0 conn(0x7f07fc071de0 legacy=0x7f07fc15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e0003a00 0x7f07e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.456+0000 7f07f8a00640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e0004800 0x7f07e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f8a00640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07e000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06e7f0 con 0x7f07e0005210 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07e0010570 con 0x7f07e0003a00 2024-04-16T13:05:06.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07e0010770 con 0x7f07e0004800 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07e000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f9e00640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e0003a00 0x7f07e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07f9400640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e0004800 0x7f07e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 -- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e0004800 msgr2=0x7f07e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07e0004800 0x7f07e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 -- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e0003a00 msgr2=0x7f07e0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07e0003a00 0x7f07e0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.457+0000 7f07fa800640 1 -- 172.21.15.67:0/1379961031 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e0003520 con 0x7f07e0005210 2024-04-16T13:05:06.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.458+0000 7f07fa800640 1 -- 172.21.15.67:0/1379961031 reap_dead start 2024-04-16T13:05:06.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.458+0000 7f07fa800640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07e000fdd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001e20 tx=0x7f07e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f487001c44186ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:06.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.459+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4001a70 con 0x7f07e0005210 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.459+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4003b70 con 0x7f07e0005210 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.459+0000 7f07f8a00640 1 -- 172.21.15.67:0/1379961031 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40050d0 con 0x7f07e0005210 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 -- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 msgr2=0x7f07e000fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07e000fdd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001e20 tx=0x7f07e0005830 comp rx=0 tx=0).stop 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 -- 172.21.15.67:0/1379961031 shutdown_connections 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 --2- 172.21.15.67:0/1379961031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07e000fdd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 -- 172.21.15.67:0/1379961031 >> 172.21.15.67:0/1379961031 conn(0x7f07fc067d90 msgr2=0x7f07fc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 -- 172.21.15.67:0/1379961031 shutdown_connections 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.460+0000 7f07fb200640 1 -- 172.21.15.67:0/1379961031 wait complete. 2024-04-16T13:05:06.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.462+0000 7f07fb200640 1 Processor -- start 2024-04-16T13:05:06.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.462+0000 7f07fb200640 1 -- start start 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07fc0c5680 0x7f07fc146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc0b5020 0x7f07fc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06ec80 con 0x7f07e0005210 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc15db10 con 0x7f07fc0b5020 2024-04-16T13:05:06.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fb200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc06ee00 con 0x7f07fc0c5680 2024-04-16T13:05:06.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54296/0 (socket says 172.21.15.67:54296) 2024-04-16T13:05:06.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9e00640 1 -- 172.21.15.67:0/287089989 learned_addr learned my addr 172.21.15.67:0/287089989 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:06.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07fa800640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc0b5020 0x7f07fc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9400640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07fc0c5680 0x7f07fc146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9e00640 1 -- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07fc0c5680 msgr2=0x7f07fc146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.463+0000 7f07f9e00640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07fc0c5680 0x7f07fc146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f9e00640 1 -- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc0b5020 msgr2=0x7f07fc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f9e00640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc0b5020 0x7f07fc158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f9e00640 1 -- 172.21.15.67:0/287089989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0b3f80 con 0x7f07e0005210 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f9e00640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07ec011570 tx=0x7f07ec011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec015930 con 0x7f07e0005210 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec015ad0 con 0x7f07e0005210 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec01d400 con 0x7f07e0005210 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc0b4260 con 0x7f07e0005210 2024-04-16T13:05:06.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.464+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc0b4820 con 0x7f07e0005210 2024-04-16T13:05:06.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.466+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc0b16e0 con 0x7f07e0005210 2024-04-16T13:05:06.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.466+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f07ec01d5a0 con 0x7f07e0005210 2024-04-16T13:05:06.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.467+0000 7f07f2000640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 0x7f07d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:06.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.468+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f07ec08c770 con 0x7f07e0005210 2024-04-16T13:05:06.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.468+0000 7f07f9400640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 0x7f07d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:06.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.469+0000 7f07f9400640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 0x7f07d806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07e4001050 tx=0x7f07e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:06.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.472+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07fc0b16e0 con 0x7f07e0005210 2024-04-16T13:05:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:06.721+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f07fc0cefe0 con 0x7f07e0005210 2024-04-16T13:05:06.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:05:06.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:05:07.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.226+0000 7f07f2000640 1 -- 172.21.15.67:0/287089989 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f07fc0cefe0 con 0x7f07e0005210 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 msgr2=0x7f07d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 0x7f07d806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07e4001050 tx=0x7f07e4009040 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 msgr2=0x7f07fc0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07ec011570 tx=0x7f07ec011a30 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 shutdown_connections 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07d806c8f0 0x7f07d806edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07fc0b5020 0x7f07fc158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.229+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07fc0c5680 0x7f07fc146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.230+0000 7f07fb200640 1 --2- 172.21.15.67:0/287089989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e0005210 0x7f07fc0b36a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.230+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 >> 172.21.15.67:0/287089989 conn(0x7f07fc067d90 msgr2=0x7f07fc154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:07.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.230+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 shutdown_connections 2024-04-16T13:05:07.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.230+0000 7f07fb200640 1 -- 172.21.15.67:0/287089989 wait complete. 2024-04-16T13:05:07.256 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-16T13:05:07.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T13:05:07.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.480+0000 7f690fe00640 1 Processor -- start 2024-04-16T13:05:07.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.480+0000 7f690fe00640 1 -- start start 2024-04-16T13:05:07.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.482+0000 7f690fe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f690815c860 0x7f69080c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.482+0000 7f690fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 0x7f69080b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.482+0000 7f690fe00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69080cce80 con 0x7f69080cc9f0 2024-04-16T13:05:07.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.482+0000 7f690fe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f69080c7710 con 0x7f690815c860 2024-04-16T13:05:07.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.482+0000 7f690fe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69080c6e70 con 0x7f69080b3700 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f690ca00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f69080cc9f0 0x7f6908160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34210/0 (socket says 172.21.15.67:34210) 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f690ca00640 1 -- 172.21.15.67:0/3642211068 learned_addr learned my addr 172.21.15.67:0/3642211068 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f690de00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 0x7f69080b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f690d400640 1 --2- 172.21.15.67:0/3642211068 >> v2:172.21.15.82:3300/0 conn(0x7f690815c860 0x7f69080c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636283759 0 0) 0x7f69080cce80 con 0x7f69080cc9f0 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f0003520 con 0x7f69080cc9f0 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086784051 0 0) 0x7f68f0003520 con 0x7f69080cc9f0 2024-04-16T13:05:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 msgr2=0x7f69080b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 0x7f69080b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 >> v2:172.21.15.82:3300/0 conn(0x7f690815c860 msgr2=0x7f69080c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 --2- 172.21.15.67:0/3642211068 >> v2:172.21.15.82:3300/0 conn(0x7f690815c860 0x7f69080c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.483+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69080c7150 con 0x7f69080cc9f0 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f68f4001670 con 0x7f69080cc9f0 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 >> v1:172.21.15.67:6789/0 conn(0x7f69080cc9f0 legacy=0x7f6908160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00039b0 0x7f68f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f68f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 0x7f68f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69080c7710 con 0x7f68f0004800 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69080c6e70 con 0x7f68f00039b0 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f68f000b9c0 con 0x7f69080b3700 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690ca00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f68f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690d400640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00039b0 0x7f68f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690ca00640 1 -- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 msgr2=0x7f68f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690ca00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f69080b3700 0x7f68f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690ca00640 1 -- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00039b0 msgr2=0x7f68f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.484+0000 7f690ca00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f00039b0 0x7f68f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.485+0000 7f690ca00640 1 -- 172.21.15.67:0/3642211068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f0003520 con 0x7f68f0004800 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.486+0000 7f690ca00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f68f0004c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c290 tx=0x7f68f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c46d29a4a57a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.486+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4007d50 con 0x7f68f0004800 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.486+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4030070 con 0x7f68f0004800 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.486+0000 7f6907e00640 1 -- 172.21.15.67:0/3642211068 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f402cd70 con 0x7f68f0004800 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 -- 172.21.15.67:0/3642211068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 msgr2=0x7f68f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 --2- 172.21.15.67:0/3642211068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f68f0004c80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c290 tx=0x7f68f0005830 comp rx=0 tx=0).stop 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690de00640 1 -- 172.21.15.67:0/3642211068 reap_dead start 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 -- 172.21.15.67:0/3642211068 shutdown_connections 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 -- 172.21.15.67:0/3642211068 >> 172.21.15.67:0/3642211068 conn(0x7f6908067d90 msgr2=0x7f690806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 -- 172.21.15.67:0/3642211068 shutdown_connections 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.487+0000 7f690fe00640 1 -- 172.21.15.67:0/3642211068 wait complete. 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.489+0000 7f690fe00640 1 Processor -- start 2024-04-16T13:05:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.489+0000 7f690fe00640 1 -- start start 2024-04-16T13:05:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f690813dd70 0x7f690815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690815ff20 0x7f690815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f690815cc40 con 0x7f68f0004800 2024-04-16T13:05:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69081605c0 con 0x7f690815ff20 2024-04-16T13:05:07.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690fe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f69081611f0 con 0x7f690813dd70 2024-04-16T13:05:07.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54302/0 (socket says 172.21.15.67:54302) 2024-04-16T13:05:07.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.490+0000 7f690d400640 1 -- 172.21.15.67:0/2205992766 learned_addr learned my addr 172.21.15.67:0/2205992766 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 -- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f690813dd70 msgr2=0x7f690815f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f690813dd70 0x7f690815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690de00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690815ff20 0x7f690815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 -- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690815ff20 msgr2=0x7f690815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690815ff20 0x7f690815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 -- 172.21.15.67:0/2205992766 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69080c9f20 con 0x7f68f0004800 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690d400640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68fc011540 tx=0x7f68fc011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:07.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc015930 con 0x7f68f0004800 2024-04-16T13:05:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc015ad0 con 0x7f68f0004800 2024-04-16T13:05:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc01d400 con 0x7f68f0004800 2024-04-16T13:05:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.491+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69080ca200 con 0x7f68f0004800 2024-04-16T13:05:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.492+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69080ca7c0 con 0x7f68f0004800 2024-04-16T13:05:07.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.493+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6908068a70 con 0x7f68f0004800 2024-04-16T13:05:07.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.494+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f68fc01d5a0 con 0x7f68f0004800 2024-04-16T13:05:07.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.495+0000 7f6905600640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:07.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.495+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68fc08c7a0 con 0x7f68f0004800 2024-04-16T13:05:07.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.496+0000 7f690ca00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:07.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.497+0000 7f690ca00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 0x7f68e806ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f4039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:07.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.500+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f68fc019030 con 0x7f68f0004800 2024-04-16T13:05:07.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:07.746+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6908158460 con 0x7f68f0004800 2024-04-16T13:05:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.229+0000 7f6905600640 1 -- 172.21.15.67:0/2205992766 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f68fc05a7f0 con 0x7f68f0004800 2024-04-16T13:05:08.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 msgr2=0x7f68e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 0x7f68e806ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034000 tx=0x7f68f4039040 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 msgr2=0x7f69080cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68fc011540 tx=0x7f68fc011a00 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 shutdown_connections 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f68e806c920 0x7f68e806ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690815ff20 0x7f690815cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f690813dd70 0x7f690815f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 --2- 172.21.15.67:0/2205992766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68f0004800 0x7f69080cafc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.234+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 >> 172.21.15.67:0/2205992766 conn(0x7f6908067d90 msgr2=0x7f6908071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:08.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.235+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 shutdown_connections 2024-04-16T13:05:08.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.235+0000 7f690fe00640 1 -- 172.21.15.67:0/2205992766 wait complete. 2024-04-16T13:05:08.260 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T13:05:08.261 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:05:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.482+0000 7fb276200640 1 Processor -- start 2024-04-16T13:05:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.482+0000 7fb276200640 1 -- start start 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb276200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb27015ea90 0x7fb27006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb276200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 0x7fb2700d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb276200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700d05a0 con 0x7fb27015e6b0 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb276200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb27006ceb0 con 0x7fb27015ea90 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb276200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700d1b40 con 0x7fb27006d8a0 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb26fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb27015ea90 0x7fb27006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb26fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb27015ea90 0x7fb27006d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54312/0 (socket says 172.21.15.67:54312) 2024-04-16T13:05:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.483+0000 7fb26fe00640 1 -- 172.21.15.67:0/3904680945 learned_addr learned my addr 172.21.15.67:0/3904680945 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb275800640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 0x7fb2700d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb26fe00640 1 -- 172.21.15.67:0/3904680945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 msgr2=0x7fb2700d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb26fe00640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 0x7fb2700d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb26fe00640 1 -- 172.21.15.67:0/3904680945 >> v1:172.21.15.67:6789/0 conn(0x7fb27015e6b0 legacy=0x7fb2700cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb26fe00640 1 -- 172.21.15.67:0/3904680945 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2700cf3b0 con 0x7fb27015ea90 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb26f400640 1 -- 172.21.15.67:0/3904680945 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534954719 0 0) 0x7fb2700d05a0 con 0x7fb27015e6b0 2024-04-16T13:05:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.484+0000 7fb275800640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 0x7fb2700d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.485+0000 7fb26fe00640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015ea90 0x7fb27006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb258009850 tx=0x7fb25802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61648eb69c554b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb26f400640 1 -- 172.21.15.67:0/3904680945 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258004230 con 0x7fb27015ea90 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb26f400640 1 -- 172.21.15.67:0/3904680945 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2580043d0 con 0x7fb27015ea90 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb26f400640 1 -- 172.21.15.67:0/3904680945 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258003810 con 0x7fb27015ea90 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 -- 172.21.15.67:0/3904680945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015ea90 msgr2=0x7fb27006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015ea90 0x7fb27006d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb258009850 tx=0x7fb25802b960 comp rx=0 tx=0).stop 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 -- 172.21.15.67:0/3904680945 shutdown_connections 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27006d8a0 0x7fb2700d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 --2- 172.21.15.67:0/3904680945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015ea90 0x7fb27006d360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 -- 172.21.15.67:0/3904680945 >> 172.21.15.67:0/3904680945 conn(0x7fb27009d950 msgr2=0x7fb27008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 -- 172.21.15.67:0/3904680945 shutdown_connections 2024-04-16T13:05:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.486+0000 7fb276200640 1 -- 172.21.15.67:0/3904680945 wait complete. 2024-04-16T13:05:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.488+0000 7fb276200640 1 Processor -- start 2024-04-16T13:05:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.488+0000 7fb276200640 1 -- start start 2024-04-16T13:05:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27006d8a0 0x7fb270161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 0x7fb2700ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700d1e20 con 0x7fb27015e6b0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700cf970 con 0x7fb27006d8a0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb276200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700d1510 con 0x7fb27015ea90 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb26fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb26fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54320/0 (socket says 172.21.15.67:54320) 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.489+0000 7fb26fe00640 1 -- 172.21.15.67:0/534113224 learned_addr learned my addr 172.21.15.67:0/534113224 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb274e00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27006d8a0 0x7fb270161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 -- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 msgr2=0x7fb2700ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb275800640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 0x7fb2700ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 0x7fb2700ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 -- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27006d8a0 msgr2=0x7fb270161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27006d8a0 0x7fb270161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 -- 172.21.15.67:0/534113224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb270160180 con 0x7fb27015e6b0 2024-04-16T13:05:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb275800640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 0x7fb2700ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.490+0000 7fb26fe00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb25802b9a0 tx=0x7fb2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.491+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258047070 con 0x7fb27015e6b0 2024-04-16T13:05:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.491+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258003bd0 con 0x7fb27015e6b0 2024-04-16T13:05:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.491+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb270160980 con 0x7fb27015e6b0 2024-04-16T13:05:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.491+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258006040 con 0x7fb27015e6b0 2024-04-16T13:05:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.491+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb270160f40 con 0x7fb27015e6b0 2024-04-16T13:05:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.492+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb270075bd0 con 0x7fb27015e6b0 2024-04-16T13:05:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.493+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb25804a070 con 0x7fb27015e6b0 2024-04-16T13:05:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.494+0000 7fb26cc00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.494+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2580ad9c0 con 0x7fb27015e6b0 2024-04-16T13:05:08.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.495+0000 7fb274e00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.496+0000 7fb274e00640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 0x7fb24c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb2700cac90 tx=0x7fb260009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:08.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.498+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb258034020 con 0x7fb27015e6b0 2024-04-16T13:05:08.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.749+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2701613c0 con 0x7fb27015e6b0 2024-04-16T13:05:08.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.750+0000 7fb26cc00640 1 -- 172.21.15.67:0/534113224 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fb25807baa0 con 0x7fb27015e6b0 2024-04-16T13:05:08.751 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:08.752 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:05:08.752 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:05:08.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 msgr2=0x7fb24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 0x7fb24c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb2700cac90 tx=0x7fb260009040 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 msgr2=0x7fb27015f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb25802b9a0 tx=0x7fb2580046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 shutdown_connections 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb24c06c8f0 0x7fb24c06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb27015ea90 0x7fb2700ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb27015e6b0 0x7fb27015f880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 --2- 172.21.15.67:0/534113224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27006d8a0 0x7fb270161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 >> 172.21.15.67:0/534113224 conn(0x7fb27009d950 msgr2=0x7fb2700cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 shutdown_connections 2024-04-16T13:05:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.753+0000 7fb276200640 1 -- 172.21.15.67:0/534113224 wait complete. 2024-04-16T13:05:08.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.995+0000 7fa62be00640 1 Processor -- start 2024-04-16T13:05:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.996+0000 7fa62be00640 1 -- start start 2024-04-16T13:05:08.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 0x7fa62c0d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62be00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62c0d0000 con 0x7fa62c0d5220 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62be00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa62c0d0c10 con 0x7fa62c15eaa0 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0d02e0 con 0x7fa62c06da70 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54336/0 (socket says 172.21.15.67:54336) 2024-04-16T13:05:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.997+0000 7fa62aa00640 1 -- 172.21.15.67:0/132431108 learned_addr learned my addr 172.21.15.67:0/132431108 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62b400640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 0x7fa62c0d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62aa00640 1 -- 172.21.15.67:0/132431108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 msgr2=0x7fa62c0d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62aa00640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 0x7fa62c0d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62aa00640 1 -- 172.21.15.67:0/132431108 >> v1:172.21.15.67:6789/0 conn(0x7fa62c0d5220 legacy=0x7fa62c06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62aa00640 1 -- 172.21.15.67:0/132431108 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c0d05c0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa629600640 1 -- 172.21.15.67:0/132431108 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833881806 0 0) 0x7fa62c0d0000 con 0x7fa62c0d5220 2024-04-16T13:05:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.998+0000 7fa62b400640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 0x7fa62c0d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:08.999+0000 7fa62aa00640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009870 tx=0x7fa61c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2352bd5f8cd343a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa629600640 1 -- 172.21.15.67:0/132431108 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c035020 con 0x7fa62c15eaa0 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa629600640 1 -- 172.21.15.67:0/132431108 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c031640 con 0x7fa62c15eaa0 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa629600640 1 -- 172.21.15.67:0/132431108 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c02d040 con 0x7fa62c15eaa0 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 -- 172.21.15.67:0/132431108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 msgr2=0x7fa62c0d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009870 tx=0x7fa61c02b8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 -- 172.21.15.67:0/132431108 shutdown_connections 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c06da70 0x7fa62c0d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 --2- 172.21.15.67:0/132431108 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0d4ce0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 -- 172.21.15.67:0/132431108 >> 172.21.15.67:0/132431108 conn(0x7fa62c08c000 msgr2=0x7fa62c0d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.000+0000 7fa62be00640 1 -- 172.21.15.67:0/132431108 shutdown_connections 2024-04-16T13:05:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.001+0000 7fa62be00640 1 -- 172.21.15.67:0/132431108 wait complete. 2024-04-16T13:05:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.002+0000 7fa62be00640 1 Processor -- start 2024-04-16T13:05:09.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.003+0000 7fa62be00640 1 -- start start 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.003+0000 7fa62be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 0x7fa62c1f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.003+0000 7fa62be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d5220 0x7fa62c1f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c06ceb0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c15ee80 con 0x7fa62c06da70 2024-04-16T13:05:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa62c0d2cf0 con 0x7fa62c0d5220 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54346/0 (socket says 172.21.15.67:54346) 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 -- 172.21.15.67:0/3443864871 learned_addr learned my addr 172.21.15.67:0/3443864871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62aa00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 0x7fa62c1f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62a000640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d5220 0x7fa62c1f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 -- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d5220 msgr2=0x7fa62c1f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d5220 0x7fa62c1f7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 -- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 msgr2=0x7fa62c1f7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 0x7fa62c1f7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62b400640 1 -- 172.21.15.67:0/3443864871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c0cb7d0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.004+0000 7fa62aa00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 0x7fa62c1f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa62b400640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ce80 tx=0x7fa62400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62401a070 con 0x7fa62c15eaa0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62400d880 con 0x7fa62c15eaa0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62400dc70 con 0x7fa62c15eaa0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c0cbab0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.005+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c0cc070 con 0x7fa62c15eaa0 2024-04-16T13:05:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.006+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c075bd0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.007+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa62401d070 con 0x7fa62c15eaa0 2024-04-16T13:05:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.008+0000 7fa623400640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 0x7fa60c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.008+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa62408c5b0 con 0x7fa62c15eaa0 2024-04-16T13:05:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.009+0000 7fa62aa00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 0x7fa60c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.010+0000 7fa62aa00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 0x7fa60c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa61c036000 tx=0x7fa61c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.013+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa62405a040 con 0x7fa62c15eaa0 2024-04-16T13:05:09.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.221+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa62c15df30 con 0x7fa62c15eaa0 2024-04-16T13:05:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.223+0000 7fa623400640 1 -- 172.21.15.67:0/3443864871 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fa62405e340 con 0x7fa62c15eaa0 2024-04-16T13:05:09.224 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:09.224 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 msgr2=0x7fa60c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 0x7fa60c06edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa61c036000 tx=0x7fa61c008030 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 msgr2=0x7fa62c0cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ce80 tx=0x7fa62400a710 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 shutdown_connections 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa60c06c8f0 0x7fa60c06edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa62c15eaa0 0x7fa62c0cd730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa62c0d5220 0x7fa62c1f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 --2- 172.21.15.67:0/3443864871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c06da70 0x7fa62c1f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.225+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 >> 172.21.15.67:0/3443864871 conn(0x7fa62c08c000 msgr2=0x7fa62c0d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:09.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.226+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 shutdown_connections 2024-04-16T13:05:09.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.226+0000 7fa62be00640 1 -- 172.21.15.67:0/3443864871 wait complete. 2024-04-16T13:05:09.246 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T13:05:09.246 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:05:09.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.467+0000 7fc3ba800640 1 Processor -- start 2024-04-16T13:05:09.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.468+0000 7fc3ba800640 1 -- start start 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.469+0000 7fc3ba800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3b415eaa0 0x7fc3b40d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.469+0000 7fc3ba800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b40d5220 0x7fc3b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.469+0000 7fc3ba800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b40d0000 con 0x7fc3b406d8a0 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.469+0000 7fc3ba800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b406dd10 con 0x7fc3b40d5220 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3ba800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b40d0c10 con 0x7fc3b415eaa0 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b40d5220 0x7fc3b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc3b40d5220 0x7fc3b406d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54350/0 (socket says 172.21.15.67:54350) 2024-04-16T13:05:09.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 -- 172.21.15.67:0/3934391358 learned_addr learned my addr 172.21.15.67:0/3934391358 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:09.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b9400640 1 --2- 172.21.15.67:0/3934391358 >> v2:172.21.15.82:3300/0 conn(0x7fc3b415eaa0 0x7fc3b40d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 -- 172.21.15.67:0/3934391358 >> v2:172.21.15.82:3300/0 conn(0x7fc3b415eaa0 msgr2=0x7fc3b40d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:09.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 --2- 172.21.15.67:0/3934391358 >> v2:172.21.15.82:3300/0 conn(0x7fc3b415eaa0 0x7fc3b40d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 -- 172.21.15.67:0/3934391358 >> v1:172.21.15.82:6789/0 conn(0x7fc3b406d8a0 legacy=0x7fc3b40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:09.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.470+0000 7fc3b8a00640 1 -- 172.21.15.67:0/3934391358 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b40d02e0 con 0x7fc3b40d5220 2024-04-16T13:05:09.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.471+0000 7fc3b8a00640 1 --2- 172.21.15.67:0/3934391358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b406d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc3b408cfe0 tx=0x7fc3a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40a78b6c6cefdb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3b3e00640 1 -- 172.21.15.67:0/3934391358 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a002e070 con 0x7fc3b40d5220 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3b3e00640 1 -- 172.21.15.67:0/3934391358 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0037070 con 0x7fc3b40d5220 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3b3e00640 1 -- 172.21.15.67:0/3934391358 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0031a00 con 0x7fc3b40d5220 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3ba800640 1 -- 172.21.15.67:0/3934391358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 msgr2=0x7fc3b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3ba800640 1 --2- 172.21.15.67:0/3934391358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b406d360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc3b408cfe0 tx=0x7fc3a002b880 comp rx=0 tx=0).stop 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.472+0000 7fc3ba800640 1 -- 172.21.15.67:0/3934391358 shutdown_connections 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.473+0000 7fc3ba800640 1 --2- 172.21.15.67:0/3934391358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b406d360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.473+0000 7fc3ba800640 1 --2- 172.21.15.67:0/3934391358 >> v2:172.21.15.82:3300/0 conn(0x7fc3b415eaa0 0x7fc3b40d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.473+0000 7fc3ba800640 1 -- 172.21.15.67:0/3934391358 >> 172.21.15.67:0/3934391358 conn(0x7fc3b408c000 msgr2=0x7fc3b40d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.473+0000 7fc3ba800640 1 -- 172.21.15.67:0/3934391358 shutdown_connections 2024-04-16T13:05:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.473+0000 7fc3ba800640 1 -- 172.21.15.67:0/3934391358 wait complete. 2024-04-16T13:05:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.474+0000 7fc3ba800640 1 Processor -- start 2024-04-16T13:05:09.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.475+0000 7fc3ba800640 1 -- start start 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.475+0000 7fc3ba800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b406d8a0 0x7fc3b40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3ba800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3ba800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b415eaa0 0x7fc3b414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3ba800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b415ee80 con 0x7fc3b40d5220 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3ba800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40d08a0 con 0x7fc3b406d8a0 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3ba800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b406ceb0 con 0x7fc3b415eaa0 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54362/0 (socket says 172.21.15.67:54362) 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 -- 172.21.15.67:0/936578509 learned_addr learned my addr 172.21.15.67:0/936578509 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:09.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b9400640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b406d8a0 0x7fc3b40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b9e00640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b415eaa0 0x7fc3b414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 -- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b415eaa0 msgr2=0x7fc3b414a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b415eaa0 0x7fc3b414a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 -- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b406d8a0 msgr2=0x7fc3b40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b406d8a0 0x7fc3b40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.476+0000 7fc3b8a00640 1 -- 172.21.15.67:0/936578509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b40ca560 con 0x7fc3b40d5220 2024-04-16T13:05:09.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3b8a00640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0000c00 tx=0x7fc3a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0032880 con 0x7fc3b40d5220 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0032a40 con 0x7fc3b40d5220 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0032e30 con 0x7fc3b40d5220 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b40cb6a0 con 0x7fc3b40d5220 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.477+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b40cbc60 con 0x7fc3b40d5220 2024-04-16T13:05:09.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.478+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b4075bd0 con 0x7fc3b40d5220 2024-04-16T13:05:09.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.479+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3a004c060 con 0x7fc3b40d5220 2024-04-16T13:05:09.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.481+0000 7fc3b1600640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 0x7fc39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:09.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.481+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3a00ad6f0 con 0x7fc3b40d5220 2024-04-16T13:05:09.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.481+0000 7fc3b9400640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 0x7fc39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:09.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.482+0000 7fc3b9400640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 0x7fc39406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80099c0 tx=0x7fc3a8003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.486+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3a0040070 con 0x7fc3b40d5220 2024-04-16T13:05:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.685+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3b40b4ef0 con 0x7fc39406c8f0 2024-04-16T13:05:09.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.717+0000 7fc3b1600640 1 -- 172.21.15.67:0/936578509 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fc3b40b4ef0 con 0x7fc39406c8f0 2024-04-16T13:05:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:09.725 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:05:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 msgr2=0x7fc39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 0x7fc39406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80099c0 tx=0x7fc3a8003990 comp rx=0 tx=0).stop 2024-04-16T13:05:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 msgr2=0x7fc3b414a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0000c00 tx=0x7fc3a00046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 shutdown_connections 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc39406c8f0 0x7fc39406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3b415eaa0 0x7fc3b414a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3b40d5220 0x7fc3b414a0e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 --2- 172.21.15.67:0/936578509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b406d8a0 0x7fc3b40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 >> 172.21.15.67:0/936578509 conn(0x7fc3b408c000 msgr2=0x7fc3b40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 shutdown_connections 2024-04-16T13:05:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:09.725+0000 7fc3ba800640 1 -- 172.21.15.67:0/936578509 wait complete. 2024-04-16T13:05:09.748 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-16T13:05:08.497008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005619"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.138090+0000","last_change":"2024-04-16T13:04:45.017212+0000","last_active":"2024-04-16T13:04:53.138090+0000","last_peered":"2024-04-16T13:04:53.138090+0000","last_clean":"2024-04-16T13:04:53.138090+0000","last_became_active":"2024-04-16T13:04:45.016908+0000","last_became_peered":"2024-04-16T13:04:45.016908+0000","last_unstale":"2024-04-16T13:04:53.138090+0000","last_undegraded":"2024-04-16T13:04:53.138090+0000","last_fullsized":"2024-04-16T13:04:53.138090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:53:15.736911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141192+0000","last_change":"2024-04-16T13:04:46.029051+0000","last_active":"2024-04-16T13:04:52.141192+0000","last_peered":"2024-04-16T13:04:52.141192+0000","last_clean":"2024-04-16T13:04:52.141192+0000","last_became_active":"2024-04-16T13:04:46.028414+0000","last_became_peered":"2024-04-16T13:04:46.028414+0000","last_unstale":"2024-04-16T13:04:52.141192+0000","last_undegraded":"2024-04-16T13:04:52.141192+0000","last_fullsized":"2024-04-16T13:04:52.141192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140594+0000","last_change":"2024-04-16T13:04:50.716406+0000","last_active":"2024-04-16T13:04:52.140594+0000","last_peered":"2024-04-16T13:04:52.140594+0000","last_clean":"2024-04-16T13:04:52.140594+0000","last_became_active":"2024-04-16T13:04:50.715298+0000","last_became_peered":"2024-04-16T13:04:50.715298+0000","last_unstale":"2024-04-16T13:04:52.140594+0000","last_undegraded":"2024-04-16T13:04:52.140594+0000","last_fullsized":"2024-04-16T13:04:52.140594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:35.233459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141394+0000","last_change":"2024-04-16T13:04:45.011371+0000","last_active":"2024-04-16T13:04:52.141394+0000","last_peered":"2024-04-16T13:04:52.141394+0000","last_clean":"2024-04-16T13:04:52.141394+0000","last_became_active":"2024-04-16T13:04:45.010921+0000","last_became_peered":"2024-04-16T13:04:45.010921+0000","last_unstale":"2024-04-16T13:04:52.141394+0000","last_undegraded":"2024-04-16T13:04:52.141394+0000","last_fullsized":"2024-04-16T13:04:52.141394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137685+0000","last_change":"2024-04-16T13:04:46.010566+0000","last_active":"2024-04-16T13:04:53.137685+0000","last_peered":"2024-04-16T13:04:53.137685+0000","last_clean":"2024-04-16T13:04:53.137685+0000","last_became_active":"2024-04-16T13:04:46.010271+0000","last_became_peered":"2024-04-16T13:04:46.010271+0000","last_unstale":"2024-04-16T13:04:53.137685+0000","last_undegraded":"2024-04-16T13:04:53.137685+0000","last_fullsized":"2024-04-16T13:04:53.137685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141893+0000","last_change":"2024-04-16T13:04:50.172684+0000","last_active":"2024-04-16T13:04:52.141893+0000","last_peered":"2024-04-16T13:04:52.141893+0000","last_clean":"2024-04-16T13:04:52.141893+0000","last_became_active":"2024-04-16T13:04:50.171569+0000","last_became_peered":"2024-04-16T13:04:50.171569+0000","last_unstale":"2024-04-16T13:04:52.141893+0000","last_undegraded":"2024-04-16T13:04:52.141893+0000","last_fullsized":"2024-04-16T13:04:52.141893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525149+0000","last_change":"2024-04-16T13:04:45.024578+0000","last_active":"2024-04-16T13:04:53.525149+0000","last_peered":"2024-04-16T13:04:53.525149+0000","last_clean":"2024-04-16T13:04:53.525149+0000","last_became_active":"2024-04-16T13:04:45.024333+0000","last_became_peered":"2024-04-16T13:04:45.024333+0000","last_unstale":"2024-04-16T13:04:53.525149+0000","last_undegraded":"2024-04-16T13:04:53.525149+0000","last_fullsized":"2024-04-16T13:04:53.525149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129517+0000","last_change":"2024-04-16T13:04:46.009310+0000","last_active":"2024-04-16T13:04:53.129517+0000","last_peered":"2024-04-16T13:04:53.129517+0000","last_clean":"2024-04-16T13:04:53.129517+0000","last_became_active":"2024-04-16T13:04:46.008657+0000","last_became_peered":"2024-04-16T13:04:46.008657+0000","last_unstale":"2024-04-16T13:04:53.129517+0000","last_undegraded":"2024-04-16T13:04:53.129517+0000","last_fullsized":"2024-04-16T13:04:53.129517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143101+0000","last_change":"2024-04-16T13:04:50.166861+0000","last_active":"2024-04-16T13:04:52.143101+0000","last_peered":"2024-04-16T13:04:52.143101+0000","last_clean":"2024-04-16T13:04:52.143101+0000","last_became_active":"2024-04-16T13:04:50.166201+0000","last_became_peered":"2024-04-16T13:04:50.166201+0000","last_unstale":"2024-04-16T13:04:52.143101+0000","last_undegraded":"2024-04-16T13:04:52.143101+0000","last_fullsized":"2024-04-16T13:04:52.143101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526586+0000","last_change":"2024-04-16T13:04:45.022779+0000","last_active":"2024-04-16T13:04:53.526586+0000","last_peered":"2024-04-16T13:04:53.526586+0000","last_clean":"2024-04-16T13:04:53.526586+0000","last_became_active":"2024-04-16T13:04:45.022445+0000","last_became_peered":"2024-04-16T13:04:45.022445+0000","last_unstale":"2024-04-16T13:04:53.526586+0000","last_undegraded":"2024-04-16T13:04:53.526586+0000","last_fullsized":"2024-04-16T13:04:53.526586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:35.238732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129942+0000","last_change":"2024-04-16T13:04:46.008470+0000","last_active":"2024-04-16T13:04:53.129942+0000","last_peered":"2024-04-16T13:04:53.129942+0000","last_clean":"2024-04-16T13:04:53.129942+0000","last_became_active":"2024-04-16T13:04:46.007901+0000","last_became_peered":"2024-04-16T13:04:46.007901+0000","last_unstale":"2024-04-16T13:04:53.129942+0000","last_undegraded":"2024-04-16T13:04:53.129942+0000","last_fullsized":"2024-04-16T13:04:53.129942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142378+0000","last_change":"2024-04-16T13:04:50.163286+0000","last_active":"2024-04-16T13:04:52.142378+0000","last_peered":"2024-04-16T13:04:52.142378+0000","last_clean":"2024-04-16T13:04:52.142378+0000","last_became_active":"2024-04-16T13:04:50.161658+0000","last_became_peered":"2024-04-16T13:04:50.161658+0000","last_unstale":"2024-04-16T13:04:52.142378+0000","last_undegraded":"2024-04-16T13:04:52.142378+0000","last_fullsized":"2024-04-16T13:04:52.142378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015548+0000","last_change":"2024-04-16T13:04:46.014646+0000","last_active":"2024-04-16T13:04:53.015548+0000","last_peered":"2024-04-16T13:04:53.015548+0000","last_clean":"2024-04-16T13:04:53.015548+0000","last_became_active":"2024-04-16T13:04:46.014332+0000","last_became_peered":"2024-04-16T13:04:46.014332+0000","last_unstale":"2024-04-16T13:04:53.015548+0000","last_undegraded":"2024-04-16T13:04:53.015548+0000","last_fullsized":"2024-04-16T13:04:53.015548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525140+0000","last_change":"2024-04-16T13:04:45.018345+0000","last_active":"2024-04-16T13:04:53.525140+0000","last_peered":"2024-04-16T13:04:53.525140+0000","last_clean":"2024-04-16T13:04:53.525140+0000","last_became_active":"2024-04-16T13:04:45.018023+0000","last_became_peered":"2024-04-16T13:04:45.018023+0000","last_unstale":"2024-04-16T13:04:53.525140+0000","last_undegraded":"2024-04-16T13:04:53.525140+0000","last_fullsized":"2024-04-16T13:04:53.525140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144101+0000","last_change":"2024-04-16T13:04:50.166377+0000","last_active":"2024-04-16T13:04:52.144101+0000","last_peered":"2024-04-16T13:04:52.144101+0000","last_clean":"2024-04-16T13:04:52.144101+0000","last_became_active":"2024-04-16T13:04:50.165706+0000","last_became_peered":"2024-04-16T13:04:50.165706+0000","last_unstale":"2024-04-16T13:04:52.144101+0000","last_undegraded":"2024-04-16T13:04:52.144101+0000","last_fullsized":"2024-04-16T13:04:52.144101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140626+0000","last_change":"2024-04-16T13:04:46.004518+0000","last_active":"2024-04-16T13:04:52.140626+0000","last_peered":"2024-04-16T13:04:52.140626+0000","last_clean":"2024-04-16T13:04:52.140626+0000","last_became_active":"2024-04-16T13:04:46.004307+0000","last_became_peered":"2024-04-16T13:04:46.004307+0000","last_unstale":"2024-04-16T13:04:52.140626+0000","last_undegraded":"2024-04-16T13:04:52.140626+0000","last_fullsized":"2024-04-16T13:04:52.140626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137806+0000","last_change":"2024-04-16T13:04:44.994353+0000","last_active":"2024-04-16T13:04:52.137806+0000","last_peered":"2024-04-16T13:04:52.137806+0000","last_clean":"2024-04-16T13:04:52.137806+0000","last_became_active":"2024-04-16T13:04:44.993983+0000","last_became_peered":"2024-04-16T13:04:44.993983+0000","last_unstale":"2024-04-16T13:04:52.137806+0000","last_undegraded":"2024-04-16T13:04:52.137806+0000","last_fullsized":"2024-04-16T13:04:52.137806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144015+0000","last_change":"2024-04-16T13:04:50.172131+0000","last_active":"2024-04-16T13:04:52.144015+0000","last_peered":"2024-04-16T13:04:52.144015+0000","last_clean":"2024-04-16T13:04:52.144015+0000","last_became_active":"2024-04-16T13:04:50.171610+0000","last_became_peered":"2024-04-16T13:04:50.171610+0000","last_unstale":"2024-04-16T13:04:52.144015+0000","last_undegraded":"2024-04-16T13:04:52.144015+0000","last_fullsized":"2024-04-16T13:04:52.144015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140915+0000","last_change":"2024-04-16T13:04:46.006324+0000","last_active":"2024-04-16T13:04:52.140915+0000","last_peered":"2024-04-16T13:04:52.140915+0000","last_clean":"2024-04-16T13:04:52.140915+0000","last_became_active":"2024-04-16T13:04:46.005807+0000","last_became_peered":"2024-04-16T13:04:46.005807+0000","last_unstale":"2024-04-16T13:04:52.140915+0000","last_undegraded":"2024-04-16T13:04:52.140915+0000","last_fullsized":"2024-04-16T13:04:52.140915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137099+0000","last_change":"2024-04-16T13:04:45.000438+0000","last_active":"2024-04-16T13:04:52.137099+0000","last_peered":"2024-04-16T13:04:52.137099+0000","last_clean":"2024-04-16T13:04:52.137099+0000","last_became_active":"2024-04-16T13:04:45.000089+0000","last_became_peered":"2024-04-16T13:04:45.000089+0000","last_unstale":"2024-04-16T13:04:52.137099+0000","last_undegraded":"2024-04-16T13:04:52.137099+0000","last_fullsized":"2024-04-16T13:04:52.137099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139470+0000","last_change":"2024-04-16T13:04:50.711220+0000","last_active":"2024-04-16T13:04:52.139470+0000","last_peered":"2024-04-16T13:04:52.139470+0000","last_clean":"2024-04-16T13:04:52.139470+0000","last_became_active":"2024-04-16T13:04:50.709851+0000","last_became_peered":"2024-04-16T13:04:50.709851+0000","last_unstale":"2024-04-16T13:04:52.139470+0000","last_undegraded":"2024-04-16T13:04:52.139470+0000","last_fullsized":"2024-04-16T13:04:52.139470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142413+0000","last_change":"2024-04-16T13:04:46.003322+0000","last_active":"2024-04-16T13:04:52.142413+0000","last_peered":"2024-04-16T13:04:52.142413+0000","last_clean":"2024-04-16T13:04:52.142413+0000","last_became_active":"2024-04-16T13:04:46.003054+0000","last_became_peered":"2024-04-16T13:04:46.003054+0000","last_unstale":"2024-04-16T13:04:52.142413+0000","last_undegraded":"2024-04-16T13:04:52.142413+0000","last_fullsized":"2024-04-16T13:04:52.142413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:20.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525718+0000","last_change":"2024-04-16T13:04:45.017508+0000","last_active":"2024-04-16T13:04:53.525718+0000","last_peered":"2024-04-16T13:04:53.525718+0000","last_clean":"2024-04-16T13:04:53.525718+0000","last_became_active":"2024-04-16T13:04:45.017191+0000","last_became_peered":"2024-04-16T13:04:45.017191+0000","last_unstale":"2024-04-16T13:04:53.525718+0000","last_undegraded":"2024-04-16T13:04:53.525718+0000","last_fullsized":"2024-04-16T13:04:53.525718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143665+0000","last_change":"2024-04-16T13:04:50.172094+0000","last_active":"2024-04-16T13:04:52.143665+0000","last_peered":"2024-04-16T13:04:52.143665+0000","last_clean":"2024-04-16T13:04:52.143665+0000","last_became_active":"2024-04-16T13:04:50.171583+0000","last_became_peered":"2024-04-16T13:04:50.171583+0000","last_unstale":"2024-04-16T13:04:52.143665+0000","last_undegraded":"2024-04-16T13:04:52.143665+0000","last_fullsized":"2024-04-16T13:04:52.143665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137578+0000","last_change":"2024-04-16T13:04:46.006452+0000","last_active":"2024-04-16T13:04:53.137578+0000","last_peered":"2024-04-16T13:04:53.137578+0000","last_clean":"2024-04-16T13:04:53.137578+0000","last_became_active":"2024-04-16T13:04:46.006110+0000","last_became_peered":"2024-04-16T13:04:46.006110+0000","last_unstale":"2024-04-16T13:04:53.137578+0000","last_undegraded":"2024-04-16T13:04:53.137578+0000","last_fullsized":"2024-04-16T13:04:53.137578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016559+0000","last_change":"2024-04-16T13:04:45.017007+0000","last_active":"2024-04-16T13:04:53.016559+0000","last_peered":"2024-04-16T13:04:53.016559+0000","last_clean":"2024-04-16T13:04:53.016559+0000","last_became_active":"2024-04-16T13:04:45.016628+0000","last_became_peered":"2024-04-16T13:04:45.016628+0000","last_unstale":"2024-04-16T13:04:53.016559+0000","last_undegraded":"2024-04-16T13:04:53.016559+0000","last_fullsized":"2024-04-16T13:04:53.016559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141982+0000","last_change":"2024-04-16T13:04:50.714894+0000","last_active":"2024-04-16T13:04:52.141982+0000","last_peered":"2024-04-16T13:04:52.141982+0000","last_clean":"2024-04-16T13:04:52.141982+0000","last_became_active":"2024-04-16T13:04:50.707478+0000","last_became_peered":"2024-04-16T13:04:50.707478+0000","last_unstale":"2024-04-16T13:04:52.141982+0000","last_undegraded":"2024-04-16T13:04:52.141982+0000","last_fullsized":"2024-04-16T13:04:52.141982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141377+0000","last_change":"2024-04-16T13:04:45.998408+0000","last_active":"2024-04-16T13:04:52.141377+0000","last_peered":"2024-04-16T13:04:52.141377+0000","last_clean":"2024-04-16T13:04:52.141377+0000","last_became_active":"2024-04-16T13:04:45.998086+0000","last_became_peered":"2024-04-16T13:04:45.998086+0000","last_unstale":"2024-04-16T13:04:52.141377+0000","last_undegraded":"2024-04-16T13:04:52.141377+0000","last_fullsized":"2024-04-16T13:04:52.141377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139111+0000","last_change":"2024-04-16T13:04:45.006718+0000","last_active":"2024-04-16T13:04:52.139111+0000","last_peered":"2024-04-16T13:04:52.139111+0000","last_clean":"2024-04-16T13:04:52.139111+0000","last_became_active":"2024-04-16T13:04:45.006418+0000","last_became_peered":"2024-04-16T13:04:45.006418+0000","last_unstale":"2024-04-16T13:04:52.139111+0000","last_undegraded":"2024-04-16T13:04:52.139111+0000","last_fullsized":"2024-04-16T13:04:52.139111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140164+0000","last_change":"2024-04-16T13:04:50.699284+0000","last_active":"2024-04-16T13:04:52.140164+0000","last_peered":"2024-04-16T13:04:52.140164+0000","last_clean":"2024-04-16T13:04:52.140164+0000","last_became_active":"2024-04-16T13:04:50.696999+0000","last_became_peered":"2024-04-16T13:04:50.696999+0000","last_unstale":"2024-04-16T13:04:52.140164+0000","last_undegraded":"2024-04-16T13:04:52.140164+0000","last_fullsized":"2024-04-16T13:04:52.140164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:47:43.788831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138077+0000","last_change":"2024-04-16T13:04:45.996654+0000","last_active":"2024-04-16T13:04:52.138077+0000","last_peered":"2024-04-16T13:04:52.138077+0000","last_clean":"2024-04-16T13:04:52.138077+0000","last_became_active":"2024-04-16T13:04:45.996251+0000","last_became_peered":"2024-04-16T13:04:45.996251+0000","last_unstale":"2024-04-16T13:04:52.138077+0000","last_undegraded":"2024-04-16T13:04:52.138077+0000","last_fullsized":"2024-04-16T13:04:52.138077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527291+0000","last_change":"2024-04-16T13:04:45.018375+0000","last_active":"2024-04-16T13:04:53.527291+0000","last_peered":"2024-04-16T13:04:53.527291+0000","last_clean":"2024-04-16T13:04:53.527291+0000","last_became_active":"2024-04-16T13:04:45.018125+0000","last_became_peered":"2024-04-16T13:04:45.018125+0000","last_unstale":"2024-04-16T13:04:53.527291+0000","last_undegraded":"2024-04-16T13:04:53.527291+0000","last_fullsized":"2024-04-16T13:04:53.527291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:38.002313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137111+0000","last_change":"2024-04-16T13:04:50.698690+0000","last_active":"2024-04-16T13:04:53.137111+0000","last_peered":"2024-04-16T13:04:53.137111+0000","last_clean":"2024-04-16T13:04:53.137111+0000","last_became_active":"2024-04-16T13:04:50.697358+0000","last_became_peered":"2024-04-16T13:04:50.697358+0000","last_unstale":"2024-04-16T13:04:53.137111+0000","last_undegraded":"2024-04-16T13:04:53.137111+0000","last_fullsized":"2024-04-16T13:04:53.137111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130111+0000","last_change":"2024-04-16T13:04:46.007829+0000","last_active":"2024-04-16T13:04:53.130111+0000","last_peered":"2024-04-16T13:04:53.130111+0000","last_clean":"2024-04-16T13:04:53.130111+0000","last_became_active":"2024-04-16T13:04:46.007537+0000","last_became_peered":"2024-04-16T13:04:46.007537+0000","last_unstale":"2024-04-16T13:04:53.130111+0000","last_undegraded":"2024-04-16T13:04:53.130111+0000","last_fullsized":"2024-04-16T13:04:53.130111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138200+0000","last_change":"2024-04-16T13:04:45.008507+0000","last_active":"2024-04-16T13:04:52.138200+0000","last_peered":"2024-04-16T13:04:52.138200+0000","last_clean":"2024-04-16T13:04:52.138200+0000","last_became_active":"2024-04-16T13:04:45.008217+0000","last_became_peered":"2024-04-16T13:04:45.008217+0000","last_unstale":"2024-04-16T13:04:52.138200+0000","last_undegraded":"2024-04-16T13:04:52.138200+0000","last_fullsized":"2024-04-16T13:04:52.138200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137403+0000","last_change":"2024-04-16T13:04:50.167171+0000","last_active":"2024-04-16T13:04:52.137403+0000","last_peered":"2024-04-16T13:04:52.137403+0000","last_clean":"2024-04-16T13:04:52.137403+0000","last_became_active":"2024-04-16T13:04:50.164681+0000","last_became_peered":"2024-04-16T13:04:50.164681+0000","last_unstale":"2024-04-16T13:04:52.137403+0000","last_undegraded":"2024-04-16T13:04:52.137403+0000","last_fullsized":"2024-04-16T13:04:52.137403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143872+0000","last_change":"2024-04-16T13:04:46.021438+0000","last_active":"2024-04-16T13:04:52.143872+0000","last_peered":"2024-04-16T13:04:52.143872+0000","last_clean":"2024-04-16T13:04:52.143872+0000","last_became_active":"2024-04-16T13:04:46.021184+0000","last_became_peered":"2024-04-16T13:04:46.021184+0000","last_unstale":"2024-04-16T13:04:52.143872+0000","last_undegraded":"2024-04-16T13:04:52.143872+0000","last_fullsized":"2024-04-16T13:04:52.143872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.055670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127965+0000","last_change":"2024-04-16T13:04:45.014922+0000","last_active":"2024-04-16T13:04:53.127965+0000","last_peered":"2024-04-16T13:04:53.127965+0000","last_clean":"2024-04-16T13:04:53.127965+0000","last_became_active":"2024-04-16T13:04:45.014037+0000","last_became_peered":"2024-04-16T13:04:45.014037+0000","last_unstale":"2024-04-16T13:04:53.127965+0000","last_undegraded":"2024-04-16T13:04:53.127965+0000","last_fullsized":"2024-04-16T13:04:53.127965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138224+0000","last_change":"2024-04-16T13:04:50.172451+0000","last_active":"2024-04-16T13:04:52.138224+0000","last_peered":"2024-04-16T13:04:52.138224+0000","last_clean":"2024-04-16T13:04:52.138224+0000","last_became_active":"2024-04-16T13:04:50.171709+0000","last_became_peered":"2024-04-16T13:04:50.171709+0000","last_unstale":"2024-04-16T13:04:52.138224+0000","last_undegraded":"2024-04-16T13:04:52.138224+0000","last_fullsized":"2024-04-16T13:04:52.138224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136931+0000","last_change":"2024-04-16T13:04:45.990241+0000","last_active":"2024-04-16T13:04:52.136931+0000","last_peered":"2024-04-16T13:04:52.136931+0000","last_clean":"2024-04-16T13:04:52.136931+0000","last_became_active":"2024-04-16T13:04:45.989713+0000","last_became_peered":"2024-04-16T13:04:45.989713+0000","last_unstale":"2024-04-16T13:04:52.136931+0000","last_undegraded":"2024-04-16T13:04:52.136931+0000","last_fullsized":"2024-04-16T13:04:52.136931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017464+0000","last_change":"2024-04-16T13:04:44.999454+0000","last_active":"2024-04-16T13:04:53.017464+0000","last_peered":"2024-04-16T13:04:53.017464+0000","last_clean":"2024-04-16T13:04:53.017464+0000","last_became_active":"2024-04-16T13:04:44.999166+0000","last_became_peered":"2024-04-16T13:04:44.999166+0000","last_unstale":"2024-04-16T13:04:53.017464+0000","last_undegraded":"2024-04-16T13:04:53.017464+0000","last_fullsized":"2024-04-16T13:04:53.017464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139649+0000","last_change":"2024-04-16T13:04:50.166374+0000","last_active":"2024-04-16T13:04:52.139649+0000","last_peered":"2024-04-16T13:04:52.139649+0000","last_clean":"2024-04-16T13:04:52.139649+0000","last_became_active":"2024-04-16T13:04:50.166029+0000","last_became_peered":"2024-04-16T13:04:50.166029+0000","last_unstale":"2024-04-16T13:04:52.139649+0000","last_undegraded":"2024-04-16T13:04:52.139649+0000","last_fullsized":"2024-04-16T13:04:52.139649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136502+0000","last_change":"2024-04-16T13:04:46.013116+0000","last_active":"2024-04-16T13:04:53.136502+0000","last_peered":"2024-04-16T13:04:53.136502+0000","last_clean":"2024-04-16T13:04:53.136502+0000","last_became_active":"2024-04-16T13:04:46.012724+0000","last_became_peered":"2024-04-16T13:04:46.012724+0000","last_unstale":"2024-04-16T13:04:53.136502+0000","last_undegraded":"2024-04-16T13:04:53.136502+0000","last_fullsized":"2024-04-16T13:04:53.136502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525117+0000","last_change":"2024-04-16T13:04:45.022061+0000","last_active":"2024-04-16T13:04:53.525117+0000","last_peered":"2024-04-16T13:04:53.525117+0000","last_clean":"2024-04-16T13:04:53.525117+0000","last_became_active":"2024-04-16T13:04:45.021784+0000","last_became_peered":"2024-04-16T13:04:45.021784+0000","last_unstale":"2024-04-16T13:04:53.525117+0000","last_undegraded":"2024-04-16T13:04:53.525117+0000","last_fullsized":"2024-04-16T13:04:53.525117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137504+0000","last_change":"2024-04-16T13:04:50.698726+0000","last_active":"2024-04-16T13:04:53.137504+0000","last_peered":"2024-04-16T13:04:53.137504+0000","last_clean":"2024-04-16T13:04:53.137504+0000","last_became_active":"2024-04-16T13:04:50.697335+0000","last_became_peered":"2024-04-16T13:04:50.697335+0000","last_unstale":"2024-04-16T13:04:53.137504+0000","last_undegraded":"2024-04-16T13:04:53.137504+0000","last_fullsized":"2024-04-16T13:04:53.137504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140431+0000","last_change":"2024-04-16T13:04:46.007441+0000","last_active":"2024-04-16T13:04:52.140431+0000","last_peered":"2024-04-16T13:04:52.140431+0000","last_clean":"2024-04-16T13:04:52.140431+0000","last_became_active":"2024-04-16T13:04:46.006232+0000","last_became_peered":"2024-04-16T13:04:46.006232+0000","last_unstale":"2024-04-16T13:04:52.140431+0000","last_undegraded":"2024-04-16T13:04:52.140431+0000","last_fullsized":"2024-04-16T13:04:52.140431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129402+0000","last_change":"2024-04-16T13:04:45.014153+0000","last_active":"2024-04-16T13:04:53.129402+0000","last_peered":"2024-04-16T13:04:53.129402+0000","last_clean":"2024-04-16T13:04:53.129402+0000","last_became_active":"2024-04-16T13:04:45.012884+0000","last_became_peered":"2024-04-16T13:04:45.012884+0000","last_unstale":"2024-04-16T13:04:53.129402+0000","last_undegraded":"2024-04-16T13:04:53.129402+0000","last_fullsized":"2024-04-16T13:04:53.129402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525920+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:04:53.525920+0000","last_peered":"2024-04-16T13:04:53.525920+0000","last_clean":"2024-04-16T13:04:53.525920+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:04:53.525920+0000","last_undegraded":"2024-04-16T13:04:53.525920+0000","last_fullsized":"2024-04-16T13:04:53.525920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017152+0000","last_change":"2024-04-16T13:04:50.706193+0000","last_active":"2024-04-16T13:04:53.017152+0000","last_peered":"2024-04-16T13:04:53.017152+0000","last_clean":"2024-04-16T13:04:53.017152+0000","last_became_active":"2024-04-16T13:04:50.705129+0000","last_became_peered":"2024-04-16T13:04:50.705129+0000","last_unstale":"2024-04-16T13:04:53.017152+0000","last_undegraded":"2024-04-16T13:04:53.017152+0000","last_fullsized":"2024-04-16T13:04:53.017152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526940+0000","last_change":"2024-04-16T13:04:46.010068+0000","last_active":"2024-04-16T13:04:53.526940+0000","last_peered":"2024-04-16T13:04:53.526940+0000","last_clean":"2024-04-16T13:04:53.526940+0000","last_became_active":"2024-04-16T13:04:46.009661+0000","last_became_peered":"2024-04-16T13:04:46.009661+0000","last_unstale":"2024-04-16T13:04:53.526940+0000","last_undegraded":"2024-04-16T13:04:53.526940+0000","last_fullsized":"2024-04-16T13:04:53.526940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018774+0000","last_change":"2024-04-16T13:04:45.009675+0000","last_active":"2024-04-16T13:04:53.018774+0000","last_peered":"2024-04-16T13:04:53.018774+0000","last_clean":"2024-04-16T13:04:53.018774+0000","last_became_active":"2024-04-16T13:04:45.009208+0000","last_became_peered":"2024-04-16T13:04:45.009208+0000","last_unstale":"2024-04-16T13:04:53.018774+0000","last_undegraded":"2024-04-16T13:04:53.018774+0000","last_fullsized":"2024-04-16T13:04:53.018774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015724+0000","last_change":"2024-04-16T13:04:50.700561+0000","last_active":"2024-04-16T13:04:53.015724+0000","last_peered":"2024-04-16T13:04:53.015724+0000","last_clean":"2024-04-16T13:04:53.015724+0000","last_became_active":"2024-04-16T13:04:50.697511+0000","last_became_peered":"2024-04-16T13:04:50.697511+0000","last_unstale":"2024-04-16T13:04:53.015724+0000","last_undegraded":"2024-04-16T13:04:53.015724+0000","last_fullsized":"2024-04-16T13:04:53.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129832+0000","last_change":"2024-04-16T13:04:46.008012+0000","last_active":"2024-04-16T13:04:53.129832+0000","last_peered":"2024-04-16T13:04:53.129832+0000","last_clean":"2024-04-16T13:04:53.129832+0000","last_became_active":"2024-04-16T13:04:46.007687+0000","last_became_peered":"2024-04-16T13:04:46.007687+0000","last_unstale":"2024-04-16T13:04:53.129832+0000","last_undegraded":"2024-04-16T13:04:53.129832+0000","last_fullsized":"2024-04-16T13:04:53.129832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138728+0000","last_change":"2024-04-16T13:04:45.003115+0000","last_active":"2024-04-16T13:04:52.138728+0000","last_peered":"2024-04-16T13:04:52.138728+0000","last_clean":"2024-04-16T13:04:52.138728+0000","last_became_active":"2024-04-16T13:04:45.002827+0000","last_became_peered":"2024-04-16T13:04:45.002827+0000","last_unstale":"2024-04-16T13:04:52.138728+0000","last_undegraded":"2024-04-16T13:04:52.138728+0000","last_fullsized":"2024-04-16T13:04:52.138728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137007+0000","last_change":"2024-04-16T13:04:50.170429+0000","last_active":"2024-04-16T13:04:53.137007+0000","last_peered":"2024-04-16T13:04:53.137007+0000","last_clean":"2024-04-16T13:04:53.137007+0000","last_became_active":"2024-04-16T13:04:50.168276+0000","last_became_peered":"2024-04-16T13:04:50.168276+0000","last_unstale":"2024-04-16T13:04:53.137007+0000","last_undegraded":"2024-04-16T13:04:53.137007+0000","last_fullsized":"2024-04-16T13:04:53.137007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527648+0000","last_change":"2024-04-16T13:04:45.996001+0000","last_active":"2024-04-16T13:04:53.527648+0000","last_peered":"2024-04-16T13:04:53.527648+0000","last_clean":"2024-04-16T13:04:53.527648+0000","last_became_active":"2024-04-16T13:04:45.994462+0000","last_became_peered":"2024-04-16T13:04:45.994462+0000","last_unstale":"2024-04-16T13:04:53.527648+0000","last_undegraded":"2024-04-16T13:04:53.527648+0000","last_fullsized":"2024-04-16T13:04:53.527648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:14.137296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017648+0000","last_change":"2024-04-16T13:04:45.001424+0000","last_active":"2024-04-16T13:04:53.017648+0000","last_peered":"2024-04-16T13:04:53.017648+0000","last_clean":"2024-04-16T13:04:53.017648+0000","last_became_active":"2024-04-16T13:04:45.001151+0000","last_became_peered":"2024-04-16T13:04:45.001151+0000","last_unstale":"2024-04-16T13:04:53.017648+0000","last_undegraded":"2024-04-16T13:04:53.017648+0000","last_fullsized":"2024-04-16T13:04:53.017648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128506+0000","last_change":"2024-04-16T13:04:50.711246+0000","last_active":"2024-04-16T13:04:53.128506+0000","last_peered":"2024-04-16T13:04:53.128506+0000","last_clean":"2024-04-16T13:04:53.128506+0000","last_became_active":"2024-04-16T13:04:50.704394+0000","last_became_peered":"2024-04-16T13:04:50.704394+0000","last_unstale":"2024-04-16T13:04:53.128506+0000","last_undegraded":"2024-04-16T13:04:53.128506+0000","last_fullsized":"2024-04-16T13:04:53.128506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:15.746451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526983+0000","last_change":"2024-04-16T13:04:45.985184+0000","last_active":"2024-04-16T13:04:53.526983+0000","last_peered":"2024-04-16T13:04:53.526983+0000","last_clean":"2024-04-16T13:04:53.526983+0000","last_became_active":"2024-04-16T13:04:45.984518+0000","last_became_peered":"2024-04-16T13:04:45.984518+0000","last_unstale":"2024-04-16T13:04:53.526983+0000","last_undegraded":"2024-04-16T13:04:53.526983+0000","last_fullsized":"2024-04-16T13:04:53.526983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144199+0000","last_change":"2024-04-16T13:04:45.009363+0000","last_active":"2024-04-16T13:04:52.144199+0000","last_peered":"2024-04-16T13:04:52.144199+0000","last_clean":"2024-04-16T13:04:52.144199+0000","last_became_active":"2024-04-16T13:04:45.008983+0000","last_became_peered":"2024-04-16T13:04:45.008983+0000","last_unstale":"2024-04-16T13:04:52.144199+0000","last_undegraded":"2024-04-16T13:04:52.144199+0000","last_fullsized":"2024-04-16T13:04:52.144199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:08:10.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141720+0000","last_change":"2024-04-16T13:04:50.166542+0000","last_active":"2024-04-16T13:04:52.141720+0000","last_peered":"2024-04-16T13:04:52.141720+0000","last_clean":"2024-04-16T13:04:52.141720+0000","last_became_active":"2024-04-16T13:04:50.166094+0000","last_became_peered":"2024-04-16T13:04:50.166094+0000","last_unstale":"2024-04-16T13:04:52.141720+0000","last_undegraded":"2024-04-16T13:04:52.141720+0000","last_fullsized":"2024-04-16T13:04:52.141720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:03.750621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526209+0000","last_change":"2024-04-16T13:04:45.985012+0000","last_active":"2024-04-16T13:04:53.526209+0000","last_peered":"2024-04-16T13:04:53.526209+0000","last_clean":"2024-04-16T13:04:53.526209+0000","last_became_active":"2024-04-16T13:04:45.984021+0000","last_became_peered":"2024-04-16T13:04:45.984021+0000","last_unstale":"2024-04-16T13:04:53.526209+0000","last_undegraded":"2024-04-16T13:04:53.526209+0000","last_fullsized":"2024-04-16T13:04:53.526209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017519+0000","last_change":"2024-04-16T13:04:44.997650+0000","last_active":"2024-04-16T13:04:53.017519+0000","last_peered":"2024-04-16T13:04:53.017519+0000","last_clean":"2024-04-16T13:04:53.017519+0000","last_became_active":"2024-04-16T13:04:44.997334+0000","last_became_peered":"2024-04-16T13:04:44.997334+0000","last_unstale":"2024-04-16T13:04:53.017519+0000","last_undegraded":"2024-04-16T13:04:53.017519+0000","last_fullsized":"2024-04-16T13:04:53.017519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137461+0000","last_change":"2024-04-16T13:04:50.161820+0000","last_active":"2024-04-16T13:04:53.137461+0000","last_peered":"2024-04-16T13:04:53.137461+0000","last_clean":"2024-04-16T13:04:53.137461+0000","last_became_active":"2024-04-16T13:04:50.161334+0000","last_became_peered":"2024-04-16T13:04:50.161334+0000","last_unstale":"2024-04-16T13:04:53.137461+0000","last_undegraded":"2024-04-16T13:04:53.137461+0000","last_fullsized":"2024-04-16T13:04:53.137461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015516+0000","last_change":"2024-04-16T13:04:46.002411+0000","last_active":"2024-04-16T13:04:53.015516+0000","last_peered":"2024-04-16T13:04:53.015516+0000","last_clean":"2024-04-16T13:04:53.015516+0000","last_became_active":"2024-04-16T13:04:46.002107+0000","last_became_peered":"2024-04-16T13:04:46.002107+0000","last_unstale":"2024-04-16T13:04:53.015516+0000","last_undegraded":"2024-04-16T13:04:53.015516+0000","last_fullsized":"2024-04-16T13:04:53.015516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.014730+0000","last_change":"2024-04-16T13:04:45.013545+0000","last_active":"2024-04-16T13:04:53.014730+0000","last_peered":"2024-04-16T13:04:53.014730+0000","last_clean":"2024-04-16T13:04:53.014730+0000","last_became_active":"2024-04-16T13:04:45.013202+0000","last_became_peered":"2024-04-16T13:04:45.013202+0000","last_unstale":"2024-04-16T13:04:53.014730+0000","last_undegraded":"2024-04-16T13:04:53.014730+0000","last_fullsized":"2024-04-16T13:04:53.014730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141020+0000","last_change":"2024-04-16T13:04:50.708122+0000","last_active":"2024-04-16T13:04:52.141020+0000","last_peered":"2024-04-16T13:04:52.141020+0000","last_clean":"2024-04-16T13:04:52.141020+0000","last_became_active":"2024-04-16T13:04:50.706711+0000","last_became_peered":"2024-04-16T13:04:50.706711+0000","last_unstale":"2024-04-16T13:04:52.141020+0000","last_undegraded":"2024-04-16T13:04:52.141020+0000","last_fullsized":"2024-04-16T13:04:52.141020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:34.429700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526079+0000","last_change":"2024-04-16T13:04:45.988616+0000","last_active":"2024-04-16T13:04:53.526079+0000","last_peered":"2024-04-16T13:04:53.526079+0000","last_clean":"2024-04-16T13:04:53.526079+0000","last_became_active":"2024-04-16T13:04:45.986360+0000","last_became_peered":"2024-04-16T13:04:45.986360+0000","last_unstale":"2024-04-16T13:04:53.526079+0000","last_undegraded":"2024-04-16T13:04:53.526079+0000","last_fullsized":"2024-04-16T13:04:53.526079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127989+0000","last_change":"2024-04-16T13:04:45.014011+0000","last_active":"2024-04-16T13:04:53.127989+0000","last_peered":"2024-04-16T13:04:53.127989+0000","last_clean":"2024-04-16T13:04:53.127989+0000","last_became_active":"2024-04-16T13:04:45.013245+0000","last_became_peered":"2024-04-16T13:04:45.013245+0000","last_unstale":"2024-04-16T13:04:53.127989+0000","last_undegraded":"2024-04-16T13:04:53.127989+0000","last_fullsized":"2024-04-16T13:04:53.127989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141019+0000","last_change":"2024-04-16T13:04:50.699221+0000","last_active":"2024-04-16T13:04:52.141019+0000","last_peered":"2024-04-16T13:04:52.141019+0000","last_clean":"2024-04-16T13:04:52.141019+0000","last_became_active":"2024-04-16T13:04:50.697803+0000","last_became_peered":"2024-04-16T13:04:50.697803+0000","last_unstale":"2024-04-16T13:04:52.141019+0000","last_undegraded":"2024-04-16T13:04:52.141019+0000","last_fullsized":"2024-04-16T13:04:52.141019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:55.380620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136601+0000","last_change":"2024-04-16T13:04:46.012519+0000","last_active":"2024-04-16T13:04:53.136601+0000","last_peered":"2024-04-16T13:04:53.136601+0000","last_clean":"2024-04-16T13:04:53.136601+0000","last_became_active":"2024-04-16T13:04:46.001053+0000","last_became_peered":"2024-04-16T13:04:46.001053+0000","last_unstale":"2024-04-16T13:04:53.136601+0000","last_undegraded":"2024-04-16T13:04:53.136601+0000","last_fullsized":"2024-04-16T13:04:53.136601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.135925+0000","last_change":"2024-04-16T13:04:45.008591+0000","last_active":"2024-04-16T13:04:53.135925+0000","last_peered":"2024-04-16T13:04:53.135925+0000","last_clean":"2024-04-16T13:04:53.135925+0000","last_became_active":"2024-04-16T13:04:45.008078+0000","last_became_peered":"2024-04-16T13:04:45.008078+0000","last_unstale":"2024-04-16T13:04:53.135925+0000","last_undegraded":"2024-04-16T13:04:53.135925+0000","last_fullsized":"2024-04-16T13:04:53.135925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130019+0000","last_change":"2024-04-16T13:04:50.705924+0000","last_active":"2024-04-16T13:04:53.130019+0000","last_peered":"2024-04-16T13:04:53.130019+0000","last_clean":"2024-04-16T13:04:53.130019+0000","last_became_active":"2024-04-16T13:04:50.704821+0000","last_became_peered":"2024-04-16T13:04:50.704821+0000","last_unstale":"2024-04-16T13:04:53.130019+0000","last_undegraded":"2024-04-16T13:04:53.130019+0000","last_fullsized":"2024-04-16T13:04:53.130019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:11.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526614+0000","last_change":"2024-04-16T13:04:45.998493+0000","last_active":"2024-04-16T13:04:53.526614+0000","last_peered":"2024-04-16T13:04:53.526614+0000","last_clean":"2024-04-16T13:04:53.526614+0000","last_became_active":"2024-04-16T13:04:45.998193+0000","last_became_peered":"2024-04-16T13:04:45.998193+0000","last_unstale":"2024-04-16T13:04:53.526614+0000","last_undegraded":"2024-04-16T13:04:53.526614+0000","last_fullsized":"2024-04-16T13:04:53.526614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:58.423993+0000","last_change":"2024-04-16T13:04:45.015482+0000","last_active":"2024-04-16T13:04:58.423993+0000","last_peered":"2024-04-16T13:04:58.423993+0000","last_clean":"2024-04-16T13:04:58.423993+0000","last_became_active":"2024-04-16T13:04:45.015101+0000","last_became_peered":"2024-04-16T13:04:45.015101+0000","last_unstale":"2024-04-16T13:04:58.423993+0000","last_undegraded":"2024-04-16T13:04:58.423993+0000","last_fullsized":"2024-04-16T13:04:58.423993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137698+0000","last_change":"2024-04-16T13:04:50.167914+0000","last_active":"2024-04-16T13:04:52.137698+0000","last_peered":"2024-04-16T13:04:52.137698+0000","last_clean":"2024-04-16T13:04:52.137698+0000","last_became_active":"2024-04-16T13:04:50.167516+0000","last_became_peered":"2024-04-16T13:04:50.167516+0000","last_unstale":"2024-04-16T13:04:52.137698+0000","last_undegraded":"2024-04-16T13:04:52.137698+0000","last_fullsized":"2024-04-16T13:04:52.137698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143485+0000","last_change":"2024-04-16T13:04:45.990047+0000","last_active":"2024-04-16T13:04:52.143485+0000","last_peered":"2024-04-16T13:04:52.143485+0000","last_clean":"2024-04-16T13:04:52.143485+0000","last_became_active":"2024-04-16T13:04:45.989544+0000","last_became_peered":"2024-04-16T13:04:45.989544+0000","last_unstale":"2024-04-16T13:04:52.143485+0000","last_undegraded":"2024-04-16T13:04:52.143485+0000","last_fullsized":"2024-04-16T13:04:52.143485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:41.080920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138591+0000","last_change":"2024-04-16T13:04:45.016272+0000","last_active":"2024-04-16T13:04:52.138591+0000","last_peered":"2024-04-16T13:04:52.138591+0000","last_clean":"2024-04-16T13:04:52.138591+0000","last_became_active":"2024-04-16T13:04:45.015942+0000","last_became_peered":"2024-04-16T13:04:45.015942+0000","last_unstale":"2024-04-16T13:04:52.138591+0000","last_undegraded":"2024-04-16T13:04:52.138591+0000","last_fullsized":"2024-04-16T13:04:52.138591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142942+0000","last_change":"2024-04-16T13:04:50.167454+0000","last_active":"2024-04-16T13:04:52.142942+0000","last_peered":"2024-04-16T13:04:52.142942+0000","last_clean":"2024-04-16T13:04:52.142942+0000","last_became_active":"2024-04-16T13:04:50.166243+0000","last_became_peered":"2024-04-16T13:04:50.166243+0000","last_unstale":"2024-04-16T13:04:52.142942+0000","last_undegraded":"2024-04-16T13:04:52.142942+0000","last_fullsized":"2024-04-16T13:04:52.142942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:44.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137930+0000","last_change":"2024-04-16T13:04:46.010441+0000","last_active":"2024-04-16T13:04:53.137930+0000","last_peered":"2024-04-16T13:04:53.137930+0000","last_clean":"2024-04-16T13:04:53.137930+0000","last_became_active":"2024-04-16T13:04:46.010071+0000","last_became_peered":"2024-04-16T13:04:46.010071+0000","last_unstale":"2024-04-16T13:04:53.137930+0000","last_undegraded":"2024-04-16T13:04:53.137930+0000","last_fullsized":"2024-04-16T13:04:53.137930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127981+0000","last_change":"2024-04-16T13:04:45.019809+0000","last_active":"2024-04-16T13:04:53.127981+0000","last_peered":"2024-04-16T13:04:53.127981+0000","last_clean":"2024-04-16T13:04:53.127981+0000","last_became_active":"2024-04-16T13:04:45.019299+0000","last_became_peered":"2024-04-16T13:04:45.019299+0000","last_unstale":"2024-04-16T13:04:53.127981+0000","last_undegraded":"2024-04-16T13:04:53.127981+0000","last_fullsized":"2024-04-16T13:04:53.127981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140403+0000","last_change":"2024-04-16T13:04:50.164233+0000","last_active":"2024-04-16T13:04:52.140403+0000","last_peered":"2024-04-16T13:04:52.140403+0000","last_clean":"2024-04-16T13:04:52.140403+0000","last_became_active":"2024-04-16T13:04:50.161088+0000","last_became_peered":"2024-04-16T13:04:50.161088+0000","last_unstale":"2024-04-16T13:04:52.140403+0000","last_undegraded":"2024-04-16T13:04:52.140403+0000","last_fullsized":"2024-04-16T13:04:52.140403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:52:19.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130074+0000","last_change":"2024-04-16T13:04:46.009061+0000","last_active":"2024-04-16T13:04:53.130074+0000","last_peered":"2024-04-16T13:04:53.130074+0000","last_clean":"2024-04-16T13:04:53.130074+0000","last_became_active":"2024-04-16T13:04:46.008721+0000","last_became_peered":"2024-04-16T13:04:46.008721+0000","last_unstale":"2024-04-16T13:04:53.130074+0000","last_undegraded":"2024-04-16T13:04:53.130074+0000","last_fullsized":"2024-04-16T13:04:53.130074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017766+0000","last_change":"2024-04-16T13:04:45.021156+0000","last_active":"2024-04-16T13:04:53.017766+0000","last_peered":"2024-04-16T13:04:53.017766+0000","last_clean":"2024-04-16T13:04:53.017766+0000","last_became_active":"2024-04-16T13:04:45.020854+0000","last_became_peered":"2024-04-16T13:04:45.020854+0000","last_unstale":"2024-04-16T13:04:53.017766+0000","last_undegraded":"2024-04-16T13:04:53.017766+0000","last_fullsized":"2024-04-16T13:04:53.017766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140351+0000","last_change":"2024-04-16T13:04:50.707455+0000","last_active":"2024-04-16T13:04:52.140351+0000","last_peered":"2024-04-16T13:04:52.140351+0000","last_clean":"2024-04-16T13:04:52.140351+0000","last_became_active":"2024-04-16T13:04:50.706437+0000","last_became_peered":"2024-04-16T13:04:50.706437+0000","last_unstale":"2024-04-16T13:04:52.140351+0000","last_undegraded":"2024-04-16T13:04:52.140351+0000","last_fullsized":"2024-04-16T13:04:52.140351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:07:07.045544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137384+0000","last_change":"2024-04-16T13:04:50.708826+0000","last_active":"2024-04-16T13:04:53.137384+0000","last_peered":"2024-04-16T13:04:53.137384+0000","last_clean":"2024-04-16T13:04:53.137384+0000","last_became_active":"2024-04-16T13:04:50.707859+0000","last_became_peered":"2024-04-16T13:04:50.707859+0000","last_unstale":"2024-04-16T13:04:53.137384+0000","last_undegraded":"2024-04-16T13:04:53.137384+0000","last_fullsized":"2024-04-16T13:04:53.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136926+0000","last_change":"2024-04-16T13:04:46.000392+0000","last_active":"2024-04-16T13:04:52.136926+0000","last_peered":"2024-04-16T13:04:52.136926+0000","last_clean":"2024-04-16T13:04:52.136926+0000","last_became_active":"2024-04-16T13:04:46.000078+0000","last_became_peered":"2024-04-16T13:04:46.000078+0000","last_unstale":"2024-04-16T13:04:52.136926+0000","last_undegraded":"2024-04-16T13:04:52.136926+0000","last_fullsized":"2024-04-16T13:04:52.136926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127941+0000","last_change":"2024-04-16T13:04:45.006496+0000","last_active":"2024-04-16T13:04:53.127941+0000","last_peered":"2024-04-16T13:04:53.127941+0000","last_clean":"2024-04-16T13:04:53.127941+0000","last_became_active":"2024-04-16T13:04:45.006186+0000","last_became_peered":"2024-04-16T13:04:45.006186+0000","last_unstale":"2024-04-16T13:04:53.127941+0000","last_undegraded":"2024-04-16T13:04:53.127941+0000","last_fullsized":"2024-04-16T13:04:53.127941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017419+0000","last_change":"2024-04-16T13:04:50.176861+0000","last_active":"2024-04-16T13:04:53.017419+0000","last_peered":"2024-04-16T13:04:53.017419+0000","last_clean":"2024-04-16T13:04:53.017419+0000","last_became_active":"2024-04-16T13:04:50.176348+0000","last_became_peered":"2024-04-16T13:04:50.176348+0000","last_unstale":"2024-04-16T13:04:53.017419+0000","last_undegraded":"2024-04-16T13:04:53.017419+0000","last_fullsized":"2024-04-16T13:04:53.017419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140739+0000","last_change":"2024-04-16T13:04:46.000621+0000","last_active":"2024-04-16T13:04:52.140739+0000","last_peered":"2024-04-16T13:04:52.140739+0000","last_clean":"2024-04-16T13:04:52.140739+0000","last_became_active":"2024-04-16T13:04:46.000319+0000","last_became_peered":"2024-04-16T13:04:46.000319+0000","last_unstale":"2024-04-16T13:04:52.140739+0000","last_undegraded":"2024-04-16T13:04:52.140739+0000","last_fullsized":"2024-04-16T13:04:52.140739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141221+0000","last_change":"2024-04-16T13:04:45.006224+0000","last_active":"2024-04-16T13:04:52.141221+0000","last_peered":"2024-04-16T13:04:52.141221+0000","last_clean":"2024-04-16T13:04:52.141221+0000","last_became_active":"2024-04-16T13:04:45.005898+0000","last_became_peered":"2024-04-16T13:04:45.005898+0000","last_unstale":"2024-04-16T13:04:52.141221+0000","last_undegraded":"2024-04-16T13:04:52.141221+0000","last_fullsized":"2024-04-16T13:04:52.141221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015851+0000","last_change":"2024-04-16T13:04:45.019025+0000","last_active":"2024-04-16T13:04:53.015851+0000","last_peered":"2024-04-16T13:04:53.015851+0000","last_clean":"2024-04-16T13:04:53.015851+0000","last_became_active":"2024-04-16T13:04:45.015700+0000","last_became_peered":"2024-04-16T13:04:45.015700+0000","last_unstale":"2024-04-16T13:04:53.015851+0000","last_undegraded":"2024-04-16T13:04:53.015851+0000","last_fullsized":"2024-04-16T13:04:53.015851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137290+0000","last_change":"2024-04-16T13:04:46.018489+0000","last_active":"2024-04-16T13:04:53.137290+0000","last_peered":"2024-04-16T13:04:53.137290+0000","last_clean":"2024-04-16T13:04:53.137290+0000","last_became_active":"2024-04-16T13:04:46.018109+0000","last_became_peered":"2024-04-16T13:04:46.018109+0000","last_unstale":"2024-04-16T13:04:53.137290+0000","last_undegraded":"2024-04-16T13:04:53.137290+0000","last_fullsized":"2024-04-16T13:04:53.137290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018321+0000","last_change":"2024-04-16T13:04:50.172707+0000","last_active":"2024-04-16T13:04:53.018321+0000","last_peered":"2024-04-16T13:04:53.018321+0000","last_clean":"2024-04-16T13:04:53.018321+0000","last_became_active":"2024-04-16T13:04:50.172280+0000","last_became_peered":"2024-04-16T13:04:50.172280+0000","last_unstale":"2024-04-16T13:04:53.018321+0000","last_undegraded":"2024-04-16T13:04:53.018321+0000","last_fullsized":"2024-04-16T13:04:53.018321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:04.522503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140744+0000","last_change":"2024-04-16T13:04:45.005110+0000","last_active":"2024-04-16T13:04:52.140744+0000","last_peered":"2024-04-16T13:04:52.140744+0000","last_clean":"2024-04-16T13:04:52.140744+0000","last_became_active":"2024-04-16T13:04:45.004820+0000","last_became_peered":"2024-04-16T13:04:45.004820+0000","last_unstale":"2024-04-16T13:04:52.140744+0000","last_undegraded":"2024-04-16T13:04:52.140744+0000","last_fullsized":"2024-04-16T13:04:52.140744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142646+0000","last_change":"2024-04-16T13:04:45.992254+0000","last_active":"2024-04-16T13:04:52.142646+0000","last_peered":"2024-04-16T13:04:52.142646+0000","last_clean":"2024-04-16T13:04:52.142646+0000","last_became_active":"2024-04-16T13:04:45.991789+0000","last_became_peered":"2024-04-16T13:04:45.991789+0000","last_unstale":"2024-04-16T13:04:52.142646+0000","last_undegraded":"2024-04-16T13:04:52.142646+0000","last_fullsized":"2024-04-16T13:04:52.142646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:40.238739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141125+0000","last_change":"2024-04-16T13:04:50.166825+0000","last_active":"2024-04-16T13:04:52.141125+0000","last_peered":"2024-04-16T13:04:52.141125+0000","last_clean":"2024-04-16T13:04:52.141125+0000","last_became_active":"2024-04-16T13:04:50.163810+0000","last_became_peered":"2024-04-16T13:04:50.163810+0000","last_unstale":"2024-04-16T13:04:52.141125+0000","last_undegraded":"2024-04-16T13:04:52.141125+0000","last_fullsized":"2024-04-16T13:04:52.141125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:27.336747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015243+0000","last_change":"2024-04-16T13:04:46.003053+0000","last_active":"2024-04-16T13:04:53.015243+0000","last_peered":"2024-04-16T13:04:53.015243+0000","last_clean":"2024-04-16T13:04:53.015243+0000","last_became_active":"2024-04-16T13:04:46.002349+0000","last_became_peered":"2024-04-16T13:04:46.002349+0000","last_unstale":"2024-04-16T13:04:53.015243+0000","last_undegraded":"2024-04-16T13:04:53.015243+0000","last_fullsized":"2024-04-16T13:04:53.015243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017790+0000","last_change":"2024-04-16T13:04:46.012253+0000","last_active":"2024-04-16T13:04:53.017790+0000","last_peered":"2024-04-16T13:04:53.017790+0000","last_clean":"2024-04-16T13:04:53.017790+0000","last_became_active":"2024-04-16T13:04:46.011827+0000","last_became_peered":"2024-04-16T13:04:46.011827+0000","last_unstale":"2024-04-16T13:04:53.017790+0000","last_undegraded":"2024-04-16T13:04:53.017790+0000","last_fullsized":"2024-04-16T13:04:53.017790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129257+0000","last_change":"2024-04-16T13:04:46.005260+0000","last_active":"2024-04-16T13:04:53.129257+0000","last_peered":"2024-04-16T13:04:53.129257+0000","last_clean":"2024-04-16T13:04:53.129257+0000","last_became_active":"2024-04-16T13:04:46.004249+0000","last_became_peered":"2024-04-16T13:04:46.004249+0000","last_unstale":"2024-04-16T13:04:53.129257+0000","last_undegraded":"2024-04-16T13:04:53.129257+0000","last_fullsized":"2024-04-16T13:04:53.129257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137145+0000","last_change":"2024-04-16T13:04:46.004033+0000","last_active":"2024-04-16T13:04:53.137145+0000","last_peered":"2024-04-16T13:04:53.137145+0000","last_clean":"2024-04-16T13:04:53.137145+0000","last_became_active":"2024-04-16T13:04:46.002797+0000","last_became_peered":"2024-04-16T13:04:46.002797+0000","last_unstale":"2024-04-16T13:04:53.137145+0000","last_undegraded":"2024-04-16T13:04:53.137145+0000","last_fullsized":"2024-04-16T13:04:53.137145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:33.289858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141301+0000","last_change":"2024-04-16T13:04:46.004426+0000","last_active":"2024-04-16T13:04:52.141301+0000","last_peered":"2024-04-16T13:04:52.141301+0000","last_clean":"2024-04-16T13:04:52.141301+0000","last_became_active":"2024-04-16T13:04:46.004142+0000","last_became_peered":"2024-04-16T13:04:46.004142+0000","last_unstale":"2024-04-16T13:04:52.141301+0000","last_undegraded":"2024-04-16T13:04:52.141301+0000","last_fullsized":"2024-04-16T13:04:52.141301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138556+0000","last_change":"2024-04-16T13:04:45.996051+0000","last_active":"2024-04-16T13:04:52.138556+0000","last_peered":"2024-04-16T13:04:52.138556+0000","last_clean":"2024-04-16T13:04:52.138556+0000","last_became_active":"2024-04-16T13:04:45.995786+0000","last_became_peered":"2024-04-16T13:04:45.995786+0000","last_unstale":"2024-04-16T13:04:52.138556+0000","last_undegraded":"2024-04-16T13:04:52.138556+0000","last_fullsized":"2024-04-16T13:04:52.138556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017733+0000","last_change":"2024-04-16T13:04:46.014233+0000","last_active":"2024-04-16T13:04:53.017733+0000","last_peered":"2024-04-16T13:04:53.017733+0000","last_clean":"2024-04-16T13:04:53.017733+0000","last_became_active":"2024-04-16T13:04:46.007756+0000","last_became_peered":"2024-04-16T13:04:46.007756+0000","last_unstale":"2024-04-16T13:04:53.017733+0000","last_undegraded":"2024-04-16T13:04:53.017733+0000","last_fullsized":"2024-04-16T13:04:53.017733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141176+0000","last_change":"2024-04-16T13:04:46.002910+0000","last_active":"2024-04-16T13:04:52.141176+0000","last_peered":"2024-04-16T13:04:52.141176+0000","last_clean":"2024-04-16T13:04:52.141176+0000","last_became_active":"2024-04-16T13:04:46.002453+0000","last_became_peered":"2024-04-16T13:04:46.002453+0000","last_unstale":"2024-04-16T13:04:52.141176+0000","last_undegraded":"2024-04-16T13:04:52.141176+0000","last_fullsized":"2024-04-16T13:04:52.141176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128952+0000","last_change":"2024-04-16T13:04:46.004049+0000","last_active":"2024-04-16T13:04:53.128952+0000","last_peered":"2024-04-16T13:04:53.128952+0000","last_clean":"2024-04-16T13:04:53.128952+0000","last_became_active":"2024-04-16T13:04:46.003706+0000","last_became_peered":"2024-04-16T13:04:46.003706+0000","last_unstale":"2024-04-16T13:04:53.128952+0000","last_undegraded":"2024-04-16T13:04:53.128952+0000","last_fullsized":"2024-04-16T13:04:53.128952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141077+0000","last_change":"2024-04-16T13:04:45.995750+0000","last_active":"2024-04-16T13:04:52.141077+0000","last_peered":"2024-04-16T13:04:52.141077+0000","last_clean":"2024-04-16T13:04:52.141077+0000","last_became_active":"2024-04-16T13:04:45.995236+0000","last_became_peered":"2024-04-16T13:04:45.995236+0000","last_unstale":"2024-04-16T13:04:52.141077+0000","last_undegraded":"2024-04-16T13:04:52.141077+0000","last_fullsized":"2024-04-16T13:04:52.141077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129172+0000","last_change":"2024-04-16T13:04:46.004985+0000","last_active":"2024-04-16T13:04:53.129172+0000","last_peered":"2024-04-16T13:04:53.129172+0000","last_clean":"2024-04-16T13:04:53.129172+0000","last_became_active":"2024-04-16T13:04:46.003800+0000","last_became_peered":"2024-04-16T13:04:46.003800+0000","last_unstale":"2024-04-16T13:04:53.129172+0000","last_undegraded":"2024-04-16T13:04:53.129172+0000","last_fullsized":"2024-04-16T13:04:53.129172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136544+0000","last_change":"2024-04-16T13:04:46.004265+0000","last_active":"2024-04-16T13:04:53.136544+0000","last_peered":"2024-04-16T13:04:53.136544+0000","last_clean":"2024-04-16T13:04:53.136544+0000","last_became_active":"2024-04-16T13:04:46.003115+0000","last_became_peered":"2024-04-16T13:04:46.003115+0000","last_unstale":"2024-04-16T13:04:53.136544+0000","last_undegraded":"2024-04-16T13:04:53.136544+0000","last_fullsized":"2024-04-16T13:04:53.136544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:52.579674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016869+0000","last_change":"2024-04-16T13:04:46.018522+0000","last_active":"2024-04-16T13:04:53.016869+0000","last_peered":"2024-04-16T13:04:53.016869+0000","last_clean":"2024-04-16T13:04:53.016869+0000","last_became_active":"2024-04-16T13:04:46.008619+0000","last_became_peered":"2024-04-16T13:04:46.008619+0000","last_unstale":"2024-04-16T13:04:53.016869+0000","last_undegraded":"2024-04-16T13:04:53.016869+0000","last_fullsized":"2024-04-16T13:04:53.016869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527232+0000","last_change":"2024-04-16T13:04:45.996736+0000","last_active":"2024-04-16T13:04:53.527232+0000","last_peered":"2024-04-16T13:04:53.527232+0000","last_clean":"2024-04-16T13:04:53.527232+0000","last_became_active":"2024-04-16T13:04:45.996437+0000","last_became_peered":"2024-04-16T13:04:45.996437+0000","last_unstale":"2024-04-16T13:04:53.527232+0000","last_undegraded":"2024-04-16T13:04:53.527232+0000","last_fullsized":"2024-04-16T13:04:53.527232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.019040+0000","last_change":"2024-04-16T13:04:46.000008+0000","last_active":"2024-04-16T13:04:53.019040+0000","last_peered":"2024-04-16T13:04:53.019040+0000","last_clean":"2024-04-16T13:04:53.019040+0000","last_became_active":"2024-04-16T13:04:45.999290+0000","last_became_peered":"2024-04-16T13:04:45.999290+0000","last_unstale":"2024-04-16T13:04:53.019040+0000","last_undegraded":"2024-04-16T13:04:53.019040+0000","last_fullsized":"2024-04-16T13:04:53.019040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:39.017477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130606+0000","last_change":"2024-04-16T13:04:46.010682+0000","last_active":"2024-04-16T13:04:53.130606+0000","last_peered":"2024-04-16T13:04:53.130606+0000","last_clean":"2024-04-16T13:04:53.130606+0000","last_became_active":"2024-04-16T13:04:46.008966+0000","last_became_peered":"2024-04-16T13:04:46.008966+0000","last_unstale":"2024-04-16T13:04:53.130606+0000","last_undegraded":"2024-04-16T13:04:53.130606+0000","last_fullsized":"2024-04-16T13:04:53.130606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128870+0000","last_change":"2024-04-16T13:04:46.003968+0000","last_active":"2024-04-16T13:04:53.128870+0000","last_peered":"2024-04-16T13:04:53.128870+0000","last_clean":"2024-04-16T13:04:53.128870+0000","last_became_active":"2024-04-16T13:04:46.003377+0000","last_became_peered":"2024-04-16T13:04:46.003377+0000","last_unstale":"2024-04-16T13:04:53.128870+0000","last_undegraded":"2024-04-16T13:04:53.128870+0000","last_fullsized":"2024-04-16T13:04:53.128870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136997+0000","last_change":"2024-04-16T13:04:45.986929+0000","last_active":"2024-04-16T13:04:52.136997+0000","last_peered":"2024-04-16T13:04:52.136997+0000","last_clean":"2024-04-16T13:04:52.136997+0000","last_became_active":"2024-04-16T13:04:45.986136+0000","last_became_peered":"2024-04-16T13:04:45.986136+0000","last_unstale":"2024-04-16T13:04:52.136997+0000","last_undegraded":"2024-04-16T13:04:52.136997+0000","last_fullsized":"2024-04-16T13:04:52.136997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136540+0000","last_change":"2024-04-16T13:04:46.006745+0000","last_active":"2024-04-16T13:04:53.136540+0000","last_peered":"2024-04-16T13:04:53.136540+0000","last_clean":"2024-04-16T13:04:53.136540+0000","last_became_active":"2024-04-16T13:04:46.005822+0000","last_became_peered":"2024-04-16T13:04:46.005822+0000","last_unstale":"2024-04-16T13:04:53.136540+0000","last_undegraded":"2024-04-16T13:04:53.136540+0000","last_fullsized":"2024-04-16T13:04:53.136540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:36.399411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141458+0000","last_change":"2024-04-16T13:04:46.019457+0000","last_active":"2024-04-16T13:04:52.141458+0000","last_peered":"2024-04-16T13:04:52.141458+0000","last_clean":"2024-04-16T13:04:52.141458+0000","last_became_active":"2024-04-16T13:04:46.017865+0000","last_became_peered":"2024-04-16T13:04:46.017865+0000","last_unstale":"2024-04-16T13:04:52.141458+0000","last_undegraded":"2024-04-16T13:04:52.141458+0000","last_fullsized":"2024-04-16T13:04:52.141458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143225+0000","last_change":"2024-04-16T13:04:46.008099+0000","last_active":"2024-04-16T13:04:52.143225+0000","last_peered":"2024-04-16T13:04:52.143225+0000","last_clean":"2024-04-16T13:04:52.143225+0000","last_became_active":"2024-04-16T13:04:46.007709+0000","last_became_peered":"2024-04-16T13:04:46.007709+0000","last_unstale":"2024-04-16T13:04:52.143225+0000","last_undegraded":"2024-04-16T13:04:52.143225+0000","last_fullsized":"2024-04-16T13:04:52.143225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018093+0000","last_change":"2024-04-16T13:04:46.020412+0000","last_active":"2024-04-16T13:04:53.018093+0000","last_peered":"2024-04-16T13:04:53.018093+0000","last_clean":"2024-04-16T13:04:53.018093+0000","last_became_active":"2024-04-16T13:04:46.020176+0000","last_became_peered":"2024-04-16T13:04:46.020176+0000","last_unstale":"2024-04-16T13:04:53.018093+0000","last_undegraded":"2024-04-16T13:04:53.018093+0000","last_fullsized":"2024-04-16T13:04:53.018093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017641+0000","last_change":"2024-04-16T13:04:46.017218+0000","last_active":"2024-04-16T13:04:53.017641+0000","last_peered":"2024-04-16T13:04:53.017641+0000","last_clean":"2024-04-16T13:04:53.017641+0000","last_became_active":"2024-04-16T13:04:46.014646+0000","last_became_peered":"2024-04-16T13:04:46.014646+0000","last_unstale":"2024-04-16T13:04:53.017641+0000","last_undegraded":"2024-04-16T13:04:53.017641+0000","last_fullsized":"2024-04-16T13:04:53.017641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527498+0000","last_change":"2024-04-16T13:04:46.009985+0000","last_active":"2024-04-16T13:04:53.527498+0000","last_peered":"2024-04-16T13:04:53.527498+0000","last_clean":"2024-04-16T13:04:53.527498+0000","last_became_active":"2024-04-16T13:04:46.009696+0000","last_became_peered":"2024-04-16T13:04:46.009696+0000","last_unstale":"2024-04-16T13:04:53.527498+0000","last_undegraded":"2024-04-16T13:04:53.527498+0000","last_fullsized":"2024-04-16T13:04:53.527498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:40.104541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140079+0000","last_change":"2024-04-16T13:04:46.006877+0000","last_active":"2024-04-16T13:04:52.140079+0000","last_peered":"2024-04-16T13:04:52.140079+0000","last_clean":"2024-04-16T13:04:52.140079+0000","last_became_active":"2024-04-16T13:04:46.006436+0000","last_became_peered":"2024-04-16T13:04:46.006436+0000","last_unstale":"2024-04-16T13:04:52.140079+0000","last_undegraded":"2024-04-16T13:04:52.140079+0000","last_fullsized":"2024-04-16T13:04:52.140079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526019+0000","last_change":"2024-04-16T13:04:46.004191+0000","last_active":"2024-04-16T13:04:53.526019+0000","last_peered":"2024-04-16T13:04:53.526019+0000","last_clean":"2024-04-16T13:04:53.526019+0000","last_became_active":"2024-04-16T13:04:46.003868+0000","last_became_peered":"2024-04-16T13:04:46.003868+0000","last_unstale":"2024-04-16T13:04:53.526019+0000","last_undegraded":"2024-04-16T13:04:53.526019+0000","last_fullsized":"2024-04-16T13:04:53.526019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128991+0000","last_change":"2024-04-16T13:04:46.005552+0000","last_active":"2024-04-16T13:04:53.128991+0000","last_peered":"2024-04-16T13:04:53.128991+0000","last_clean":"2024-04-16T13:04:53.128991+0000","last_became_active":"2024-04-16T13:04:46.004596+0000","last_became_peered":"2024-04-16T13:04:46.004596+0000","last_unstale":"2024-04-16T13:04:53.128991+0000","last_undegraded":"2024-04-16T13:04:53.128991+0000","last_fullsized":"2024-04-16T13:04:53.128991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525853+0000","last_change":"2024-04-16T13:04:45.997612+0000","last_active":"2024-04-16T13:04:53.525853+0000","last_peered":"2024-04-16T13:04:53.525853+0000","last_clean":"2024-04-16T13:04:53.525853+0000","last_became_active":"2024-04-16T13:04:45.996762+0000","last_became_peered":"2024-04-16T13:04:45.996762+0000","last_unstale":"2024-04-16T13:04:53.525853+0000","last_undegraded":"2024-04-16T13:04:53.525853+0000","last_fullsized":"2024-04-16T13:04:53.525853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129465+0000","last_change":"2024-04-16T13:04:46.008999+0000","last_active":"2024-04-16T13:04:53.129465+0000","last_peered":"2024-04-16T13:04:53.129465+0000","last_clean":"2024-04-16T13:04:53.129465+0000","last_became_active":"2024-04-16T13:04:46.008352+0000","last_became_peered":"2024-04-16T13:04:46.008352+0000","last_unstale":"2024-04-16T13:04:53.129465+0000","last_undegraded":"2024-04-16T13:04:53.129465+0000","last_fullsized":"2024-04-16T13:04:53.129465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136867+0000","last_change":"2024-04-16T13:04:46.005440+0000","last_active":"2024-04-16T13:04:53.136867+0000","last_peered":"2024-04-16T13:04:53.136867+0000","last_clean":"2024-04-16T13:04:53.136867+0000","last_became_active":"2024-04-16T13:04:46.002984+0000","last_became_peered":"2024-04-16T13:04:46.002984+0000","last_unstale":"2024-04-16T13:04:53.136867+0000","last_undegraded":"2024-04-16T13:04:53.136867+0000","last_fullsized":"2024-04-16T13:04:53.136867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138984+0000","last_change":"2024-04-16T13:04:46.009580+0000","last_active":"2024-04-16T13:04:52.138984+0000","last_peered":"2024-04-16T13:04:52.138984+0000","last_clean":"2024-04-16T13:04:52.138984+0000","last_became_active":"2024-04-16T13:04:46.008940+0000","last_became_peered":"2024-04-16T13:04:46.008940+0000","last_unstale":"2024-04-16T13:04:52.138984+0000","last_undegraded":"2024-04-16T13:04:52.138984+0000","last_fullsized":"2024-04-16T13:04:52.138984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527357+0000","last_change":"2024-04-16T13:04:46.007107+0000","last_active":"2024-04-16T13:04:53.527357+0000","last_peered":"2024-04-16T13:04:53.527357+0000","last_clean":"2024-04-16T13:04:53.527357+0000","last_became_active":"2024-04-16T13:04:46.006881+0000","last_became_peered":"2024-04-16T13:04:46.006881+0000","last_unstale":"2024-04-16T13:04:53.527357+0000","last_undegraded":"2024-04-16T13:04:53.527357+0000","last_fullsized":"2024-04-16T13:04:53.527357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:05:09.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:05:10.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.017+0000 7f19b6600640 1 Processor -- start 2024-04-16T13:05:10.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.018+0000 7f19b6600640 1 -- start start 2024-04-16T13:05:10.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19b6600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19b0146150 0x7f19b015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19b6600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 0x7f19b015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19b6600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b006dd50 con 0x7f19b0071e50 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19b6600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f19b015d4e0 con 0x7f19b0146150 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19b6600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f19b015d7c0 con 0x7f19b00cec90 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.019+0000 7f19af400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19b0146150 0x7f19b015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f19b0146150 0x7f19b015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54376/0 (socket says 172.21.15.67:54376) 2024-04-16T13:05:10.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 -- 172.21.15.67:0/4290797696 learned_addr learned my addr 172.21.15.67:0/4290797696 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19aea00640 1 --2- 172.21.15.67:0/4290797696 >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 0x7f19b015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 -- 172.21.15.67:0/4290797696 >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 msgr2=0x7f19b015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 --2- 172.21.15.67:0/4290797696 >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 0x7f19b015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 -- 172.21.15.67:0/4290797696 >> v1:172.21.15.82:6789/0 conn(0x7f19b0071e50 legacy=0x7f19b006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19af400640 1 -- 172.21.15.67:0/4290797696 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b015daa0 con 0x7f19b0146150 2024-04-16T13:05:10.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.020+0000 7f19aea00640 1 --2- 172.21.15.67:0/4290797696 >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 0x7f19b015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:10.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.021+0000 7f19af400640 1 --2- 172.21.15.67:0/4290797696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b015cca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f19b00b2f30 tx=0x7f19a002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f590825bee945cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19ae000640 1 -- 172.21.15.67:0/4290797696 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0038070 con 0x7f19b0146150 2024-04-16T13:05:10.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19ae000640 1 -- 172.21.15.67:0/4290797696 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a002f050 con 0x7f19b0146150 2024-04-16T13:05:10.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19ae000640 1 -- 172.21.15.67:0/4290797696 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0031970 con 0x7f19b0146150 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 -- 172.21.15.67:0/4290797696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 msgr2=0x7f19b015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 --2- 172.21.15.67:0/4290797696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b015cca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f19b00b2f30 tx=0x7f19a002b7f0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 -- 172.21.15.67:0/4290797696 shutdown_connections 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 --2- 172.21.15.67:0/4290797696 >> v2:172.21.15.82:3300/0 conn(0x7f19b00cec90 0x7f19b015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 --2- 172.21.15.67:0/4290797696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b015cca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.022+0000 7f19b6600640 1 -- 172.21.15.67:0/4290797696 >> 172.21.15.67:0/4290797696 conn(0x7f19b00b2210 msgr2=0x7f19b00b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.023+0000 7f19b6600640 1 -- 172.21.15.67:0/4290797696 shutdown_connections 2024-04-16T13:05:10.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.023+0000 7f19b6600640 1 -- 172.21.15.67:0/4290797696 wait complete. 2024-04-16T13:05:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.024+0000 7f19b6600640 1 Processor -- start 2024-04-16T13:05:10.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.024+0000 7f19b6600640 1 -- start start 2024-04-16T13:05:10.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 0x7f19b015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b00cec90 0x7f19b01e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19b015e580 con 0x7f19b0146150 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19b015e400 con 0x7f19b00cec90 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.025+0000 7f19b6600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f19b006e960 con 0x7f19b0071e50 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54390/0 (socket says 172.21.15.67:54390) 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 -- 172.21.15.67:0/2382863868 learned_addr learned my addr 172.21.15.67:0/2382863868 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19aea00640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b00cec90 0x7f19b01e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19af400640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 0x7f19b015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 -- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 msgr2=0x7f19b015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 0x7f19b015c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 -- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b00cec90 msgr2=0x7f19b01e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b00cec90 0x7f19b01e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19afe00640 1 -- 172.21.15.67:0/2382863868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b01e5340 con 0x7f19b0146150 2024-04-16T13:05:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.026+0000 7f19af400640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 0x7f19b015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19afe00640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c780 tx=0x7f19a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004b60 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a8004d00 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a800aa90 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b01e5620 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.027+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b01e5be0 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.028+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b0075bd0 con 0x7f19b0146150 2024-04-16T13:05:10.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.029+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19a800ac30 con 0x7f19b0146150 2024-04-16T13:05:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.030+0000 7f19a7400640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 0x7f199006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.030+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f19a808c190 con 0x7f19b0146150 2024-04-16T13:05:10.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.031+0000 7f19af400640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 0x7f199006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.032+0000 7f19af400640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 0x7f199006ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19a0035000 tx=0x7f19a0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.035+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19a8020070 con 0x7f19b0146150 2024-04-16T13:05:10.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.239+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19b01e50f0 con 0x7f199006c920 2024-04-16T13:05:10.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.268+0000 7f19a7400640 1 -- 172.21.15.67:0/2382863868 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f19b01e50f0 con 0x7f199006c920 2024-04-16T13:05:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:05:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.274+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 msgr2=0x7f199006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.274+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 0x7f199006ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19a0035000 tx=0x7f19a0008030 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.274+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 msgr2=0x7f19b01e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.274+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c780 tx=0x7f19a800cc40 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 shutdown_connections 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c920 0x7f199006ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b0146150 0x7f19b01e7fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19b00cec90 0x7f19b01e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 --2- 172.21.15.67:0/2382863868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0071e50 0x7f19b015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 >> 172.21.15.67:0/2382863868 conn(0x7f19b00b2210 msgr2=0x7f19b0072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 shutdown_connections 2024-04-16T13:05:10.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.275+0000 7f19b6600640 1 -- 172.21.15.67:0/2382863868 wait complete. 2024-04-16T13:05:10.297 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-16T13:05:08.497008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2048878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005619"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.138090+0000","last_change":"2024-04-16T13:04:45.017212+0000","last_active":"2024-04-16T13:04:53.138090+0000","last_peered":"2024-04-16T13:04:53.138090+0000","last_clean":"2024-04-16T13:04:53.138090+0000","last_became_active":"2024-04-16T13:04:45.016908+0000","last_became_peered":"2024-04-16T13:04:45.016908+0000","last_unstale":"2024-04-16T13:04:53.138090+0000","last_undegraded":"2024-04-16T13:04:53.138090+0000","last_fullsized":"2024-04-16T13:04:53.138090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:53:15.736911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141192+0000","last_change":"2024-04-16T13:04:46.029051+0000","last_active":"2024-04-16T13:04:52.141192+0000","last_peered":"2024-04-16T13:04:52.141192+0000","last_clean":"2024-04-16T13:04:52.141192+0000","last_became_active":"2024-04-16T13:04:46.028414+0000","last_became_peered":"2024-04-16T13:04:46.028414+0000","last_unstale":"2024-04-16T13:04:52.141192+0000","last_undegraded":"2024-04-16T13:04:52.141192+0000","last_fullsized":"2024-04-16T13:04:52.141192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140594+0000","last_change":"2024-04-16T13:04:50.716406+0000","last_active":"2024-04-16T13:04:52.140594+0000","last_peered":"2024-04-16T13:04:52.140594+0000","last_clean":"2024-04-16T13:04:52.140594+0000","last_became_active":"2024-04-16T13:04:50.715298+0000","last_became_peered":"2024-04-16T13:04:50.715298+0000","last_unstale":"2024-04-16T13:04:52.140594+0000","last_undegraded":"2024-04-16T13:04:52.140594+0000","last_fullsized":"2024-04-16T13:04:52.140594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:35.233459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141394+0000","last_change":"2024-04-16T13:04:45.011371+0000","last_active":"2024-04-16T13:04:52.141394+0000","last_peered":"2024-04-16T13:04:52.141394+0000","last_clean":"2024-04-16T13:04:52.141394+0000","last_became_active":"2024-04-16T13:04:45.010921+0000","last_became_peered":"2024-04-16T13:04:45.010921+0000","last_unstale":"2024-04-16T13:04:52.141394+0000","last_undegraded":"2024-04-16T13:04:52.141394+0000","last_fullsized":"2024-04-16T13:04:52.141394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137685+0000","last_change":"2024-04-16T13:04:46.010566+0000","last_active":"2024-04-16T13:04:53.137685+0000","last_peered":"2024-04-16T13:04:53.137685+0000","last_clean":"2024-04-16T13:04:53.137685+0000","last_became_active":"2024-04-16T13:04:46.010271+0000","last_became_peered":"2024-04-16T13:04:46.010271+0000","last_unstale":"2024-04-16T13:04:53.137685+0000","last_undegraded":"2024-04-16T13:04:53.137685+0000","last_fullsized":"2024-04-16T13:04:53.137685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141893+0000","last_change":"2024-04-16T13:04:50.172684+0000","last_active":"2024-04-16T13:04:52.141893+0000","last_peered":"2024-04-16T13:04:52.141893+0000","last_clean":"2024-04-16T13:04:52.141893+0000","last_became_active":"2024-04-16T13:04:50.171569+0000","last_became_peered":"2024-04-16T13:04:50.171569+0000","last_unstale":"2024-04-16T13:04:52.141893+0000","last_undegraded":"2024-04-16T13:04:52.141893+0000","last_fullsized":"2024-04-16T13:04:52.141893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525149+0000","last_change":"2024-04-16T13:04:45.024578+0000","last_active":"2024-04-16T13:04:53.525149+0000","last_peered":"2024-04-16T13:04:53.525149+0000","last_clean":"2024-04-16T13:04:53.525149+0000","last_became_active":"2024-04-16T13:04:45.024333+0000","last_became_peered":"2024-04-16T13:04:45.024333+0000","last_unstale":"2024-04-16T13:04:53.525149+0000","last_undegraded":"2024-04-16T13:04:53.525149+0000","last_fullsized":"2024-04-16T13:04:53.525149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129517+0000","last_change":"2024-04-16T13:04:46.009310+0000","last_active":"2024-04-16T13:04:53.129517+0000","last_peered":"2024-04-16T13:04:53.129517+0000","last_clean":"2024-04-16T13:04:53.129517+0000","last_became_active":"2024-04-16T13:04:46.008657+0000","last_became_peered":"2024-04-16T13:04:46.008657+0000","last_unstale":"2024-04-16T13:04:53.129517+0000","last_undegraded":"2024-04-16T13:04:53.129517+0000","last_fullsized":"2024-04-16T13:04:53.129517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143101+0000","last_change":"2024-04-16T13:04:50.166861+0000","last_active":"2024-04-16T13:04:52.143101+0000","last_peered":"2024-04-16T13:04:52.143101+0000","last_clean":"2024-04-16T13:04:52.143101+0000","last_became_active":"2024-04-16T13:04:50.166201+0000","last_became_peered":"2024-04-16T13:04:50.166201+0000","last_unstale":"2024-04-16T13:04:52.143101+0000","last_undegraded":"2024-04-16T13:04:52.143101+0000","last_fullsized":"2024-04-16T13:04:52.143101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526586+0000","last_change":"2024-04-16T13:04:45.022779+0000","last_active":"2024-04-16T13:04:53.526586+0000","last_peered":"2024-04-16T13:04:53.526586+0000","last_clean":"2024-04-16T13:04:53.526586+0000","last_became_active":"2024-04-16T13:04:45.022445+0000","last_became_peered":"2024-04-16T13:04:45.022445+0000","last_unstale":"2024-04-16T13:04:53.526586+0000","last_undegraded":"2024-04-16T13:04:53.526586+0000","last_fullsized":"2024-04-16T13:04:53.526586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:35.238732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129942+0000","last_change":"2024-04-16T13:04:46.008470+0000","last_active":"2024-04-16T13:04:53.129942+0000","last_peered":"2024-04-16T13:04:53.129942+0000","last_clean":"2024-04-16T13:04:53.129942+0000","last_became_active":"2024-04-16T13:04:46.007901+0000","last_became_peered":"2024-04-16T13:04:46.007901+0000","last_unstale":"2024-04-16T13:04:53.129942+0000","last_undegraded":"2024-04-16T13:04:53.129942+0000","last_fullsized":"2024-04-16T13:04:53.129942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142378+0000","last_change":"2024-04-16T13:04:50.163286+0000","last_active":"2024-04-16T13:04:52.142378+0000","last_peered":"2024-04-16T13:04:52.142378+0000","last_clean":"2024-04-16T13:04:52.142378+0000","last_became_active":"2024-04-16T13:04:50.161658+0000","last_became_peered":"2024-04-16T13:04:50.161658+0000","last_unstale":"2024-04-16T13:04:52.142378+0000","last_undegraded":"2024-04-16T13:04:52.142378+0000","last_fullsized":"2024-04-16T13:04:52.142378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015548+0000","last_change":"2024-04-16T13:04:46.014646+0000","last_active":"2024-04-16T13:04:53.015548+0000","last_peered":"2024-04-16T13:04:53.015548+0000","last_clean":"2024-04-16T13:04:53.015548+0000","last_became_active":"2024-04-16T13:04:46.014332+0000","last_became_peered":"2024-04-16T13:04:46.014332+0000","last_unstale":"2024-04-16T13:04:53.015548+0000","last_undegraded":"2024-04-16T13:04:53.015548+0000","last_fullsized":"2024-04-16T13:04:53.015548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525140+0000","last_change":"2024-04-16T13:04:45.018345+0000","last_active":"2024-04-16T13:04:53.525140+0000","last_peered":"2024-04-16T13:04:53.525140+0000","last_clean":"2024-04-16T13:04:53.525140+0000","last_became_active":"2024-04-16T13:04:45.018023+0000","last_became_peered":"2024-04-16T13:04:45.018023+0000","last_unstale":"2024-04-16T13:04:53.525140+0000","last_undegraded":"2024-04-16T13:04:53.525140+0000","last_fullsized":"2024-04-16T13:04:53.525140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144101+0000","last_change":"2024-04-16T13:04:50.166377+0000","last_active":"2024-04-16T13:04:52.144101+0000","last_peered":"2024-04-16T13:04:52.144101+0000","last_clean":"2024-04-16T13:04:52.144101+0000","last_became_active":"2024-04-16T13:04:50.165706+0000","last_became_peered":"2024-04-16T13:04:50.165706+0000","last_unstale":"2024-04-16T13:04:52.144101+0000","last_undegraded":"2024-04-16T13:04:52.144101+0000","last_fullsized":"2024-04-16T13:04:52.144101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140626+0000","last_change":"2024-04-16T13:04:46.004518+0000","last_active":"2024-04-16T13:04:52.140626+0000","last_peered":"2024-04-16T13:04:52.140626+0000","last_clean":"2024-04-16T13:04:52.140626+0000","last_became_active":"2024-04-16T13:04:46.004307+0000","last_became_peered":"2024-04-16T13:04:46.004307+0000","last_unstale":"2024-04-16T13:04:52.140626+0000","last_undegraded":"2024-04-16T13:04:52.140626+0000","last_fullsized":"2024-04-16T13:04:52.140626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137806+0000","last_change":"2024-04-16T13:04:44.994353+0000","last_active":"2024-04-16T13:04:52.137806+0000","last_peered":"2024-04-16T13:04:52.137806+0000","last_clean":"2024-04-16T13:04:52.137806+0000","last_became_active":"2024-04-16T13:04:44.993983+0000","last_became_peered":"2024-04-16T13:04:44.993983+0000","last_unstale":"2024-04-16T13:04:52.137806+0000","last_undegraded":"2024-04-16T13:04:52.137806+0000","last_fullsized":"2024-04-16T13:04:52.137806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144015+0000","last_change":"2024-04-16T13:04:50.172131+0000","last_active":"2024-04-16T13:04:52.144015+0000","last_peered":"2024-04-16T13:04:52.144015+0000","last_clean":"2024-04-16T13:04:52.144015+0000","last_became_active":"2024-04-16T13:04:50.171610+0000","last_became_peered":"2024-04-16T13:04:50.171610+0000","last_unstale":"2024-04-16T13:04:52.144015+0000","last_undegraded":"2024-04-16T13:04:52.144015+0000","last_fullsized":"2024-04-16T13:04:52.144015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140915+0000","last_change":"2024-04-16T13:04:46.006324+0000","last_active":"2024-04-16T13:04:52.140915+0000","last_peered":"2024-04-16T13:04:52.140915+0000","last_clean":"2024-04-16T13:04:52.140915+0000","last_became_active":"2024-04-16T13:04:46.005807+0000","last_became_peered":"2024-04-16T13:04:46.005807+0000","last_unstale":"2024-04-16T13:04:52.140915+0000","last_undegraded":"2024-04-16T13:04:52.140915+0000","last_fullsized":"2024-04-16T13:04:52.140915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137099+0000","last_change":"2024-04-16T13:04:45.000438+0000","last_active":"2024-04-16T13:04:52.137099+0000","last_peered":"2024-04-16T13:04:52.137099+0000","last_clean":"2024-04-16T13:04:52.137099+0000","last_became_active":"2024-04-16T13:04:45.000089+0000","last_became_peered":"2024-04-16T13:04:45.000089+0000","last_unstale":"2024-04-16T13:04:52.137099+0000","last_undegraded":"2024-04-16T13:04:52.137099+0000","last_fullsized":"2024-04-16T13:04:52.137099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139470+0000","last_change":"2024-04-16T13:04:50.711220+0000","last_active":"2024-04-16T13:04:52.139470+0000","last_peered":"2024-04-16T13:04:52.139470+0000","last_clean":"2024-04-16T13:04:52.139470+0000","last_became_active":"2024-04-16T13:04:50.709851+0000","last_became_peered":"2024-04-16T13:04:50.709851+0000","last_unstale":"2024-04-16T13:04:52.139470+0000","last_undegraded":"2024-04-16T13:04:52.139470+0000","last_fullsized":"2024-04-16T13:04:52.139470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142413+0000","last_change":"2024-04-16T13:04:46.003322+0000","last_active":"2024-04-16T13:04:52.142413+0000","last_peered":"2024-04-16T13:04:52.142413+0000","last_clean":"2024-04-16T13:04:52.142413+0000","last_became_active":"2024-04-16T13:04:46.003054+0000","last_became_peered":"2024-04-16T13:04:46.003054+0000","last_unstale":"2024-04-16T13:04:52.142413+0000","last_undegraded":"2024-04-16T13:04:52.142413+0000","last_fullsized":"2024-04-16T13:04:52.142413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:20.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525718+0000","last_change":"2024-04-16T13:04:45.017508+0000","last_active":"2024-04-16T13:04:53.525718+0000","last_peered":"2024-04-16T13:04:53.525718+0000","last_clean":"2024-04-16T13:04:53.525718+0000","last_became_active":"2024-04-16T13:04:45.017191+0000","last_became_peered":"2024-04-16T13:04:45.017191+0000","last_unstale":"2024-04-16T13:04:53.525718+0000","last_undegraded":"2024-04-16T13:04:53.525718+0000","last_fullsized":"2024-04-16T13:04:53.525718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143665+0000","last_change":"2024-04-16T13:04:50.172094+0000","last_active":"2024-04-16T13:04:52.143665+0000","last_peered":"2024-04-16T13:04:52.143665+0000","last_clean":"2024-04-16T13:04:52.143665+0000","last_became_active":"2024-04-16T13:04:50.171583+0000","last_became_peered":"2024-04-16T13:04:50.171583+0000","last_unstale":"2024-04-16T13:04:52.143665+0000","last_undegraded":"2024-04-16T13:04:52.143665+0000","last_fullsized":"2024-04-16T13:04:52.143665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137578+0000","last_change":"2024-04-16T13:04:46.006452+0000","last_active":"2024-04-16T13:04:53.137578+0000","last_peered":"2024-04-16T13:04:53.137578+0000","last_clean":"2024-04-16T13:04:53.137578+0000","last_became_active":"2024-04-16T13:04:46.006110+0000","last_became_peered":"2024-04-16T13:04:46.006110+0000","last_unstale":"2024-04-16T13:04:53.137578+0000","last_undegraded":"2024-04-16T13:04:53.137578+0000","last_fullsized":"2024-04-16T13:04:53.137578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016559+0000","last_change":"2024-04-16T13:04:45.017007+0000","last_active":"2024-04-16T13:04:53.016559+0000","last_peered":"2024-04-16T13:04:53.016559+0000","last_clean":"2024-04-16T13:04:53.016559+0000","last_became_active":"2024-04-16T13:04:45.016628+0000","last_became_peered":"2024-04-16T13:04:45.016628+0000","last_unstale":"2024-04-16T13:04:53.016559+0000","last_undegraded":"2024-04-16T13:04:53.016559+0000","last_fullsized":"2024-04-16T13:04:53.016559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141982+0000","last_change":"2024-04-16T13:04:50.714894+0000","last_active":"2024-04-16T13:04:52.141982+0000","last_peered":"2024-04-16T13:04:52.141982+0000","last_clean":"2024-04-16T13:04:52.141982+0000","last_became_active":"2024-04-16T13:04:50.707478+0000","last_became_peered":"2024-04-16T13:04:50.707478+0000","last_unstale":"2024-04-16T13:04:52.141982+0000","last_undegraded":"2024-04-16T13:04:52.141982+0000","last_fullsized":"2024-04-16T13:04:52.141982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141377+0000","last_change":"2024-04-16T13:04:45.998408+0000","last_active":"2024-04-16T13:04:52.141377+0000","last_peered":"2024-04-16T13:04:52.141377+0000","last_clean":"2024-04-16T13:04:52.141377+0000","last_became_active":"2024-04-16T13:04:45.998086+0000","last_became_peered":"2024-04-16T13:04:45.998086+0000","last_unstale":"2024-04-16T13:04:52.141377+0000","last_undegraded":"2024-04-16T13:04:52.141377+0000","last_fullsized":"2024-04-16T13:04:52.141377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139111+0000","last_change":"2024-04-16T13:04:45.006718+0000","last_active":"2024-04-16T13:04:52.139111+0000","last_peered":"2024-04-16T13:04:52.139111+0000","last_clean":"2024-04-16T13:04:52.139111+0000","last_became_active":"2024-04-16T13:04:45.006418+0000","last_became_peered":"2024-04-16T13:04:45.006418+0000","last_unstale":"2024-04-16T13:04:52.139111+0000","last_undegraded":"2024-04-16T13:04:52.139111+0000","last_fullsized":"2024-04-16T13:04:52.139111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140164+0000","last_change":"2024-04-16T13:04:50.699284+0000","last_active":"2024-04-16T13:04:52.140164+0000","last_peered":"2024-04-16T13:04:52.140164+0000","last_clean":"2024-04-16T13:04:52.140164+0000","last_became_active":"2024-04-16T13:04:50.696999+0000","last_became_peered":"2024-04-16T13:04:50.696999+0000","last_unstale":"2024-04-16T13:04:52.140164+0000","last_undegraded":"2024-04-16T13:04:52.140164+0000","last_fullsized":"2024-04-16T13:04:52.140164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:47:43.788831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138077+0000","last_change":"2024-04-16T13:04:45.996654+0000","last_active":"2024-04-16T13:04:52.138077+0000","last_peered":"2024-04-16T13:04:52.138077+0000","last_clean":"2024-04-16T13:04:52.138077+0000","last_became_active":"2024-04-16T13:04:45.996251+0000","last_became_peered":"2024-04-16T13:04:45.996251+0000","last_unstale":"2024-04-16T13:04:52.138077+0000","last_undegraded":"2024-04-16T13:04:52.138077+0000","last_fullsized":"2024-04-16T13:04:52.138077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527291+0000","last_change":"2024-04-16T13:04:45.018375+0000","last_active":"2024-04-16T13:04:53.527291+0000","last_peered":"2024-04-16T13:04:53.527291+0000","last_clean":"2024-04-16T13:04:53.527291+0000","last_became_active":"2024-04-16T13:04:45.018125+0000","last_became_peered":"2024-04-16T13:04:45.018125+0000","last_unstale":"2024-04-16T13:04:53.527291+0000","last_undegraded":"2024-04-16T13:04:53.527291+0000","last_fullsized":"2024-04-16T13:04:53.527291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:38.002313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137111+0000","last_change":"2024-04-16T13:04:50.698690+0000","last_active":"2024-04-16T13:04:53.137111+0000","last_peered":"2024-04-16T13:04:53.137111+0000","last_clean":"2024-04-16T13:04:53.137111+0000","last_became_active":"2024-04-16T13:04:50.697358+0000","last_became_peered":"2024-04-16T13:04:50.697358+0000","last_unstale":"2024-04-16T13:04:53.137111+0000","last_undegraded":"2024-04-16T13:04:53.137111+0000","last_fullsized":"2024-04-16T13:04:53.137111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130111+0000","last_change":"2024-04-16T13:04:46.007829+0000","last_active":"2024-04-16T13:04:53.130111+0000","last_peered":"2024-04-16T13:04:53.130111+0000","last_clean":"2024-04-16T13:04:53.130111+0000","last_became_active":"2024-04-16T13:04:46.007537+0000","last_became_peered":"2024-04-16T13:04:46.007537+0000","last_unstale":"2024-04-16T13:04:53.130111+0000","last_undegraded":"2024-04-16T13:04:53.130111+0000","last_fullsized":"2024-04-16T13:04:53.130111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138200+0000","last_change":"2024-04-16T13:04:45.008507+0000","last_active":"2024-04-16T13:04:52.138200+0000","last_peered":"2024-04-16T13:04:52.138200+0000","last_clean":"2024-04-16T13:04:52.138200+0000","last_became_active":"2024-04-16T13:04:45.008217+0000","last_became_peered":"2024-04-16T13:04:45.008217+0000","last_unstale":"2024-04-16T13:04:52.138200+0000","last_undegraded":"2024-04-16T13:04:52.138200+0000","last_fullsized":"2024-04-16T13:04:52.138200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137403+0000","last_change":"2024-04-16T13:04:50.167171+0000","last_active":"2024-04-16T13:04:52.137403+0000","last_peered":"2024-04-16T13:04:52.137403+0000","last_clean":"2024-04-16T13:04:52.137403+0000","last_became_active":"2024-04-16T13:04:50.164681+0000","last_became_peered":"2024-04-16T13:04:50.164681+0000","last_unstale":"2024-04-16T13:04:52.137403+0000","last_undegraded":"2024-04-16T13:04:52.137403+0000","last_fullsized":"2024-04-16T13:04:52.137403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143872+0000","last_change":"2024-04-16T13:04:46.021438+0000","last_active":"2024-04-16T13:04:52.143872+0000","last_peered":"2024-04-16T13:04:52.143872+0000","last_clean":"2024-04-16T13:04:52.143872+0000","last_became_active":"2024-04-16T13:04:46.021184+0000","last_became_peered":"2024-04-16T13:04:46.021184+0000","last_unstale":"2024-04-16T13:04:52.143872+0000","last_undegraded":"2024-04-16T13:04:52.143872+0000","last_fullsized":"2024-04-16T13:04:52.143872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.055670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127965+0000","last_change":"2024-04-16T13:04:45.014922+0000","last_active":"2024-04-16T13:04:53.127965+0000","last_peered":"2024-04-16T13:04:53.127965+0000","last_clean":"2024-04-16T13:04:53.127965+0000","last_became_active":"2024-04-16T13:04:45.014037+0000","last_became_peered":"2024-04-16T13:04:45.014037+0000","last_unstale":"2024-04-16T13:04:53.127965+0000","last_undegraded":"2024-04-16T13:04:53.127965+0000","last_fullsized":"2024-04-16T13:04:53.127965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138224+0000","last_change":"2024-04-16T13:04:50.172451+0000","last_active":"2024-04-16T13:04:52.138224+0000","last_peered":"2024-04-16T13:04:52.138224+0000","last_clean":"2024-04-16T13:04:52.138224+0000","last_became_active":"2024-04-16T13:04:50.171709+0000","last_became_peered":"2024-04-16T13:04:50.171709+0000","last_unstale":"2024-04-16T13:04:52.138224+0000","last_undegraded":"2024-04-16T13:04:52.138224+0000","last_fullsized":"2024-04-16T13:04:52.138224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136931+0000","last_change":"2024-04-16T13:04:45.990241+0000","last_active":"2024-04-16T13:04:52.136931+0000","last_peered":"2024-04-16T13:04:52.136931+0000","last_clean":"2024-04-16T13:04:52.136931+0000","last_became_active":"2024-04-16T13:04:45.989713+0000","last_became_peered":"2024-04-16T13:04:45.989713+0000","last_unstale":"2024-04-16T13:04:52.136931+0000","last_undegraded":"2024-04-16T13:04:52.136931+0000","last_fullsized":"2024-04-16T13:04:52.136931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017464+0000","last_change":"2024-04-16T13:04:44.999454+0000","last_active":"2024-04-16T13:04:53.017464+0000","last_peered":"2024-04-16T13:04:53.017464+0000","last_clean":"2024-04-16T13:04:53.017464+0000","last_became_active":"2024-04-16T13:04:44.999166+0000","last_became_peered":"2024-04-16T13:04:44.999166+0000","last_unstale":"2024-04-16T13:04:53.017464+0000","last_undegraded":"2024-04-16T13:04:53.017464+0000","last_fullsized":"2024-04-16T13:04:53.017464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139649+0000","last_change":"2024-04-16T13:04:50.166374+0000","last_active":"2024-04-16T13:04:52.139649+0000","last_peered":"2024-04-16T13:04:52.139649+0000","last_clean":"2024-04-16T13:04:52.139649+0000","last_became_active":"2024-04-16T13:04:50.166029+0000","last_became_peered":"2024-04-16T13:04:50.166029+0000","last_unstale":"2024-04-16T13:04:52.139649+0000","last_undegraded":"2024-04-16T13:04:52.139649+0000","last_fullsized":"2024-04-16T13:04:52.139649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136502+0000","last_change":"2024-04-16T13:04:46.013116+0000","last_active":"2024-04-16T13:04:53.136502+0000","last_peered":"2024-04-16T13:04:53.136502+0000","last_clean":"2024-04-16T13:04:53.136502+0000","last_became_active":"2024-04-16T13:04:46.012724+0000","last_became_peered":"2024-04-16T13:04:46.012724+0000","last_unstale":"2024-04-16T13:04:53.136502+0000","last_undegraded":"2024-04-16T13:04:53.136502+0000","last_fullsized":"2024-04-16T13:04:53.136502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525117+0000","last_change":"2024-04-16T13:04:45.022061+0000","last_active":"2024-04-16T13:04:53.525117+0000","last_peered":"2024-04-16T13:04:53.525117+0000","last_clean":"2024-04-16T13:04:53.525117+0000","last_became_active":"2024-04-16T13:04:45.021784+0000","last_became_peered":"2024-04-16T13:04:45.021784+0000","last_unstale":"2024-04-16T13:04:53.525117+0000","last_undegraded":"2024-04-16T13:04:53.525117+0000","last_fullsized":"2024-04-16T13:04:53.525117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137504+0000","last_change":"2024-04-16T13:04:50.698726+0000","last_active":"2024-04-16T13:04:53.137504+0000","last_peered":"2024-04-16T13:04:53.137504+0000","last_clean":"2024-04-16T13:04:53.137504+0000","last_became_active":"2024-04-16T13:04:50.697335+0000","last_became_peered":"2024-04-16T13:04:50.697335+0000","last_unstale":"2024-04-16T13:04:53.137504+0000","last_undegraded":"2024-04-16T13:04:53.137504+0000","last_fullsized":"2024-04-16T13:04:53.137504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140431+0000","last_change":"2024-04-16T13:04:46.007441+0000","last_active":"2024-04-16T13:04:52.140431+0000","last_peered":"2024-04-16T13:04:52.140431+0000","last_clean":"2024-04-16T13:04:52.140431+0000","last_became_active":"2024-04-16T13:04:46.006232+0000","last_became_peered":"2024-04-16T13:04:46.006232+0000","last_unstale":"2024-04-16T13:04:52.140431+0000","last_undegraded":"2024-04-16T13:04:52.140431+0000","last_fullsized":"2024-04-16T13:04:52.140431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129402+0000","last_change":"2024-04-16T13:04:45.014153+0000","last_active":"2024-04-16T13:04:53.129402+0000","last_peered":"2024-04-16T13:04:53.129402+0000","last_clean":"2024-04-16T13:04:53.129402+0000","last_became_active":"2024-04-16T13:04:45.012884+0000","last_became_peered":"2024-04-16T13:04:45.012884+0000","last_unstale":"2024-04-16T13:04:53.129402+0000","last_undegraded":"2024-04-16T13:04:53.129402+0000","last_fullsized":"2024-04-16T13:04:53.129402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525920+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:04:53.525920+0000","last_peered":"2024-04-16T13:04:53.525920+0000","last_clean":"2024-04-16T13:04:53.525920+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:04:53.525920+0000","last_undegraded":"2024-04-16T13:04:53.525920+0000","last_fullsized":"2024-04-16T13:04:53.525920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017152+0000","last_change":"2024-04-16T13:04:50.706193+0000","last_active":"2024-04-16T13:04:53.017152+0000","last_peered":"2024-04-16T13:04:53.017152+0000","last_clean":"2024-04-16T13:04:53.017152+0000","last_became_active":"2024-04-16T13:04:50.705129+0000","last_became_peered":"2024-04-16T13:04:50.705129+0000","last_unstale":"2024-04-16T13:04:53.017152+0000","last_undegraded":"2024-04-16T13:04:53.017152+0000","last_fullsized":"2024-04-16T13:04:53.017152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526940+0000","last_change":"2024-04-16T13:04:46.010068+0000","last_active":"2024-04-16T13:04:53.526940+0000","last_peered":"2024-04-16T13:04:53.526940+0000","last_clean":"2024-04-16T13:04:53.526940+0000","last_became_active":"2024-04-16T13:04:46.009661+0000","last_became_peered":"2024-04-16T13:04:46.009661+0000","last_unstale":"2024-04-16T13:04:53.526940+0000","last_undegraded":"2024-04-16T13:04:53.526940+0000","last_fullsized":"2024-04-16T13:04:53.526940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018774+0000","last_change":"2024-04-16T13:04:45.009675+0000","last_active":"2024-04-16T13:04:53.018774+0000","last_peered":"2024-04-16T13:04:53.018774+0000","last_clean":"2024-04-16T13:04:53.018774+0000","last_became_active":"2024-04-16T13:04:45.009208+0000","last_became_peered":"2024-04-16T13:04:45.009208+0000","last_unstale":"2024-04-16T13:04:53.018774+0000","last_undegraded":"2024-04-16T13:04:53.018774+0000","last_fullsized":"2024-04-16T13:04:53.018774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015724+0000","last_change":"2024-04-16T13:04:50.700561+0000","last_active":"2024-04-16T13:04:53.015724+0000","last_peered":"2024-04-16T13:04:53.015724+0000","last_clean":"2024-04-16T13:04:53.015724+0000","last_became_active":"2024-04-16T13:04:50.697511+0000","last_became_peered":"2024-04-16T13:04:50.697511+0000","last_unstale":"2024-04-16T13:04:53.015724+0000","last_undegraded":"2024-04-16T13:04:53.015724+0000","last_fullsized":"2024-04-16T13:04:53.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129832+0000","last_change":"2024-04-16T13:04:46.008012+0000","last_active":"2024-04-16T13:04:53.129832+0000","last_peered":"2024-04-16T13:04:53.129832+0000","last_clean":"2024-04-16T13:04:53.129832+0000","last_became_active":"2024-04-16T13:04:46.007687+0000","last_became_peered":"2024-04-16T13:04:46.007687+0000","last_unstale":"2024-04-16T13:04:53.129832+0000","last_undegraded":"2024-04-16T13:04:53.129832+0000","last_fullsized":"2024-04-16T13:04:53.129832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138728+0000","last_change":"2024-04-16T13:04:45.003115+0000","last_active":"2024-04-16T13:04:52.138728+0000","last_peered":"2024-04-16T13:04:52.138728+0000","last_clean":"2024-04-16T13:04:52.138728+0000","last_became_active":"2024-04-16T13:04:45.002827+0000","last_became_peered":"2024-04-16T13:04:45.002827+0000","last_unstale":"2024-04-16T13:04:52.138728+0000","last_undegraded":"2024-04-16T13:04:52.138728+0000","last_fullsized":"2024-04-16T13:04:52.138728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137007+0000","last_change":"2024-04-16T13:04:50.170429+0000","last_active":"2024-04-16T13:04:53.137007+0000","last_peered":"2024-04-16T13:04:53.137007+0000","last_clean":"2024-04-16T13:04:53.137007+0000","last_became_active":"2024-04-16T13:04:50.168276+0000","last_became_peered":"2024-04-16T13:04:50.168276+0000","last_unstale":"2024-04-16T13:04:53.137007+0000","last_undegraded":"2024-04-16T13:04:53.137007+0000","last_fullsized":"2024-04-16T13:04:53.137007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527648+0000","last_change":"2024-04-16T13:04:45.996001+0000","last_active":"2024-04-16T13:04:53.527648+0000","last_peered":"2024-04-16T13:04:53.527648+0000","last_clean":"2024-04-16T13:04:53.527648+0000","last_became_active":"2024-04-16T13:04:45.994462+0000","last_became_peered":"2024-04-16T13:04:45.994462+0000","last_unstale":"2024-04-16T13:04:53.527648+0000","last_undegraded":"2024-04-16T13:04:53.527648+0000","last_fullsized":"2024-04-16T13:04:53.527648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:14.137296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017648+0000","last_change":"2024-04-16T13:04:45.001424+0000","last_active":"2024-04-16T13:04:53.017648+0000","last_peered":"2024-04-16T13:04:53.017648+0000","last_clean":"2024-04-16T13:04:53.017648+0000","last_became_active":"2024-04-16T13:04:45.001151+0000","last_became_peered":"2024-04-16T13:04:45.001151+0000","last_unstale":"2024-04-16T13:04:53.017648+0000","last_undegraded":"2024-04-16T13:04:53.017648+0000","last_fullsized":"2024-04-16T13:04:53.017648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128506+0000","last_change":"2024-04-16T13:04:50.711246+0000","last_active":"2024-04-16T13:04:53.128506+0000","last_peered":"2024-04-16T13:04:53.128506+0000","last_clean":"2024-04-16T13:04:53.128506+0000","last_became_active":"2024-04-16T13:04:50.704394+0000","last_became_peered":"2024-04-16T13:04:50.704394+0000","last_unstale":"2024-04-16T13:04:53.128506+0000","last_undegraded":"2024-04-16T13:04:53.128506+0000","last_fullsized":"2024-04-16T13:04:53.128506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:15.746451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526983+0000","last_change":"2024-04-16T13:04:45.985184+0000","last_active":"2024-04-16T13:04:53.526983+0000","last_peered":"2024-04-16T13:04:53.526983+0000","last_clean":"2024-04-16T13:04:53.526983+0000","last_became_active":"2024-04-16T13:04:45.984518+0000","last_became_peered":"2024-04-16T13:04:45.984518+0000","last_unstale":"2024-04-16T13:04:53.526983+0000","last_undegraded":"2024-04-16T13:04:53.526983+0000","last_fullsized":"2024-04-16T13:04:53.526983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144199+0000","last_change":"2024-04-16T13:04:45.009363+0000","last_active":"2024-04-16T13:04:52.144199+0000","last_peered":"2024-04-16T13:04:52.144199+0000","last_clean":"2024-04-16T13:04:52.144199+0000","last_became_active":"2024-04-16T13:04:45.008983+0000","last_became_peered":"2024-04-16T13:04:45.008983+0000","last_unstale":"2024-04-16T13:04:52.144199+0000","last_undegraded":"2024-04-16T13:04:52.144199+0000","last_fullsized":"2024-04-16T13:04:52.144199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:08:10.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141720+0000","last_change":"2024-04-16T13:04:50.166542+0000","last_active":"2024-04-16T13:04:52.141720+0000","last_peered":"2024-04-16T13:04:52.141720+0000","last_clean":"2024-04-16T13:04:52.141720+0000","last_became_active":"2024-04-16T13:04:50.166094+0000","last_became_peered":"2024-04-16T13:04:50.166094+0000","last_unstale":"2024-04-16T13:04:52.141720+0000","last_undegraded":"2024-04-16T13:04:52.141720+0000","last_fullsized":"2024-04-16T13:04:52.141720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:03.750621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526209+0000","last_change":"2024-04-16T13:04:45.985012+0000","last_active":"2024-04-16T13:04:53.526209+0000","last_peered":"2024-04-16T13:04:53.526209+0000","last_clean":"2024-04-16T13:04:53.526209+0000","last_became_active":"2024-04-16T13:04:45.984021+0000","last_became_peered":"2024-04-16T13:04:45.984021+0000","last_unstale":"2024-04-16T13:04:53.526209+0000","last_undegraded":"2024-04-16T13:04:53.526209+0000","last_fullsized":"2024-04-16T13:04:53.526209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017519+0000","last_change":"2024-04-16T13:04:44.997650+0000","last_active":"2024-04-16T13:04:53.017519+0000","last_peered":"2024-04-16T13:04:53.017519+0000","last_clean":"2024-04-16T13:04:53.017519+0000","last_became_active":"2024-04-16T13:04:44.997334+0000","last_became_peered":"2024-04-16T13:04:44.997334+0000","last_unstale":"2024-04-16T13:04:53.017519+0000","last_undegraded":"2024-04-16T13:04:53.017519+0000","last_fullsized":"2024-04-16T13:04:53.017519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137461+0000","last_change":"2024-04-16T13:04:50.161820+0000","last_active":"2024-04-16T13:04:53.137461+0000","last_peered":"2024-04-16T13:04:53.137461+0000","last_clean":"2024-04-16T13:04:53.137461+0000","last_became_active":"2024-04-16T13:04:50.161334+0000","last_became_peered":"2024-04-16T13:04:50.161334+0000","last_unstale":"2024-04-16T13:04:53.137461+0000","last_undegraded":"2024-04-16T13:04:53.137461+0000","last_fullsized":"2024-04-16T13:04:53.137461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015516+0000","last_change":"2024-04-16T13:04:46.002411+0000","last_active":"2024-04-16T13:04:53.015516+0000","last_peered":"2024-04-16T13:04:53.015516+0000","last_clean":"2024-04-16T13:04:53.015516+0000","last_became_active":"2024-04-16T13:04:46.002107+0000","last_became_peered":"2024-04-16T13:04:46.002107+0000","last_unstale":"2024-04-16T13:04:53.015516+0000","last_undegraded":"2024-04-16T13:04:53.015516+0000","last_fullsized":"2024-04-16T13:04:53.015516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.014730+0000","last_change":"2024-04-16T13:04:45.013545+0000","last_active":"2024-04-16T13:04:53.014730+0000","last_peered":"2024-04-16T13:04:53.014730+0000","last_clean":"2024-04-16T13:04:53.014730+0000","last_became_active":"2024-04-16T13:04:45.013202+0000","last_became_peered":"2024-04-16T13:04:45.013202+0000","last_unstale":"2024-04-16T13:04:53.014730+0000","last_undegraded":"2024-04-16T13:04:53.014730+0000","last_fullsized":"2024-04-16T13:04:53.014730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141020+0000","last_change":"2024-04-16T13:04:50.708122+0000","last_active":"2024-04-16T13:04:52.141020+0000","last_peered":"2024-04-16T13:04:52.141020+0000","last_clean":"2024-04-16T13:04:52.141020+0000","last_became_active":"2024-04-16T13:04:50.706711+0000","last_became_peered":"2024-04-16T13:04:50.706711+0000","last_unstale":"2024-04-16T13:04:52.141020+0000","last_undegraded":"2024-04-16T13:04:52.141020+0000","last_fullsized":"2024-04-16T13:04:52.141020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:34.429700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526079+0000","last_change":"2024-04-16T13:04:45.988616+0000","last_active":"2024-04-16T13:04:53.526079+0000","last_peered":"2024-04-16T13:04:53.526079+0000","last_clean":"2024-04-16T13:04:53.526079+0000","last_became_active":"2024-04-16T13:04:45.986360+0000","last_became_peered":"2024-04-16T13:04:45.986360+0000","last_unstale":"2024-04-16T13:04:53.526079+0000","last_undegraded":"2024-04-16T13:04:53.526079+0000","last_fullsized":"2024-04-16T13:04:53.526079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127989+0000","last_change":"2024-04-16T13:04:45.014011+0000","last_active":"2024-04-16T13:04:53.127989+0000","last_peered":"2024-04-16T13:04:53.127989+0000","last_clean":"2024-04-16T13:04:53.127989+0000","last_became_active":"2024-04-16T13:04:45.013245+0000","last_became_peered":"2024-04-16T13:04:45.013245+0000","last_unstale":"2024-04-16T13:04:53.127989+0000","last_undegraded":"2024-04-16T13:04:53.127989+0000","last_fullsized":"2024-04-16T13:04:53.127989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141019+0000","last_change":"2024-04-16T13:04:50.699221+0000","last_active":"2024-04-16T13:04:52.141019+0000","last_peered":"2024-04-16T13:04:52.141019+0000","last_clean":"2024-04-16T13:04:52.141019+0000","last_became_active":"2024-04-16T13:04:50.697803+0000","last_became_peered":"2024-04-16T13:04:50.697803+0000","last_unstale":"2024-04-16T13:04:52.141019+0000","last_undegraded":"2024-04-16T13:04:52.141019+0000","last_fullsized":"2024-04-16T13:04:52.141019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:55.380620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136601+0000","last_change":"2024-04-16T13:04:46.012519+0000","last_active":"2024-04-16T13:04:53.136601+0000","last_peered":"2024-04-16T13:04:53.136601+0000","last_clean":"2024-04-16T13:04:53.136601+0000","last_became_active":"2024-04-16T13:04:46.001053+0000","last_became_peered":"2024-04-16T13:04:46.001053+0000","last_unstale":"2024-04-16T13:04:53.136601+0000","last_undegraded":"2024-04-16T13:04:53.136601+0000","last_fullsized":"2024-04-16T13:04:53.136601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.135925+0000","last_change":"2024-04-16T13:04:45.008591+0000","last_active":"2024-04-16T13:04:53.135925+0000","last_peered":"2024-04-16T13:04:53.135925+0000","last_clean":"2024-04-16T13:04:53.135925+0000","last_became_active":"2024-04-16T13:04:45.008078+0000","last_became_peered":"2024-04-16T13:04:45.008078+0000","last_unstale":"2024-04-16T13:04:53.135925+0000","last_undegraded":"2024-04-16T13:04:53.135925+0000","last_fullsized":"2024-04-16T13:04:53.135925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130019+0000","last_change":"2024-04-16T13:04:50.705924+0000","last_active":"2024-04-16T13:04:53.130019+0000","last_peered":"2024-04-16T13:04:53.130019+0000","last_clean":"2024-04-16T13:04:53.130019+0000","last_became_active":"2024-04-16T13:04:50.704821+0000","last_became_peered":"2024-04-16T13:04:50.704821+0000","last_unstale":"2024-04-16T13:04:53.130019+0000","last_undegraded":"2024-04-16T13:04:53.130019+0000","last_fullsized":"2024-04-16T13:04:53.130019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:11.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526614+0000","last_change":"2024-04-16T13:04:45.998493+0000","last_active":"2024-04-16T13:04:53.526614+0000","last_peered":"2024-04-16T13:04:53.526614+0000","last_clean":"2024-04-16T13:04:53.526614+0000","last_became_active":"2024-04-16T13:04:45.998193+0000","last_became_peered":"2024-04-16T13:04:45.998193+0000","last_unstale":"2024-04-16T13:04:53.526614+0000","last_undegraded":"2024-04-16T13:04:53.526614+0000","last_fullsized":"2024-04-16T13:04:53.526614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:58.423993+0000","last_change":"2024-04-16T13:04:45.015482+0000","last_active":"2024-04-16T13:04:58.423993+0000","last_peered":"2024-04-16T13:04:58.423993+0000","last_clean":"2024-04-16T13:04:58.423993+0000","last_became_active":"2024-04-16T13:04:45.015101+0000","last_became_peered":"2024-04-16T13:04:45.015101+0000","last_unstale":"2024-04-16T13:04:58.423993+0000","last_undegraded":"2024-04-16T13:04:58.423993+0000","last_fullsized":"2024-04-16T13:04:58.423993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137698+0000","last_change":"2024-04-16T13:04:50.167914+0000","last_active":"2024-04-16T13:04:52.137698+0000","last_peered":"2024-04-16T13:04:52.137698+0000","last_clean":"2024-04-16T13:04:52.137698+0000","last_became_active":"2024-04-16T13:04:50.167516+0000","last_became_peered":"2024-04-16T13:04:50.167516+0000","last_unstale":"2024-04-16T13:04:52.137698+0000","last_undegraded":"2024-04-16T13:04:52.137698+0000","last_fullsized":"2024-04-16T13:04:52.137698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143485+0000","last_change":"2024-04-16T13:04:45.990047+0000","last_active":"2024-04-16T13:04:52.143485+0000","last_peered":"2024-04-16T13:04:52.143485+0000","last_clean":"2024-04-16T13:04:52.143485+0000","last_became_active":"2024-04-16T13:04:45.989544+0000","last_became_peered":"2024-04-16T13:04:45.989544+0000","last_unstale":"2024-04-16T13:04:52.143485+0000","last_undegraded":"2024-04-16T13:04:52.143485+0000","last_fullsized":"2024-04-16T13:04:52.143485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:41.080920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138591+0000","last_change":"2024-04-16T13:04:45.016272+0000","last_active":"2024-04-16T13:04:52.138591+0000","last_peered":"2024-04-16T13:04:52.138591+0000","last_clean":"2024-04-16T13:04:52.138591+0000","last_became_active":"2024-04-16T13:04:45.015942+0000","last_became_peered":"2024-04-16T13:04:45.015942+0000","last_unstale":"2024-04-16T13:04:52.138591+0000","last_undegraded":"2024-04-16T13:04:52.138591+0000","last_fullsized":"2024-04-16T13:04:52.138591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142942+0000","last_change":"2024-04-16T13:04:50.167454+0000","last_active":"2024-04-16T13:04:52.142942+0000","last_peered":"2024-04-16T13:04:52.142942+0000","last_clean":"2024-04-16T13:04:52.142942+0000","last_became_active":"2024-04-16T13:04:50.166243+0000","last_became_peered":"2024-04-16T13:04:50.166243+0000","last_unstale":"2024-04-16T13:04:52.142942+0000","last_undegraded":"2024-04-16T13:04:52.142942+0000","last_fullsized":"2024-04-16T13:04:52.142942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:44.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137930+0000","last_change":"2024-04-16T13:04:46.010441+0000","last_active":"2024-04-16T13:04:53.137930+0000","last_peered":"2024-04-16T13:04:53.137930+0000","last_clean":"2024-04-16T13:04:53.137930+0000","last_became_active":"2024-04-16T13:04:46.010071+0000","last_became_peered":"2024-04-16T13:04:46.010071+0000","last_unstale":"2024-04-16T13:04:53.137930+0000","last_undegraded":"2024-04-16T13:04:53.137930+0000","last_fullsized":"2024-04-16T13:04:53.137930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127981+0000","last_change":"2024-04-16T13:04:45.019809+0000","last_active":"2024-04-16T13:04:53.127981+0000","last_peered":"2024-04-16T13:04:53.127981+0000","last_clean":"2024-04-16T13:04:53.127981+0000","last_became_active":"2024-04-16T13:04:45.019299+0000","last_became_peered":"2024-04-16T13:04:45.019299+0000","last_unstale":"2024-04-16T13:04:53.127981+0000","last_undegraded":"2024-04-16T13:04:53.127981+0000","last_fullsized":"2024-04-16T13:04:53.127981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140403+0000","last_change":"2024-04-16T13:04:50.164233+0000","last_active":"2024-04-16T13:04:52.140403+0000","last_peered":"2024-04-16T13:04:52.140403+0000","last_clean":"2024-04-16T13:04:52.140403+0000","last_became_active":"2024-04-16T13:04:50.161088+0000","last_became_peered":"2024-04-16T13:04:50.161088+0000","last_unstale":"2024-04-16T13:04:52.140403+0000","last_undegraded":"2024-04-16T13:04:52.140403+0000","last_fullsized":"2024-04-16T13:04:52.140403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:52:19.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130074+0000","last_change":"2024-04-16T13:04:46.009061+0000","last_active":"2024-04-16T13:04:53.130074+0000","last_peered":"2024-04-16T13:04:53.130074+0000","last_clean":"2024-04-16T13:04:53.130074+0000","last_became_active":"2024-04-16T13:04:46.008721+0000","last_became_peered":"2024-04-16T13:04:46.008721+0000","last_unstale":"2024-04-16T13:04:53.130074+0000","last_undegraded":"2024-04-16T13:04:53.130074+0000","last_fullsized":"2024-04-16T13:04:53.130074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017766+0000","last_change":"2024-04-16T13:04:45.021156+0000","last_active":"2024-04-16T13:04:53.017766+0000","last_peered":"2024-04-16T13:04:53.017766+0000","last_clean":"2024-04-16T13:04:53.017766+0000","last_became_active":"2024-04-16T13:04:45.020854+0000","last_became_peered":"2024-04-16T13:04:45.020854+0000","last_unstale":"2024-04-16T13:04:53.017766+0000","last_undegraded":"2024-04-16T13:04:53.017766+0000","last_fullsized":"2024-04-16T13:04:53.017766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140351+0000","last_change":"2024-04-16T13:04:50.707455+0000","last_active":"2024-04-16T13:04:52.140351+0000","last_peered":"2024-04-16T13:04:52.140351+0000","last_clean":"2024-04-16T13:04:52.140351+0000","last_became_active":"2024-04-16T13:04:50.706437+0000","last_became_peered":"2024-04-16T13:04:50.706437+0000","last_unstale":"2024-04-16T13:04:52.140351+0000","last_undegraded":"2024-04-16T13:04:52.140351+0000","last_fullsized":"2024-04-16T13:04:52.140351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:07:07.045544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137384+0000","last_change":"2024-04-16T13:04:50.708826+0000","last_active":"2024-04-16T13:04:53.137384+0000","last_peered":"2024-04-16T13:04:53.137384+0000","last_clean":"2024-04-16T13:04:53.137384+0000","last_became_active":"2024-04-16T13:04:50.707859+0000","last_became_peered":"2024-04-16T13:04:50.707859+0000","last_unstale":"2024-04-16T13:04:53.137384+0000","last_undegraded":"2024-04-16T13:04:53.137384+0000","last_fullsized":"2024-04-16T13:04:53.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136926+0000","last_change":"2024-04-16T13:04:46.000392+0000","last_active":"2024-04-16T13:04:52.136926+0000","last_peered":"2024-04-16T13:04:52.136926+0000","last_clean":"2024-04-16T13:04:52.136926+0000","last_became_active":"2024-04-16T13:04:46.000078+0000","last_became_peered":"2024-04-16T13:04:46.000078+0000","last_unstale":"2024-04-16T13:04:52.136926+0000","last_undegraded":"2024-04-16T13:04:52.136926+0000","last_fullsized":"2024-04-16T13:04:52.136926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127941+0000","last_change":"2024-04-16T13:04:45.006496+0000","last_active":"2024-04-16T13:04:53.127941+0000","last_peered":"2024-04-16T13:04:53.127941+0000","last_clean":"2024-04-16T13:04:53.127941+0000","last_became_active":"2024-04-16T13:04:45.006186+0000","last_became_peered":"2024-04-16T13:04:45.006186+0000","last_unstale":"2024-04-16T13:04:53.127941+0000","last_undegraded":"2024-04-16T13:04:53.127941+0000","last_fullsized":"2024-04-16T13:04:53.127941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017419+0000","last_change":"2024-04-16T13:04:50.176861+0000","last_active":"2024-04-16T13:04:53.017419+0000","last_peered":"2024-04-16T13:04:53.017419+0000","last_clean":"2024-04-16T13:04:53.017419+0000","last_became_active":"2024-04-16T13:04:50.176348+0000","last_became_peered":"2024-04-16T13:04:50.176348+0000","last_unstale":"2024-04-16T13:04:53.017419+0000","last_undegraded":"2024-04-16T13:04:53.017419+0000","last_fullsized":"2024-04-16T13:04:53.017419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140739+0000","last_change":"2024-04-16T13:04:46.000621+0000","last_active":"2024-04-16T13:04:52.140739+0000","last_peered":"2024-04-16T13:04:52.140739+0000","last_clean":"2024-04-16T13:04:52.140739+0000","last_became_active":"2024-04-16T13:04:46.000319+0000","last_became_peered":"2024-04-16T13:04:46.000319+0000","last_unstale":"2024-04-16T13:04:52.140739+0000","last_undegraded":"2024-04-16T13:04:52.140739+0000","last_fullsized":"2024-04-16T13:04:52.140739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141221+0000","last_change":"2024-04-16T13:04:45.006224+0000","last_active":"2024-04-16T13:04:52.141221+0000","last_peered":"2024-04-16T13:04:52.141221+0000","last_clean":"2024-04-16T13:04:52.141221+0000","last_became_active":"2024-04-16T13:04:45.005898+0000","last_became_peered":"2024-04-16T13:04:45.005898+0000","last_unstale":"2024-04-16T13:04:52.141221+0000","last_undegraded":"2024-04-16T13:04:52.141221+0000","last_fullsized":"2024-04-16T13:04:52.141221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015851+0000","last_change":"2024-04-16T13:04:45.019025+0000","last_active":"2024-04-16T13:04:53.015851+0000","last_peered":"2024-04-16T13:04:53.015851+0000","last_clean":"2024-04-16T13:04:53.015851+0000","last_became_active":"2024-04-16T13:04:45.015700+0000","last_became_peered":"2024-04-16T13:04:45.015700+0000","last_unstale":"2024-04-16T13:04:53.015851+0000","last_undegraded":"2024-04-16T13:04:53.015851+0000","last_fullsized":"2024-04-16T13:04:53.015851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137290+0000","last_change":"2024-04-16T13:04:46.018489+0000","last_active":"2024-04-16T13:04:53.137290+0000","last_peered":"2024-04-16T13:04:53.137290+0000","last_clean":"2024-04-16T13:04:53.137290+0000","last_became_active":"2024-04-16T13:04:46.018109+0000","last_became_peered":"2024-04-16T13:04:46.018109+0000","last_unstale":"2024-04-16T13:04:53.137290+0000","last_undegraded":"2024-04-16T13:04:53.137290+0000","last_fullsized":"2024-04-16T13:04:53.137290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018321+0000","last_change":"2024-04-16T13:04:50.172707+0000","last_active":"2024-04-16T13:04:53.018321+0000","last_peered":"2024-04-16T13:04:53.018321+0000","last_clean":"2024-04-16T13:04:53.018321+0000","last_became_active":"2024-04-16T13:04:50.172280+0000","last_became_peered":"2024-04-16T13:04:50.172280+0000","last_unstale":"2024-04-16T13:04:53.018321+0000","last_undegraded":"2024-04-16T13:04:53.018321+0000","last_fullsized":"2024-04-16T13:04:53.018321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:04.522503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140744+0000","last_change":"2024-04-16T13:04:45.005110+0000","last_active":"2024-04-16T13:04:52.140744+0000","last_peered":"2024-04-16T13:04:52.140744+0000","last_clean":"2024-04-16T13:04:52.140744+0000","last_became_active":"2024-04-16T13:04:45.004820+0000","last_became_peered":"2024-04-16T13:04:45.004820+0000","last_unstale":"2024-04-16T13:04:52.140744+0000","last_undegraded":"2024-04-16T13:04:52.140744+0000","last_fullsized":"2024-04-16T13:04:52.140744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142646+0000","last_change":"2024-04-16T13:04:45.992254+0000","last_active":"2024-04-16T13:04:52.142646+0000","last_peered":"2024-04-16T13:04:52.142646+0000","last_clean":"2024-04-16T13:04:52.142646+0000","last_became_active":"2024-04-16T13:04:45.991789+0000","last_became_peered":"2024-04-16T13:04:45.991789+0000","last_unstale":"2024-04-16T13:04:52.142646+0000","last_undegraded":"2024-04-16T13:04:52.142646+0000","last_fullsized":"2024-04-16T13:04:52.142646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:40.238739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141125+0000","last_change":"2024-04-16T13:04:50.166825+0000","last_active":"2024-04-16T13:04:52.141125+0000","last_peered":"2024-04-16T13:04:52.141125+0000","last_clean":"2024-04-16T13:04:52.141125+0000","last_became_active":"2024-04-16T13:04:50.163810+0000","last_became_peered":"2024-04-16T13:04:50.163810+0000","last_unstale":"2024-04-16T13:04:52.141125+0000","last_undegraded":"2024-04-16T13:04:52.141125+0000","last_fullsized":"2024-04-16T13:04:52.141125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:27.336747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015243+0000","last_change":"2024-04-16T13:04:46.003053+0000","last_active":"2024-04-16T13:04:53.015243+0000","last_peered":"2024-04-16T13:04:53.015243+0000","last_clean":"2024-04-16T13:04:53.015243+0000","last_became_active":"2024-04-16T13:04:46.002349+0000","last_became_peered":"2024-04-16T13:04:46.002349+0000","last_unstale":"2024-04-16T13:04:53.015243+0000","last_undegraded":"2024-04-16T13:04:53.015243+0000","last_fullsized":"2024-04-16T13:04:53.015243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017790+0000","last_change":"2024-04-16T13:04:46.012253+0000","last_active":"2024-04-16T13:04:53.017790+0000","last_peered":"2024-04-16T13:04:53.017790+0000","last_clean":"2024-04-16T13:04:53.017790+0000","last_became_active":"2024-04-16T13:04:46.011827+0000","last_became_peered":"2024-04-16T13:04:46.011827+0000","last_unstale":"2024-04-16T13:04:53.017790+0000","last_undegraded":"2024-04-16T13:04:53.017790+0000","last_fullsized":"2024-04-16T13:04:53.017790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129257+0000","last_change":"2024-04-16T13:04:46.005260+0000","last_active":"2024-04-16T13:04:53.129257+0000","last_peered":"2024-04-16T13:04:53.129257+0000","last_clean":"2024-04-16T13:04:53.129257+0000","last_became_active":"2024-04-16T13:04:46.004249+0000","last_became_peered":"2024-04-16T13:04:46.004249+0000","last_unstale":"2024-04-16T13:04:53.129257+0000","last_undegraded":"2024-04-16T13:04:53.129257+0000","last_fullsized":"2024-04-16T13:04:53.129257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137145+0000","last_change":"2024-04-16T13:04:46.004033+0000","last_active":"2024-04-16T13:04:53.137145+0000","last_peered":"2024-04-16T13:04:53.137145+0000","last_clean":"2024-04-16T13:04:53.137145+0000","last_became_active":"2024-04-16T13:04:46.002797+0000","last_became_peered":"2024-04-16T13:04:46.002797+0000","last_unstale":"2024-04-16T13:04:53.137145+0000","last_undegraded":"2024-04-16T13:04:53.137145+0000","last_fullsized":"2024-04-16T13:04:53.137145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:33.289858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141301+0000","last_change":"2024-04-16T13:04:46.004426+0000","last_active":"2024-04-16T13:04:52.141301+0000","last_peered":"2024-04-16T13:04:52.141301+0000","last_clean":"2024-04-16T13:04:52.141301+0000","last_became_active":"2024-04-16T13:04:46.004142+0000","last_became_peered":"2024-04-16T13:04:46.004142+0000","last_unstale":"2024-04-16T13:04:52.141301+0000","last_undegraded":"2024-04-16T13:04:52.141301+0000","last_fullsized":"2024-04-16T13:04:52.141301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138556+0000","last_change":"2024-04-16T13:04:45.996051+0000","last_active":"2024-04-16T13:04:52.138556+0000","last_peered":"2024-04-16T13:04:52.138556+0000","last_clean":"2024-04-16T13:04:52.138556+0000","last_became_active":"2024-04-16T13:04:45.995786+0000","last_became_peered":"2024-04-16T13:04:45.995786+0000","last_unstale":"2024-04-16T13:04:52.138556+0000","last_undegraded":"2024-04-16T13:04:52.138556+0000","last_fullsized":"2024-04-16T13:04:52.138556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017733+0000","last_change":"2024-04-16T13:04:46.014233+0000","last_active":"2024-04-16T13:04:53.017733+0000","last_peered":"2024-04-16T13:04:53.017733+0000","last_clean":"2024-04-16T13:04:53.017733+0000","last_became_active":"2024-04-16T13:04:46.007756+0000","last_became_peered":"2024-04-16T13:04:46.007756+0000","last_unstale":"2024-04-16T13:04:53.017733+0000","last_undegraded":"2024-04-16T13:04:53.017733+0000","last_fullsized":"2024-04-16T13:04:53.017733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141176+0000","last_change":"2024-04-16T13:04:46.002910+0000","last_active":"2024-04-16T13:04:52.141176+0000","last_peered":"2024-04-16T13:04:52.141176+0000","last_clean":"2024-04-16T13:04:52.141176+0000","last_became_active":"2024-04-16T13:04:46.002453+0000","last_became_peered":"2024-04-16T13:04:46.002453+0000","last_unstale":"2024-04-16T13:04:52.141176+0000","last_undegraded":"2024-04-16T13:04:52.141176+0000","last_fullsized":"2024-04-16T13:04:52.141176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128952+0000","last_change":"2024-04-16T13:04:46.004049+0000","last_active":"2024-04-16T13:04:53.128952+0000","last_peered":"2024-04-16T13:04:53.128952+0000","last_clean":"2024-04-16T13:04:53.128952+0000","last_became_active":"2024-04-16T13:04:46.003706+0000","last_became_peered":"2024-04-16T13:04:46.003706+0000","last_unstale":"2024-04-16T13:04:53.128952+0000","last_undegraded":"2024-04-16T13:04:53.128952+0000","last_fullsized":"2024-04-16T13:04:53.128952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141077+0000","last_change":"2024-04-16T13:04:45.995750+0000","last_active":"2024-04-16T13:04:52.141077+0000","last_peered":"2024-04-16T13:04:52.141077+0000","last_clean":"2024-04-16T13:04:52.141077+0000","last_became_active":"2024-04-16T13:04:45.995236+0000","last_became_peered":"2024-04-16T13:04:45.995236+0000","last_unstale":"2024-04-16T13:04:52.141077+0000","last_undegraded":"2024-04-16T13:04:52.141077+0000","last_fullsized":"2024-04-16T13:04:52.141077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129172+0000","last_change":"2024-04-16T13:04:46.004985+0000","last_active":"2024-04-16T13:04:53.129172+0000","last_peered":"2024-04-16T13:04:53.129172+0000","last_clean":"2024-04-16T13:04:53.129172+0000","last_became_active":"2024-04-16T13:04:46.003800+0000","last_became_peered":"2024-04-16T13:04:46.003800+0000","last_unstale":"2024-04-16T13:04:53.129172+0000","last_undegraded":"2024-04-16T13:04:53.129172+0000","last_fullsized":"2024-04-16T13:04:53.129172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136544+0000","last_change":"2024-04-16T13:04:46.004265+0000","last_active":"2024-04-16T13:04:53.136544+0000","last_peered":"2024-04-16T13:04:53.136544+0000","last_clean":"2024-04-16T13:04:53.136544+0000","last_became_active":"2024-04-16T13:04:46.003115+0000","last_became_peered":"2024-04-16T13:04:46.003115+0000","last_unstale":"2024-04-16T13:04:53.136544+0000","last_undegraded":"2024-04-16T13:04:53.136544+0000","last_fullsized":"2024-04-16T13:04:53.136544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:52.579674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016869+0000","last_change":"2024-04-16T13:04:46.018522+0000","last_active":"2024-04-16T13:04:53.016869+0000","last_peered":"2024-04-16T13:04:53.016869+0000","last_clean":"2024-04-16T13:04:53.016869+0000","last_became_active":"2024-04-16T13:04:46.008619+0000","last_became_peered":"2024-04-16T13:04:46.008619+0000","last_unstale":"2024-04-16T13:04:53.016869+0000","last_undegraded":"2024-04-16T13:04:53.016869+0000","last_fullsized":"2024-04-16T13:04:53.016869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527232+0000","last_change":"2024-04-16T13:04:45.996736+0000","last_active":"2024-04-16T13:04:53.527232+0000","last_peered":"2024-04-16T13:04:53.527232+0000","last_clean":"2024-04-16T13:04:53.527232+0000","last_became_active":"2024-04-16T13:04:45.996437+0000","last_became_peered":"2024-04-16T13:04:45.996437+0000","last_unstale":"2024-04-16T13:04:53.527232+0000","last_undegraded":"2024-04-16T13:04:53.527232+0000","last_fullsized":"2024-04-16T13:04:53.527232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.019040+0000","last_change":"2024-04-16T13:04:46.000008+0000","last_active":"2024-04-16T13:04:53.019040+0000","last_peered":"2024-04-16T13:04:53.019040+0000","last_clean":"2024-04-16T13:04:53.019040+0000","last_became_active":"2024-04-16T13:04:45.999290+0000","last_became_peered":"2024-04-16T13:04:45.999290+0000","last_unstale":"2024-04-16T13:04:53.019040+0000","last_undegraded":"2024-04-16T13:04:53.019040+0000","last_fullsized":"2024-04-16T13:04:53.019040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:39.017477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130606+0000","last_change":"2024-04-16T13:04:46.010682+0000","last_active":"2024-04-16T13:04:53.130606+0000","last_peered":"2024-04-16T13:04:53.130606+0000","last_clean":"2024-04-16T13:04:53.130606+0000","last_became_active":"2024-04-16T13:04:46.008966+0000","last_became_peered":"2024-04-16T13:04:46.008966+0000","last_unstale":"2024-04-16T13:04:53.130606+0000","last_undegraded":"2024-04-16T13:04:53.130606+0000","last_fullsized":"2024-04-16T13:04:53.130606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128870+0000","last_change":"2024-04-16T13:04:46.003968+0000","last_active":"2024-04-16T13:04:53.128870+0000","last_peered":"2024-04-16T13:04:53.128870+0000","last_clean":"2024-04-16T13:04:53.128870+0000","last_became_active":"2024-04-16T13:04:46.003377+0000","last_became_peered":"2024-04-16T13:04:46.003377+0000","last_unstale":"2024-04-16T13:04:53.128870+0000","last_undegraded":"2024-04-16T13:04:53.128870+0000","last_fullsized":"2024-04-16T13:04:53.128870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136997+0000","last_change":"2024-04-16T13:04:45.986929+0000","last_active":"2024-04-16T13:04:52.136997+0000","last_peered":"2024-04-16T13:04:52.136997+0000","last_clean":"2024-04-16T13:04:52.136997+0000","last_became_active":"2024-04-16T13:04:45.986136+0000","last_became_peered":"2024-04-16T13:04:45.986136+0000","last_unstale":"2024-04-16T13:04:52.136997+0000","last_undegraded":"2024-04-16T13:04:52.136997+0000","last_fullsized":"2024-04-16T13:04:52.136997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136540+0000","last_change":"2024-04-16T13:04:46.006745+0000","last_active":"2024-04-16T13:04:53.136540+0000","last_peered":"2024-04-16T13:04:53.136540+0000","last_clean":"2024-04-16T13:04:53.136540+0000","last_became_active":"2024-04-16T13:04:46.005822+0000","last_became_peered":"2024-04-16T13:04:46.005822+0000","last_unstale":"2024-04-16T13:04:53.136540+0000","last_undegraded":"2024-04-16T13:04:53.136540+0000","last_fullsized":"2024-04-16T13:04:53.136540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:36.399411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141458+0000","last_change":"2024-04-16T13:04:46.019457+0000","last_active":"2024-04-16T13:04:52.141458+0000","last_peered":"2024-04-16T13:04:52.141458+0000","last_clean":"2024-04-16T13:04:52.141458+0000","last_became_active":"2024-04-16T13:04:46.017865+0000","last_became_peered":"2024-04-16T13:04:46.017865+0000","last_unstale":"2024-04-16T13:04:52.141458+0000","last_undegraded":"2024-04-16T13:04:52.141458+0000","last_fullsized":"2024-04-16T13:04:52.141458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143225+0000","last_change":"2024-04-16T13:04:46.008099+0000","last_active":"2024-04-16T13:04:52.143225+0000","last_peered":"2024-04-16T13:04:52.143225+0000","last_clean":"2024-04-16T13:04:52.143225+0000","last_became_active":"2024-04-16T13:04:46.007709+0000","last_became_peered":"2024-04-16T13:04:46.007709+0000","last_unstale":"2024-04-16T13:04:52.143225+0000","last_undegraded":"2024-04-16T13:04:52.143225+0000","last_fullsized":"2024-04-16T13:04:52.143225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018093+0000","last_change":"2024-04-16T13:04:46.020412+0000","last_active":"2024-04-16T13:04:53.018093+0000","last_peered":"2024-04-16T13:04:53.018093+0000","last_clean":"2024-04-16T13:04:53.018093+0000","last_became_active":"2024-04-16T13:04:46.020176+0000","last_became_peered":"2024-04-16T13:04:46.020176+0000","last_unstale":"2024-04-16T13:04:53.018093+0000","last_undegraded":"2024-04-16T13:04:53.018093+0000","last_fullsized":"2024-04-16T13:04:53.018093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017641+0000","last_change":"2024-04-16T13:04:46.017218+0000","last_active":"2024-04-16T13:04:53.017641+0000","last_peered":"2024-04-16T13:04:53.017641+0000","last_clean":"2024-04-16T13:04:53.017641+0000","last_became_active":"2024-04-16T13:04:46.014646+0000","last_became_peered":"2024-04-16T13:04:46.014646+0000","last_unstale":"2024-04-16T13:04:53.017641+0000","last_undegraded":"2024-04-16T13:04:53.017641+0000","last_fullsized":"2024-04-16T13:04:53.017641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527498+0000","last_change":"2024-04-16T13:04:46.009985+0000","last_active":"2024-04-16T13:04:53.527498+0000","last_peered":"2024-04-16T13:04:53.527498+0000","last_clean":"2024-04-16T13:04:53.527498+0000","last_became_active":"2024-04-16T13:04:46.009696+0000","last_became_peered":"2024-04-16T13:04:46.009696+0000","last_unstale":"2024-04-16T13:04:53.527498+0000","last_undegraded":"2024-04-16T13:04:53.527498+0000","last_fullsized":"2024-04-16T13:04:53.527498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:40.104541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140079+0000","last_change":"2024-04-16T13:04:46.006877+0000","last_active":"2024-04-16T13:04:52.140079+0000","last_peered":"2024-04-16T13:04:52.140079+0000","last_clean":"2024-04-16T13:04:52.140079+0000","last_became_active":"2024-04-16T13:04:46.006436+0000","last_became_peered":"2024-04-16T13:04:46.006436+0000","last_unstale":"2024-04-16T13:04:52.140079+0000","last_undegraded":"2024-04-16T13:04:52.140079+0000","last_fullsized":"2024-04-16T13:04:52.140079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526019+0000","last_change":"2024-04-16T13:04:46.004191+0000","last_active":"2024-04-16T13:04:53.526019+0000","last_peered":"2024-04-16T13:04:53.526019+0000","last_clean":"2024-04-16T13:04:53.526019+0000","last_became_active":"2024-04-16T13:04:46.003868+0000","last_became_peered":"2024-04-16T13:04:46.003868+0000","last_unstale":"2024-04-16T13:04:53.526019+0000","last_undegraded":"2024-04-16T13:04:53.526019+0000","last_fullsized":"2024-04-16T13:04:53.526019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128991+0000","last_change":"2024-04-16T13:04:46.005552+0000","last_active":"2024-04-16T13:04:53.128991+0000","last_peered":"2024-04-16T13:04:53.128991+0000","last_clean":"2024-04-16T13:04:53.128991+0000","last_became_active":"2024-04-16T13:04:46.004596+0000","last_became_peered":"2024-04-16T13:04:46.004596+0000","last_unstale":"2024-04-16T13:04:53.128991+0000","last_undegraded":"2024-04-16T13:04:53.128991+0000","last_fullsized":"2024-04-16T13:04:53.128991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525853+0000","last_change":"2024-04-16T13:04:45.997612+0000","last_active":"2024-04-16T13:04:53.525853+0000","last_peered":"2024-04-16T13:04:53.525853+0000","last_clean":"2024-04-16T13:04:53.525853+0000","last_became_active":"2024-04-16T13:04:45.996762+0000","last_became_peered":"2024-04-16T13:04:45.996762+0000","last_unstale":"2024-04-16T13:04:53.525853+0000","last_undegraded":"2024-04-16T13:04:53.525853+0000","last_fullsized":"2024-04-16T13:04:53.525853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129465+0000","last_change":"2024-04-16T13:04:46.008999+0000","last_active":"2024-04-16T13:04:53.129465+0000","last_peered":"2024-04-16T13:04:53.129465+0000","last_clean":"2024-04-16T13:04:53.129465+0000","last_became_active":"2024-04-16T13:04:46.008352+0000","last_became_peered":"2024-04-16T13:04:46.008352+0000","last_unstale":"2024-04-16T13:04:53.129465+0000","last_undegraded":"2024-04-16T13:04:53.129465+0000","last_fullsized":"2024-04-16T13:04:53.129465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136867+0000","last_change":"2024-04-16T13:04:46.005440+0000","last_active":"2024-04-16T13:04:53.136867+0000","last_peered":"2024-04-16T13:04:53.136867+0000","last_clean":"2024-04-16T13:04:53.136867+0000","last_became_active":"2024-04-16T13:04:46.002984+0000","last_became_peered":"2024-04-16T13:04:46.002984+0000","last_unstale":"2024-04-16T13:04:53.136867+0000","last_undegraded":"2024-04-16T13:04:53.136867+0000","last_fullsized":"2024-04-16T13:04:53.136867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138984+0000","last_change":"2024-04-16T13:04:46.009580+0000","last_active":"2024-04-16T13:04:52.138984+0000","last_peered":"2024-04-16T13:04:52.138984+0000","last_clean":"2024-04-16T13:04:52.138984+0000","last_became_active":"2024-04-16T13:04:46.008940+0000","last_became_peered":"2024-04-16T13:04:46.008940+0000","last_unstale":"2024-04-16T13:04:52.138984+0000","last_undegraded":"2024-04-16T13:04:52.138984+0000","last_fullsized":"2024-04-16T13:04:52.138984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527357+0000","last_change":"2024-04-16T13:04:46.007107+0000","last_active":"2024-04-16T13:04:53.527357+0000","last_peered":"2024-04-16T13:04:53.527357+0000","last_clean":"2024-04-16T13:04:53.527357+0000","last_became_active":"2024-04-16T13:04:46.006881+0000","last_became_peered":"2024-04-16T13:04:46.006881+0000","last_unstale":"2024-04-16T13:04:53.527357+0000","last_undegraded":"2024-04-16T13:04:53.527357+0000","last_fullsized":"2024-04-16T13:04:53.527357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:05:10.301 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T13:05:10.302 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T13:05:10.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-16T13:05:10.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-16T13:05:10.302 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T13:05:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.565+0000 7f399ca00640 1 Processor -- start 2024-04-16T13:05:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.565+0000 7f399ca00640 1 -- start start 2024-04-16T13:05:10.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.567+0000 7f399ca00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3998152440 0x7f39980b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.567+0000 7f399ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.567+0000 7f399ca00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f399815c8f0 con 0x7f399815ba30 2024-04-16T13:05:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.567+0000 7f399ca00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f399806ff20 con 0x7f3998152440 2024-04-16T13:05:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.567+0000 7f399ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f399815c610 con 0x7f399806f5a0 2024-04-16T13:05:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.568+0000 7f398fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.568+0000 7f3996800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3998152440 0x7f39980b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.568+0000 7f398fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:43274/0 (socket says 172.21.15.67:43274) 2024-04-16T13:05:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.568+0000 7f398fe00640 1 -- 172.21.15.67:0/788201972 learned_addr learned my addr 172.21.15.67:0/788201972 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.568+0000 7f3997200640 1 --1- 172.21.15.67:0/788201972 >> v1:172.21.15.82:6789/0 conn(0x7f399815ba30 0x7f3998071c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:46620/0 (socket says 172.21.15.67:46620) 2024-04-16T13:05:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.569+0000 7f398fe00640 1 -- 172.21.15.67:0/788201972 >> v2:172.21.15.82:3300/0 conn(0x7f3998152440 msgr2=0x7f39980b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.569+0000 7f398fe00640 1 --2- 172.21.15.67:0/788201972 >> v2:172.21.15.82:3300/0 conn(0x7f3998152440 0x7f39980b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.569+0000 7f398fe00640 1 -- 172.21.15.67:0/788201972 >> v1:172.21.15.82:6789/0 conn(0x7f399815ba30 legacy=0x7f3998071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.569+0000 7f398fe00640 1 -- 172.21.15.67:0/788201972 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39980b3230 con 0x7f399806f5a0 2024-04-16T13:05:10.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.571+0000 7f398fe00640 1 --2- 172.21.15.67:0/788201972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3980009870 tx=0x7f398002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea52da8421c7b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.571+0000 7f3995e00640 1 -- 172.21.15.67:0/788201972 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980034070 con 0x7f399806f5a0 2024-04-16T13:05:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.571+0000 7f3995e00640 1 -- 172.21.15.67:0/788201972 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3980030840 con 0x7f399806f5a0 2024-04-16T13:05:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.571+0000 7f3995e00640 1 -- 172.21.15.67:0/788201972 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980030c10 con 0x7f399806f5a0 2024-04-16T13:05:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 -- 172.21.15.67:0/788201972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 msgr2=0x7f399806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 --2- 172.21.15.67:0/788201972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3980009870 tx=0x7f398002b980 comp rx=0 tx=0).stop 2024-04-16T13:05:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 -- 172.21.15.67:0/788201972 shutdown_connections 2024-04-16T13:05:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 --2- 172.21.15.67:0/788201972 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f399806f5a0 0x7f399806f9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 --2- 172.21.15.67:0/788201972 >> v2:172.21.15.82:3300/0 conn(0x7f3998152440 0x7f39980b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 -- 172.21.15.67:0/788201972 >> 172.21.15.67:0/788201972 conn(0x7f39980d0220 msgr2=0x7f39980d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 -- 172.21.15.67:0/788201972 shutdown_connections 2024-04-16T13:05:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.572+0000 7f399ca00640 1 -- 172.21.15.67:0/788201972 wait complete. 2024-04-16T13:05:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.574+0000 7f399ca00640 1 Processor -- start 2024-04-16T13:05:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.574+0000 7f399ca00640 1 -- start start 2024-04-16T13:05:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3998152440 0x7f39981f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f399815ba30 0x7f399815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3998073b40 con 0x7f399806f5a0 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39980b37f0 con 0x7f399815ba30 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f399ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3998152820 con 0x7f3998152440 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f3996800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f3996800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54398/0 (socket says 172.21.15.67:54398) 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f3996800640 1 -- 172.21.15.67:0/3117646621 learned_addr learned my addr 172.21.15.67:0/3117646621 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.575+0000 7f3997200640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f399815ba30 0x7f399815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 -- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3998152440 msgr2=0x7f39981f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3998152440 0x7f39981f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 -- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f399815ba30 msgr2=0x7f399815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f399815ba30 0x7f399815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 -- 172.21.15.67:0/3117646621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399814c890 con 0x7f399806f5a0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f3996800640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f398800eb40 tx=0x7f398800d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988010440 con 0x7f399806f5a0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39880105e0 con 0x7f399806f5a0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39880109d0 con 0x7f399806f5a0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3998146e10 con 0x7f399806f5a0 2024-04-16T13:05:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.576+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3998147460 con 0x7f399806f5a0 2024-04-16T13:05:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.577+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3998075bd0 con 0x7f399806f5a0 2024-04-16T13:05:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.579+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3988010b70 con 0x7f399806f5a0 2024-04-16T13:05:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.579+0000 7f398ea00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 0x7f397406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:10.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.580+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f398808c900 con 0x7f399806f5a0 2024-04-16T13:05:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.580+0000 7f398fe00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 0x7f397406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.581+0000 7f398fe00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 0x7f397406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3980036000 tx=0x7f398003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.584+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3988014030 con 0x7f399806f5a0 2024-04-16T13:05:10.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.849+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f39980cff90 con 0x7f399806f5a0 2024-04-16T13:05:10.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.853+0000 7f398ea00640 1 -- 172.21.15.67:0/3117646621 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174134 (secure 0 0 0) 0x7f398805a390 con 0x7f399806f5a0 2024-04-16T13:05:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.857+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 msgr2=0x7f397406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.857+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 0x7f397406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3980036000 tx=0x7f398003b040 comp rx=0 tx=0).stop 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.857+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 msgr2=0x7f3998149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.857+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f398800eb40 tx=0x7f398800d350 comp rx=0 tx=0).stop 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 shutdown_connections 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f397406c8f0 0x7f397406edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f399815ba30 0x7f399815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3998152440 0x7f39981f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 --2- 172.21.15.67:0/3117646621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f399806f5a0 0x7f3998149900 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 >> 172.21.15.67:0/3117646621 conn(0x7f39980d0220 msgr2=0x7f399814f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 shutdown_connections 2024-04-16T13:05:10.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:10.858+0000 7f399ca00640 1 -- 172.21.15.67:0/3117646621 wait complete. 2024-04-16T13:05:10.877 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":482426286},{"type":"v1","addr":"172.21.15.82:6833","nonce":482426286}]},"active_addr":"172.21.15.82:6833/482426286","active_change":"2024-04-16T13:04:26.465576+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1878037033}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3331001892}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2999895468}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3131499321}]}]} 2024-04-16T13:05:10.881 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-16T13:05:10.882 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-16T13:05:10.882 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.103+0000 7f846d400640 1 Processor -- start 2024-04-16T13:05:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.103+0000 7f846d400640 1 -- start start 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.104+0000 7f846d400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8468162ef0 0x7f846806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.104+0000 7f846d400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84680b5570 0x7f8468071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.104+0000 7f846d400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846806dc70 con 0x7f846806f700 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.104+0000 7f846d400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f846806df50 con 0x7f84680b5570 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.104+0000 7f846d400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f846806e230 con 0x7f8468162ef0 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84680b5570 0x7f8468071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84680b5570 0x7f8468071e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54404/0 (socket says 172.21.15.67:54404) 2024-04-16T13:05:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 -- 172.21.15.67:0/321380742 learned_addr learned my addr 172.21.15.67:0/321380742 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f8466800640 1 --2- 172.21.15.67:0/321380742 >> v2:172.21.15.82:3300/0 conn(0x7f8468162ef0 0x7f846806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 -- 172.21.15.67:0/321380742 >> v2:172.21.15.82:3300/0 conn(0x7f8468162ef0 msgr2=0x7f846806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 --2- 172.21.15.67:0/321380742 >> v2:172.21.15.82:3300/0 conn(0x7f8468162ef0 0x7f846806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 -- 172.21.15.67:0/321380742 >> v1:172.21.15.67:6789/0 conn(0x7f846806f700 legacy=0x7f84680b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f845fe00640 1 -- 172.21.15.67:0/321380742 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846806e510 con 0x7f84680b5570 2024-04-16T13:05:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.105+0000 7f8465e00640 1 -- 172.21.15.67:0/321380742 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701743394 0 0) 0x7f846806dc70 con 0x7f846806f700 2024-04-16T13:05:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f845fe00640 1 --2- 172.21.15.67:0/321380742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468071e50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84680b2f70 tx=0x7f845002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c30e7048c5c7025 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f8465e00640 1 -- 172.21.15.67:0/321380742 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450034070 con 0x7f84680b5570 2024-04-16T13:05:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f8465e00640 1 -- 172.21.15.67:0/321380742 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8450030860 con 0x7f84680b5570 2024-04-16T13:05:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f8465e00640 1 -- 172.21.15.67:0/321380742 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450030c30 con 0x7f84680b5570 2024-04-16T13:05:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f846d400640 1 -- 172.21.15.67:0/321380742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 msgr2=0x7f8468071e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.107+0000 7f846d400640 1 --2- 172.21.15.67:0/321380742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468071e50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f84680b2f70 tx=0x7f845002b9a0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 -- 172.21.15.67:0/321380742 shutdown_connections 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 --2- 172.21.15.67:0/321380742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468071e50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 --2- 172.21.15.67:0/321380742 >> v2:172.21.15.82:3300/0 conn(0x7f8468162ef0 0x7f846806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 -- 172.21.15.67:0/321380742 >> 172.21.15.67:0/321380742 conn(0x7f84680b2210 msgr2=0x7f84680b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 -- 172.21.15.67:0/321380742 shutdown_connections 2024-04-16T13:05:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.108+0000 7f846d400640 1 -- 172.21.15.67:0/321380742 wait complete. 2024-04-16T13:05:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.109+0000 7f846d400640 1 Processor -- start 2024-04-16T13:05:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 -- start start 2024-04-16T13:05:11.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f846806f700 0x7f84681f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8468162ef0 0x7f8468159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f84680cf320 con 0x7f84680b5570 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f846806ed10 con 0x7f846806f700 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.110+0000 7f846d400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8468072390 con 0x7f8468162ef0 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54418/0 (socket says 172.21.15.67:54418) 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 -- 172.21.15.67:0/1181407273 learned_addr learned my addr 172.21.15.67:0/1181407273 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f8466800640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f846806f700 0x7f84681f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 -- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8468162ef0 msgr2=0x7f8468159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8468162ef0 0x7f8468159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 -- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f846806f700 msgr2=0x7f84681f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f846806f700 0x7f84681f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.111+0000 7f845fe00640 1 -- 172.21.15.67:0/1181407273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846815e110 con 0x7f84680b5570 2024-04-16T13:05:11.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f845fe00640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8450009960 tx=0x7f84500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450034040 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8450030660 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450039d20 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8468159cb0 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.112+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846815a240 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.113+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8468075bd0 con 0x7f84680b5570 2024-04-16T13:05:11.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.114+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8450037070 con 0x7f84680b5570 2024-04-16T13:05:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.115+0000 7f845ea00640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 0x7f844406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.115+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84500add10 con 0x7f84680b5570 2024-04-16T13:05:11.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.116+0000 7f8466800640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 0x7f844406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.117+0000 7f8466800640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 0x7f844406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.120+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f845007be00 con 0x7f84680b5570 2024-04-16T13:05:11.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.325+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8468166630 con 0x7f84680b5570 2024-04-16T13:05:11.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.328+0000 7f845ea00640 1 -- 172.21.15.67:0/1181407273 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f8450030830 con 0x7f84680b5570 2024-04-16T13:05:11.330 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:11.330 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:11.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 msgr2=0x7f844406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 0x7f844406edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 msgr2=0x7f8468159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8450009960 tx=0x7f84500046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 shutdown_connections 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f844406c8f0 0x7f844406edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8468162ef0 0x7f8468159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84680b5570 0x7f8468159230 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 --2- 172.21.15.67:0/1181407273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f846806f700 0x7f84681f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 >> 172.21.15.67:0/1181407273 conn(0x7f84680b2210 msgr2=0x7f846806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 shutdown_connections 2024-04-16T13:05:11.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.331+0000 7f846d400640 1 -- 172.21.15.67:0/1181407273 wait complete. 2024-04-16T13:05:11.353 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-16T13:05:11.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.566+0000 7f325e800640 1 Processor -- start 2024-04-16T13:05:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.567+0000 7f325e800640 1 -- start start 2024-04-16T13:05:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.568+0000 7f325e800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f325815c6f0 0x7f32581600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.568+0000 7f325e800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3258160ad0 con 0x7f32580ad880 2024-04-16T13:05:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.568+0000 7f325e800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3258160db0 con 0x7f3258160630 2024-04-16T13:05:11.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.568+0000 7f325e800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3258161090 con 0x7f325815c6f0 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.569+0000 7f325de00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32580ad880 0x7f325806e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:34244/0 (socket says 172.21.15.67:34244) 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.569+0000 7f325de00640 1 -- 172.21.15.67:0/3304087260 learned_addr learned my addr 172.21.15.67:0/3304087260 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.569+0000 7f325d400640 1 --2- 172.21.15.67:0/3304087260 >> v2:172.21.15.82:3300/0 conn(0x7f325815c6f0 0x7f32581600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.569+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757938379 0 0) 0x7f3258160ad0 con 0x7f32580ad880 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.569+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3240003520 con 0x7f32580ad880 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 166243518 0 0) 0x7f3240003520 con 0x7f32580ad880 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 >> v2:172.21.15.82:3300/0 conn(0x7f325815c6f0 msgr2=0x7f32581600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 --2- 172.21.15.67:0/3304087260 >> v2:172.21.15.82:3300/0 conn(0x7f325815c6f0 0x7f32581600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 >> v1:172.21.15.82:6789/0 conn(0x7f3258160630 legacy=0x7f32580ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325806dda0 con 0x7f32580ad880 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f32500019f0 con 0x7f32580ad880 2024-04-16T13:05:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 >> v1:172.21.15.67:6789/0 conn(0x7f32580ad880 legacy=0x7f325806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 0x7f3240003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240004800 0x7f3240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32400051c0 0x7f324000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f324000c090 con 0x7f3240003a00 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f324000c240 con 0x7f32400051c0 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f324000c440 con 0x7f3240004800 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f325d400640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 0x7f3240003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.570+0000 7f325de00640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32400051c0 0x7f324000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325ca00640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240004800 0x7f3240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325d400640 1 -- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240004800 msgr2=0x7f3240004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325d400640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240004800 0x7f3240004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325d400640 1 -- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32400051c0 msgr2=0x7f324000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:11.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325d400640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32400051c0 0x7f324000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325d400640 1 -- 172.21.15.67:0/3304087260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3240003520 con 0x7f3240003a00 2024-04-16T13:05:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.571+0000 7f325de00640 1 -- 172.21.15.67:0/3304087260 reap_dead start 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.572+0000 7f325d400640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 0x7f3240003e20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3248009ac0 tx=0x7f3240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e34e9554eb4a10a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.572+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248039070 con 0x7f3240003a00 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.572+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324802c6b0 con 0x7f3240003a00 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.572+0000 7f3257e00640 1 -- 172.21.15.67:0/3304087260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248009690 con 0x7f3240003a00 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 -- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 msgr2=0x7f3240003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 0x7f3240003e20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3248009ac0 tx=0x7f3240005830 comp rx=0 tx=0).stop 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 -- 172.21.15.67:0/3304087260 shutdown_connections 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 --2- 172.21.15.67:0/3304087260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3240003a00 0x7f3240003e20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 -- 172.21.15.67:0/3304087260 >> 172.21.15.67:0/3304087260 conn(0x7f32580d0220 msgr2=0x7f32580d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:11.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 -- 172.21.15.67:0/3304087260 shutdown_connections 2024-04-16T13:05:11.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.573+0000 7f325e800640 1 -- 172.21.15.67:0/3304087260 wait complete. 2024-04-16T13:05:11.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.575+0000 7f325e800640 1 Processor -- start 2024-04-16T13:05:11.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.575+0000 7f325e800640 1 -- start start 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240003a00 0x7f32581f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32580b4a30 0x7f32580b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f325806e110 con 0x7f325815afd0 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32580af410 con 0x7f32580b4a30 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f32581600f0 con 0x7f3240003a00 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54444/0 (socket says 172.21.15.67:54444) 2024-04-16T13:05:11.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325de00640 1 -- 172.21.15.67:0/2355255494 learned_addr learned my addr 172.21.15.67:0/2355255494 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325ca00640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32580b4a30 0x7f32580b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.576+0000 7f325d400640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240003a00 0x7f32581f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 -- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240003a00 msgr2=0x7f32581f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240003a00 0x7f32581f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 -- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32580b4a30 msgr2=0x7f32580b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32580b4a30 0x7f32580b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 -- 172.21.15.67:0/2355255494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580c9840 con 0x7f325815afd0 2024-04-16T13:05:11.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325de00640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3258071a30 tx=0x7f3250007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325000ea40 con 0x7f325815afd0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3250018070 con 0x7f325815afd0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325000ee40 con 0x7f325815afd0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580c9b20 con 0x7f325815afd0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.577+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32580ca0e0 con 0x7f325815afd0 2024-04-16T13:05:11.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.579+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3258075bd0 con 0x7f325815afd0 2024-04-16T13:05:11.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.579+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f325001d460 con 0x7f325815afd0 2024-04-16T13:05:11.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.580+0000 7f3255600640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 0x7f323c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:11.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.580+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f325008c0a0 con 0x7f325815afd0 2024-04-16T13:05:11.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.581+0000 7f325d400640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 0x7f323c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:11.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.582+0000 7f325d400640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 0x7f323c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3248036000 tx=0x7f3248030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:11.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.585+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f325005a190 con 0x7f325815afd0 2024-04-16T13:05:11.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.790+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f325806fce0 con 0x7f325815afd0 2024-04-16T13:05:11.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.794+0000 7f3255600640 1 -- 172.21.15.67:0/2355255494 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f3250059a90 con 0x7f325815afd0 2024-04-16T13:05:11.795 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:11.796 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 msgr2=0x7f323c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 0x7f323c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3248036000 tx=0x7f3248030000 comp rx=0 tx=0).stop 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 msgr2=0x7f325815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3258071a30 tx=0x7f3250007b00 comp rx=0 tx=0).stop 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 shutdown_connections 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f323c06c8f0 0x7f323c06edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f325815afd0 0x7f325815b450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32580b4a30 0x7f32580b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 --2- 172.21.15.67:0/2355255494 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3240003a00 0x7f32581f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:11.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 >> 172.21.15.67:0/2355255494 conn(0x7f32580d0220 msgr2=0x7f3258158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:11.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 shutdown_connections 2024-04-16T13:05:11.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:11.797+0000 7f325e800640 1 -- 172.21.15.67:0/2355255494 wait complete. 2024-04-16T13:05:11.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-16T13:05:11.819 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-16T13:05:11.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-16T13:05:11.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-16T13:05:11.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-16T13:05:11.821 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-16T13:05:11.821 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-16T13:05:11.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-16T13:05:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.131+0000 7f734cc00640 1 Processor -- start 2024-04-16T13:05:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.131+0000 7f734cc00640 1 -- start start 2024-04-16T13:05:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.132+0000 7fbfce400640 1 Processor -- start 2024-04-16T13:05:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.132+0000 7fbfce400640 1 -- start start 2024-04-16T13:05:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.134+0000 7fbfce400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfc80d4660 0x7fbfc80d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.134+0000 7fbfce400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 0x7fbfc80b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.133+0000 7f734cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734809b180 0x7f73480cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.133+0000 7f734cc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73480ce260 con 0x7f734815c7c0 2024-04-16T13:05:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.133+0000 7f734cc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73480c6210 con 0x7f73480cda30 2024-04-16T13:05:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.133+0000 7f734cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73480ce540 con 0x7f734809b180 2024-04-16T13:05:12.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.134+0000 7fbfce400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc80b4fa0 con 0x7fbfc815e890 2024-04-16T13:05:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.134+0000 7fbfce400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc80b4d60 con 0x7fbfc80d4660 2024-04-16T13:05:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.134+0000 7fbfce400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc80d1300 con 0x7fbfc80b4390 2024-04-16T13:05:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.135+0000 7f7345e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f734815c7c0 0x7f734809aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38016/0 (socket says 172.21.15.67:38016) 2024-04-16T13:05:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.135+0000 7f7345e00640 1 -- 172.21.15.67:0/4274908608 learned_addr learned my addr 172.21.15.67:0/4274908608 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.136+0000 7f7345400640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734809b180 0x7f73480cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.135+0000 7fbfcda00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 0x7fbfc80b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.136+0000 7fbfcd000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbfc815e890 0x7fbfc80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38028/0 (socket says 172.21.15.67:38028) 2024-04-16T13:05:12.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.136+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405083559 0 0) 0x7f73480c6210 con 0x7f73480cda30 2024-04-16T13:05:12.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.136+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f732c003520 con 0x7f73480cda30 2024-04-16T13:05:12.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.136+0000 7fbfcd000640 1 -- 172.21.15.67:0/845870 learned_addr learned my addr 172.21.15.67:0/845870 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528170841 0 0) 0x7f73480ce260 con 0x7f734815c7c0 2024-04-16T13:05:12.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73480c6210 con 0x7f734815c7c0 2024-04-16T13:05:12.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfc7400640 1 -- 172.21.15.67:0/845870 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252300344 0 0) 0x7fbfc80b4fa0 con 0x7fbfc815e890 2024-04-16T13:05:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfc7400640 1 -- 172.21.15.67:0/845870 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfac003520 con 0x7fbfc815e890 2024-04-16T13:05:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfcda00640 1 -- 172.21.15.67:0/845870 >> v2:172.21.15.82:3300/0 conn(0x7fbfc80d4660 msgr2=0x7fbfc80d4b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-16T13:05:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfcda00640 1 --2- 172.21.15.67:0/845870 >> v2:172.21.15.82:3300/0 conn(0x7fbfc80d4660 0x7fbfc80d4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfcda00640 1 -- 172.21.15.67:0/845870 >> v1:172.21.15.67:6789/0 conn(0x7fbfc815e890 legacy=0x7fbfc80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.137+0000 7fbfcda00640 1 -- 172.21.15.67:0/845870 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80b5280 con 0x7fbfc80b4390 2024-04-16T13:05:12.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.1 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 576511714 0 0) 0x7f732c003520 con 0x7f73480cda30 2024-04-16T13:05:12.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734809b180 msgr2=0x7f73480cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734809b180 0x7f73480cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 >> v1:172.21.15.67:6789/0 conn(0x7f734815c7c0 legacy=0x7f734809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734806eb50 con 0x7f73480cda30 2024-04-16T13:05:12.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.1 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f7338001670 con 0x7f73480cda30 2024-04-16T13:05:12.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 >> v1:172.21.15.82:6789/0 conn(0x7f73480cda30 legacy=0x7f73480c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.139+0000 7fbfcda00640 1 --2- 172.21.15.67:0/845870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 0x7fbfc80b4820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00097a0 tx=0x7fbfc002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca87aad277a47895 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f732c003b40 0x7f732c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c0101b0 0x7f732c0125a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732c012ae0 0x7f732c014ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73480ce540 con 0x7f732c012ae0 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f732c015790 con 0x7f732c0101b0 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.138+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f732c015990 con 0x7f732c003b40 2024-04-16T13:05:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.139+0000 7f7345400640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f734809b180 0x7f73480cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:12.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.140+0000 7f7345400640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c0101b0 0x7f732c0125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.140+0000 7fbfc7400640 1 -- 172.21.15.67:0/845870 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00315a0 con 0x7fbfc80b4390 2024-04-16T13:05:12.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.140+0000 7f7345e00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f732c003b40 0x7f732c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.140+0000 7f7346800640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732c012ae0 0x7f732c014ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7f7346800640 1 -- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f732c003b40 msgr2=0x7f732c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7f7346800640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f732c003b40 0x7f732c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7f7346800640 1 -- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c0101b0 msgr2=0x7f732c0125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7f7346800640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c0101b0 0x7f732c0125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7f7346800640 1 -- 172.21.15.67:0/4274908608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734806eb50 con 0x7f732c012ae0 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7fbfc7400640 1 -- 172.21.15.67:0/845870 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc0037070 con 0x7fbfc80b4390 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.141+0000 7fbfc7400640 1 -- 172.21.15.67:0/845870 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00315a0 con 0x7fbfc80b4390 2024-04-16T13:05:12.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7f3ab8400640 1 Processor -- start 2024-04-16T13:05:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 -- 172.21.15.67:0/845870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 msgr2=0x7fbfc80b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 --2- 172.21.15.67:0/845870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 0x7fbfc80b4820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00097a0 tx=0x7fbfc002b840 comp rx=0 tx=0).stop 2024-04-16T13:05:12.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 -- 172.21.15.67:0/845870 shutdown_connections 2024-04-16T13:05:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7f3ab8400640 1 -- start start 2024-04-16T13:05:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 --2- 172.21.15.67:0/845870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc80b4390 0x7fbfc80b4820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 --2- 172.21.15.67:0/845870 >> v2:172.21.15.82:3300/0 conn(0x7fbfc80d4660 0x7fbfc80d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7fbfce400640 1 -- 172.21.15.67:0/845870 >> 172.21.15.67:0/845870 conn(0x7fbfc809da80 msgr2=0x7fbfc808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.142+0000 7f7346800640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732c012ae0 0x7f732c014ed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f733800c210 tx=0x7f732c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63028a64ebbbbb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.143+0000 7fbfce400640 1 -- 172.21.15.67:0/845870 shutdown_connections 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.143+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338039070 con 0x7f732c012ae0 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.143+0000 7f7344a00640 1 -- 172.21.15.67:0/4274908608 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733802c9c0 con 0x7f732c012ae0 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f734cc00640 1 -- 172.21.15.67:0/4274908608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732c012ae0 msgr2=0x7f732c014ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f734cc00640 1 --2- 172.21.15.67:0/4274908608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732c012ae0 0x7f732c014ed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f733800c210 tx=0x7f732c005830 comp rx=0 tx=0).stop 2024-04-16T13:05:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f7346800640 1 -- 172.21.15.67:0/4274908608 reap_dead start 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f8e4d400640 1 Processor -- start 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f3ab8400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ab00cd600 0x7f3ab00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f3ab8400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ab00cf720 0x7f3ab01666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f3ab8400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab00b45a0 con 0x7f3ab0162be0 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f3ab8400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab0162fc0 con 0x7f3ab00cf720 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.144+0000 7f3ab8400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00b4350 con 0x7f3ab00cd600 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f3ab5a00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3ab0162be0 0x7f3ab00ccef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38552/0 (socket says 172.21.15.67:38552) 2024-04-16T13:05:12.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f3ab5a00640 1 -- 172.21.15.67:0/1442606088 learned_addr learned my addr 172.21.15.67:0/1442606088 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f8e4d400640 1 -- start start 2024-04-16T13:05:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f3ab5000640 1 --2- 172.21.15.67:0/1442606088 >> v2:172.21.15.82:3300/0 conn(0x7f3ab00cd600 0x7f3ab00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f734cc00640 1 -- 172.21.15.67:0/4274908608 shutdown_connections 2024-04-16T13:05:12.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.145+0000 7f734cc00640 1 -- 172.21.15.67:0/4274908608 >> 172.21.15.67:0/4274908608 conn(0x7f73480b4010 msgr2=0x7f73480b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.143+0000 7fbfce400640 1 -- 172.21.15.67:0/845870 wait complete. 2024-04-16T13:05:12.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7fbfce400640 1 Processor -- start 2024-04-16T13:05:12.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3ab6400640 1 --2- 172.21.15.67:0/1442606088 >> v2:172.21.15.67:3300/0 conn(0x7f3ab00cf720 0x7f3ab01666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3aafe00640 1 -- 172.21.15.67:0/1442606088 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010482748 0 0) 0x7f3ab00b45a0 con 0x7f3ab0162be0 2024-04-16T13:05:12.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3aafe00640 1 -- 172.21.15.67:0/1442606088 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a98003520 con 0x7f3ab0162be0 2024-04-16T13:05:12.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7fbfce400640 1 -- start start 2024-04-16T13:05:12.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f734cc00640 1 -- 172.21.15.67:0/4274908608 shutdown_connections 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7fbfce400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfc80b4390 0x7fbfc815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7fbfce400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80d4660 0x7fbfc80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e4d400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 0x7f8e480d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e4d400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 0x7f8e480b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e4d400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e480d34c0 con 0x7f8e4815ecc0 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e4d400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8e480d37a0 con 0x7f8e480d48e0 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e4d400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8e480d3a80 con 0x7f8e480b7a80 2024-04-16T13:05:12.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e46800640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8e4815ecc0 0x7f8e480d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38554/0 (socket says 172.21.15.67:38554) 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f8e46800640 1 -- 172.21.15.67:0/1157314426 learned_addr learned my addr 172.21.15.67:0/1157314426 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3ab5000640 1 -- 172.21.15.67:0/1442606088 >> v2:172.21.15.67:3300/0 conn(0x7f3ab00cf720 msgr2=0x7f3ab01666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3ab5000640 1 --2- 172.21.15.67:0/1442606088 >> v2:172.21.15.67:3300/0 conn(0x7f3ab00cf720 0x7f3ab01666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3ab5000640 1 -- 172.21.15.67:0/1442606088 >> v1:172.21.15.82:6789/0 conn(0x7f3ab0162be0 legacy=0x7f3ab00ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.146+0000 7f3ab5000640 1 -- 172.21.15.67:0/1442606088 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab00b4880 con 0x7f3ab00cd600 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f3ab5000640 1 --2- 172.21.15.67:0/1442606088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cd600 0x7f3ab00cf1e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00b3a00 tx=0x7f3aa402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef692338816ddf8b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f3aafe00640 1 -- 172.21.15.67:0/1442606088 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4039070 con 0x7f3ab00cd600 2024-04-16T13:05:12.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.148+0000 7f1cad000640 1 Processor -- start 2024-04-16T13:05:12.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f1cad000640 1 -- start start 2024-04-16T13:05:12.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7fbfce400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc815e890 0x7fbfc80cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f8e47200640 1 --2- 172.21.15.67:0/1157314426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 0x7f8e480b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f3aafe00640 1 -- 172.21.15.67:0/1442606088 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa402cc90 con 0x7f3ab00cd600 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f3aafe00640 1 -- 172.21.15.67:0/1442606088 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4039070 con 0x7f3ab00cd600 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.147+0000 7f734cc00640 1 -- 172.21.15.67:0/4274908608 wait complete. 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfcda00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc815e890 0x7fbfc80cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfcda00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc815e890 0x7fbfc80cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51464/0 (socket says 172.21.15.67:51464) 2024-04-16T13:05:12.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfcda00640 1 -- 172.21.15.67:0/1926584344 learned_addr learned my addr 172.21.15.67:0/1926584344 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e45e00640 1 --2- 172.21.15.67:0/1157314426 >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 0x7f8e480d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc815ec70 con 0x7fbfc80b4390 2024-04-16T13:05:12.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfc7e00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80d4660 0x7fbfc80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e47200640 1 -- 172.21.15.67:0/1157314426 >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 msgr2=0x7f8e480d4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e45400640 1 -- 172.21.15.67:0/1157314426 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628486103 0 0) 0x7f8e480d34c0 con 0x7f8e4815ecc0 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e47200640 1 --2- 172.21.15.67:0/1157314426 >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 0x7f8e480d4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e47200640 1 -- 172.21.15.67:0/1157314426 >> v1:172.21.15.82:6789/0 conn(0x7f8e4815ecc0 legacy=0x7f8e480d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e47200640 1 -- 172.21.15.67:0/1157314426 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e480d3d60 con 0x7f8e480b7a80 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7f8e45e00640 1 --2- 172.21.15.67:0/1157314426 >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 0x7f8e480d4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc80d24f0 con 0x7fbfc80d4660 2024-04-16T13:05:12.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.150+0000 7fbfcd000640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfc80b4390 0x7fbfc815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.149+0000 7f734cc00640 1 Processor -- start 2024-04-16T13:05:12.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc80d2a10 con 0x7fbfc815e890 2024-04-16T13:05:12.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 -- 172.21.15.67:0/1442606088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cd600 msgr2=0x7f3ab00cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 --2- 172.21.15.67:0/1442606088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cd600 0x7f3ab00cf1e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00b3a00 tx=0x7f3aa402bee0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f734cc00640 1 -- start start 2024-04-16T13:05:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 -- 172.21.15.67:0/1442606088 shutdown_connections 2024-04-16T13:05:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 --2- 172.21.15.67:0/1442606088 >> v2:172.21.15.67:3300/0 conn(0x7f3ab00cf720 0x7f3ab01666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 --2- 172.21.15.67:0/1442606088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cd600 0x7f3ab00cf1e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f3ab8400640 1 -- 172.21.15.67:0/1442606088 >> 172.21.15.67:0/1442606088 conn(0x7f3ab00d0410 msgr2=0x7f3ab00d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f1cad000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 0x7f1ca80cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f1cad000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca80cf930 con 0x7f1ca80d0450 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f1cad000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca80cfc10 con 0x7f1ca80b42c0 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.151+0000 7f1cad000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca81643b0 con 0x7f1ca8162d10 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7fbfcd000640 1 -- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc815e890 msgr2=0x7fbfc80cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7fbfcd000640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbfc815e890 0x7fbfc80cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7fbfcd000640 1 -- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80d4660 msgr2=0x7fbfc80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7fbfcd000640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc80d4660 0x7fbfc80ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7fbfcd000640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80cc430 con 0x7fbfc80b4390 2024-04-16T13:05:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f3fc2400640 1 Processor -- start 2024-04-16T13:05:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f1ca7e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1ca80d0450 0x7f1ca80ad1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38032/0 (socket says 172.21.15.67:38032) 2024-04-16T13:05:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f1ca7e00640 1 -- 172.21.15.67:0/4251610625 learned_addr learned my addr 172.21.15.67:0/4251610625 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f1ca7400640 1 --2- 172.21.15.67:0/4251610625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 0x7f1ca80cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f3fc2400640 1 -- start start 2024-04-16T13:05:12.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfcd000640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfc80b4390 0x7fbfc815caa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c410 tx=0x7fbfb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.152+0000 7f8e47200640 1 --2- 172.21.15.67:0/1157314426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 0x7f8e480b7e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157e6fd669c76f34 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f1ca6000640 1 -- 172.21.15.67:0/4251610625 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298742954 0 0) 0x7f1ca80cfc10 con 0x7f1ca80b42c0 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f1ca7400640 1 -- 172.21.15.67:0/4251610625 >> v1:172.21.15.82:6789/0 conn(0x7f1ca80b42c0 legacy=0x7f1ca8163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f1ca7400640 1 -- 172.21.15.67:0/4251610625 >> v1:172.21.15.67:6789/0 conn(0x7f1ca80d0450 legacy=0x7f1ca80ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f1ca7400640 1 -- 172.21.15.67:0/4251610625 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca81634a0 con 0x7f1ca8162d10 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f734cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c012ae0 0x7f734815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f734cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7348201910 0x7f734815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00074e0 con 0x7fbfc80b4390 2024-04-16T13:05:12.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb00047e0 con 0x7fbfc80b4390 2024-04-16T13:05:12.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0004bd0 con 0x7fbfc80b4390 2024-04-16T13:05:12.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80cc710 con 0x7fbfc80b4390 2024-04-16T13:05:12.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7f734cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 0x7f73480c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.153+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc815f0d0 con 0x7fbfc80b4390 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f8e45400640 1 -- 172.21.15.67:0/1157314426 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40039070 con 0x7f8e480b7a80 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f8e45400640 1 -- 172.21.15.67:0/1157314426 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4002cc60 con 0x7f8e480b7a80 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f8e45400640 1 -- 172.21.15.67:0/1157314426 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40034660 con 0x7f8e480b7a80 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fbc0b2220 0x7f3fbc0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fbc0ce460 0x7f3fbc1669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fbc0b2680 con 0x7f3fbc0b2220 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3fbc1494f0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3fc2400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc0cebe0 con 0x7f3fbc149110 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 -- 172.21.15.67:0/1157314426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 msgr2=0x7f8e480b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 --2- 172.21.15.67:0/1157314426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 0x7f8e480b7e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009d90 tx=0x7f8e4002beb0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 -- 172.21.15.67:0/1157314426 shutdown_connections 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3ab8400640 1 -- 172.21.15.67:0/1442606088 shutdown_connections 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f3ab8400640 1 -- 172.21.15.67:0/1442606088 wait complete. 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f3fbbe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3fbc0ce460 0x7f3fbc1669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f3fbb400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f3fbb400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51494/0 (socket says 172.21.15.67:51494) 2024-04-16T13:05:12.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f3fbb400640 1 -- 172.21.15.67:0/386807893 learned_addr learned my addr 172.21.15.67:0/386807893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f3fbaa00640 1 --2- 172.21.15.67:0/386807893 >> v2:172.21.15.67:3300/0 conn(0x7f3fbc0b2220 0x7f3fbc0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 --2- 172.21.15.67:0/1157314426 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480b7a80 0x7f8e480b7e80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 --2- 172.21.15.67:0/1157314426 >> v2:172.21.15.82:3300/0 conn(0x7f8e480d48e0 0x7f8e480d4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f8e4d400640 1 -- 172.21.15.67:0/1157314426 >> 172.21.15.67:0/1157314426 conn(0x7f8e48067b80 msgr2=0x7f8e48067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f1ca7400640 1 --2- 172.21.15.67:0/4251610625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 0x7f1ca80cf000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097d0 tx=0x7f1c9802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caffb2bb8662fd6a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f1ca6000640 1 -- 172.21.15.67:0/4251610625 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98037070 con 0x7f1ca8162d10 2024-04-16T13:05:12.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f8e4d400640 1 -- 172.21.15.67:0/1157314426 shutdown_connections 2024-04-16T13:05:12.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f8e4d400640 1 -- 172.21.15.67:0/1157314426 wait complete. 2024-04-16T13:05:12.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f3fbb400640 1 -- 172.21.15.67:0/386807893 >> v2:172.21.15.82:3300/0 conn(0x7f3fbc0ce460 msgr2=0x7f3fbc1669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f3fbb400640 1 --2- 172.21.15.67:0/386807893 >> v2:172.21.15.82:3300/0 conn(0x7f3fbc0ce460 0x7f3fbc1669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f3fbb400640 1 -- 172.21.15.67:0/386807893 >> v2:172.21.15.67:3300/0 conn(0x7f3fbc0b2220 msgr2=0x7f3fbc0cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f3fbb400640 1 --2- 172.21.15.67:0/386807893 >> v2:172.21.15.67:3300/0 conn(0x7f3fbc0b2220 0x7f3fbc0cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f3fbb400640 1 -- 172.21.15.67:0/386807893 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc164730 con 0x7f3fbc149110 2024-04-16T13:05:12.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f1ca6000640 1 -- 172.21.15.67:0/4251610625 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c98030710 con 0x7f1ca8162d10 2024-04-16T13:05:12.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f1ca6000640 1 -- 172.21.15.67:0/4251610625 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98037070 con 0x7f1ca8162d10 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f734cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f73480cdea0 con 0x7f734815e860 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f734cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73480c6860 con 0x7f732c012ae0 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f734cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f73480ce020 con 0x7f7348201910 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f7346800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 0x7f73480c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f7346800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 0x7f73480c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52222/0 (socket says 172.21.15.67:52222) 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.154+0000 7f7346800640 1 -- 172.21.15.67:0/2222424673 learned_addr learned my addr 172.21.15.67:0/2222424673 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.155+0000 7f7345e00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c012ae0 0x7f734815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f7345e00640 1 -- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7348201910 msgr2=0x7f734815e320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f7345e00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7348201910 0x7f734815e320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.156+0000 7f7345e00640 1 -- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 msgr2=0x7f73480c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7f7345e00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 0x7f73480c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7f7345e00640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734815edc0 con 0x7f732c012ae0 2024-04-16T13:05:12.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7f7346800640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f734815e860 0x7f73480c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:12.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7f3ab8400640 1 Processor -- start 2024-04-16T13:05:12.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7f3ab8400640 1 -- start start 2024-04-16T13:05:12.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f7345e00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c012ae0 0x7f734815d960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7340007830 tx=0x7f734000e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.157+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfa0001030 con 0x7fbfc80b4390 2024-04-16T13:05:12.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 -- 172.21.15.67:0/4251610625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 msgr2=0x7f1ca80cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 --2- 172.21.15.67:0/4251610625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 0x7f1ca80cf000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097d0 tx=0x7f1c9802b770 comp rx=0 tx=0).stop 2024-04-16T13:05:12.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 -- 172.21.15.67:0/4251610625 shutdown_connections 2024-04-16T13:05:12.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 --2- 172.21.15.67:0/4251610625 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca8162d10 0x7f1ca80cf000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 -- 172.21.15.67:0/4251610625 >> 172.21.15.67:0/4251610625 conn(0x7f1ca806bc00 msgr2=0x7f1ca806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfb0011070 con 0x7fbfc80b4390 2024-04-16T13:05:12.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734000ebe0 con 0x7f732c012ae0 2024-04-16T13:05:12.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f3fbb400640 1 --2- 172.21.15.67:0/386807893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b2dc0 tx=0x7f3fb402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b2e0cd96bed1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.158+0000 7f1cad000640 1 -- 172.21.15.67:0/4251610625 shutdown_connections 2024-04-16T13:05:12.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7340018070 con 0x7f732c012ae0 2024-04-16T13:05:12.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340013420 con 0x7f732c012ae0 2024-04-16T13:05:12.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734815ce80 con 0x7f732c012ae0 2024-04-16T13:05:12.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7348201d90 con 0x7f732c012ae0 2024-04-16T13:05:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f8e4d400640 1 Processor -- start 2024-04-16T13:05:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f1cad000640 1 -- 172.21.15.67:0/4251610625 wait complete. 2024-04-16T13:05:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7fbfc4c00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbfa406c9c0 0x7fbfa406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7f3ab8400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 0x7f3ab0205380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f8e4d400640 1 -- start start 2024-04-16T13:05:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.159+0000 7f3fba000640 1 -- 172.21.15.67:0/386807893 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb402e070 con 0x7f3fbc149110 2024-04-16T13:05:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7f3fba000640 1 -- 172.21.15.67:0/386807893 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4037070 con 0x7f3fbc149110 2024-04-16T13:05:12.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7f3fba000640 1 -- 172.21.15.67:0/386807893 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4031a00 con 0x7f3fbc149110 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab8400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cf720 0x7f3ab0200c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab5a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 0x7f3ab0205380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbfb008ba50 con 0x7fbfc80b4390 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7fbfc4c00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7fbfa4076140 0x7fbfa4078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfb000ee50 con 0x7fbfa4076140 2024-04-16T13:05:12.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.160+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbfb0090260 con 0x7fbfc80b4390 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7348075bd0 con 0x7f732c012ae0 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f8e4d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 0x7f8e481f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab8400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ab0162be0 0x7f3ab0072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab5a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 0x7f3ab0205380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52238/0 (socket says 172.21.15.67:52238) 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab5a00640 1 -- 172.21.15.67:0/789636699 learned_addr learned my addr 172.21.15.67:0/789636699 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00cfb30 con 0x7f3ab00cd600 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00b4e40 con 0x7f3ab00cf720 2024-04-16T13:05:12.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab00cfcb0 con 0x7f3ab0162be0 2024-04-16T13:05:12.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7fbfc7e00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbfa406c9c0 0x7fbfa406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7fbfcda00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7fbfa4076140 0x7fbfa4078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 -- 172.21.15.67:0/386807893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 msgr2=0x7f3fbc0b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 --2- 172.21.15.67:0/386807893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b2dc0 tx=0x7f3fb402b880 comp rx=0 tx=0).stop 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 -- 172.21.15.67:0/386807893 shutdown_connections 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 --2- 172.21.15.67:0/386807893 >> v2:172.21.15.82:3300/0 conn(0x7f3fbc0ce460 0x7f3fbc1669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 --2- 172.21.15.67:0/386807893 >> v2:172.21.15.67:3300/0 conn(0x7f3fbc0b2220 0x7f3fbc0cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 --2- 172.21.15.67:0/386807893 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc149110 0x7f3fbc0b1ce0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b2dc0 tx=0x7f3fb402b880 comp rx=0 tx=0).stop 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 -- 172.21.15.67:0/386807893 >> 172.21.15.67:0/386807893 conn(0x7f3fbc067d90 msgr2=0x7f3fbc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.161+0000 7f8e4d400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480d48e0 0x7f8e48146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e4d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e4815ecc0 0x7f8e48161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e4d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4815f0a0 con 0x7f8e480b7a80 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e4d400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e480d4560 con 0x7f8e4815ecc0 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e4d400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8e480d3150 con 0x7f8e480d48e0 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e46800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 0x7f8e481f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e46800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 0x7f8e481f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52248/0 (socket says 172.21.15.67:52248) 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f8e46800640 1 -- 172.21.15.67:0/344060019 learned_addr learned my addr 172.21.15.67:0/344060019 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f1cad000640 1 Processor -- start 2024-04-16T13:05:12.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f4095600640 1 Processor -- start 2024-04-16T13:05:12.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f4095600640 1 -- start start 2024-04-16T13:05:12.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e47200640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e4815ecc0 0x7f8e48161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 -- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480d48e0 msgr2=0x7f8e48146540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T13:05:12.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8e480d48e0 0x7f8e48146540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f1cad000640 1 -- start start 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3fc2400640 1 -- 172.21.15.67:0/386807893 shutdown_connections 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 -- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e4815ecc0 msgr2=0x7f8e48161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e4815ecc0 0x7f8e48161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e480cae30 con 0x7f8e480b7a80 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.162+0000 7f3ab5000640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cf720 0x7f3ab0200c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab6400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ab0162be0 0x7f3ab0072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f8e46800640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 0x7f8e481f8480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e38001ae0 tx=0x7f8e38014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab5a00640 1 -- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ab0162be0 msgr2=0x7f3ab0072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab5a00640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ab0162be0 0x7f3ab0072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab5a00640 1 -- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cf720 msgr2=0x7f3ab0200c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab5a00640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab00cf720 0x7f3ab0200c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3ab5a00640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab02058c0 con 0x7f3ab00cd600 2024-04-16T13:05:12.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1d85c00640 1 Processor -- start 2024-04-16T13:05:12.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.163+0000 7f3fc2400640 1 -- 172.21.15.67:0/386807893 wait complete. 2024-04-16T13:05:12.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1d85c00640 1 -- start start 2024-04-16T13:05:12.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f734003a690 con 0x7f732c012ae0 2024-04-16T13:05:12.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38001cf0 con 0x7f8e480b7a80 2024-04-16T13:05:12.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e38014d40 con 0x7f8e480b7a80 2024-04-16T13:05:12.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38007310 con 0x7f8e480b7a80 2024-04-16T13:05:12.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f3fc2400640 1 Processor -- start 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca80b42c0 0x7f1ca809a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ca80d0450 0x7f1ca809af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ca8162d10 0x7f1ca815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca81630f0 con 0x7f1ca80d0450 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80cf540 con 0x7f1ca8162d10 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f1cad000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca806de40 con 0x7f1ca80b42c0 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ca8162d10 0x7f1ca815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ca8162d10 0x7f1ca815d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43708/0 (socket says 172.21.15.67:43708) 2024-04-16T13:05:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f1ca7e00640 1 -- 172.21.15.67:0/3949851748 learned_addr learned my addr 172.21.15.67:0/3949851748 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f1ca6a00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ca80d0450 0x7f1ca809af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f1ca7400640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca80b42c0 0x7f1ca809a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e480cb110 con 0x7f8e480b7a80 2024-04-16T13:05:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f3ab5a00640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 0x7f3ab0205380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c710 tx=0x7f3aa800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f3fc2400640 1 -- start start 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.164+0000 7f4095600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f40900cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f4095600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40900cb610 con 0x7f40900cc9e0 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f4095600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40900cb8f0 con 0x7f409015e910 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f4095600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40900cb3d0 con 0x7f40900cf1c0 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.165+0000 7f408ea00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f409015e910 0x7f40900cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38572/0 (socket says 172.21.15.67:38572) 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f408ea00640 1 -- 172.21.15.67:0/2418601679 learned_addr learned my addr 172.21.15.67:0/2418601679 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f4087e00640 1 --2- 172.21.15.67:0/2418601679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f40900cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1d85c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 0x7f1d800d4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1d85c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d800b4fa0 con 0x7f1d800b4390 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1d85c00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d800b5280 con 0x7f1d8015e890 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1d85c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1d800d1300 con 0x7f1d800d4660 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f733e000640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f732806c940 0x7f732806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7340057ee0 con 0x7f732c012ae0 2024-04-16T13:05:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1ca6a00640 1 -- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca80b42c0 msgr2=0x7f1ca809a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1ca6a00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1ca80b42c0 0x7f1ca809a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1ca6a00640 1 -- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ca8162d10 msgr2=0x7f1ca815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1ca6a00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ca8162d10 0x7f1ca815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f733e000640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7f7328076de0 0x7f7328079280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7328079950 con 0x7f7328076de0 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7340056870 con 0x7f732c012ae0 2024-04-16T13:05:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f1ca6a00640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca809da10 con 0x7f1ca80d0450 2024-04-16T13:05:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.166+0000 7f7345400640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f732806c940 0x7f732806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f7346800640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7f7328076de0 0x7f7328079280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc0b2220 0x7f3fbc138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 0x7f3fbc139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc13a530 0x7f3fbc073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc0ce8f0 con 0x7f3fbc13a530 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc164cf0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f3fc2400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3fbc166f00 con 0x7f3fbc0b2220 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e481f7f60 con 0x7f8e480b7a80 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f1ca6a00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ca80d0450 0x7f1ca809af40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c430 tx=0x7f1c9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f4087e00640 1 -- 172.21.15.67:0/2418601679 >> v1:172.21.15.82:6789/0 conn(0x7f409015e910 legacy=0x7f40900cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f4087e00640 1 -- 172.21.15.67:0/2418601679 >> v1:172.21.15.67:6789/0 conn(0x7f40900cc9e0 legacy=0x7f40900cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f4087e00640 1 -- 172.21.15.67:0/2418601679 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40900cbbd0 con 0x7f40900cf1c0 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f1d85200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1d800b4390 0x7f1d800d2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38060/0 (socket says 172.21.15.67:38060) 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f1d85200640 1 -- 172.21.15.67:0/1688055354 learned_addr learned my addr 172.21.15.67:0/1688055354 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.167+0000 7f1d7f400640 1 --2- 172.21.15.67:0/1688055354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 0x7f1d800d4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7fbfcda00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7fbfa4076140 0x7fbfa4078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f3fbaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 0x7f3fbc139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f3fbaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 0x7f3fbc139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43722/0 (socket says 172.21.15.67:43722) 2024-04-16T13:05:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f3fbaa00640 1 -- 172.21.15.67:0/2652484999 learned_addr learned my addr 172.21.15.67:0/2652484999 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f3fbb400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc0b2220 0x7f3fbc138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7fbfc7e00640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbfa406c9c0 0x7fbfa406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfc81f4b80 tx=0x7fbfb80094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94017070 con 0x7f1ca80d0450 2024-04-16T13:05:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c940035f0 con 0x7f1ca80d0450 2024-04-16T13:05:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c940039e0 con 0x7f1ca80d0450 2024-04-16T13:05:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e48068a70 con 0x7f8e480b7a80 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca809dcf0 con 0x7f1ca80d0450 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca815fbd0 con 0x7f1ca80d0450 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3fbaa00640 1 -- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc0b2220 msgr2=0x7f3fbc138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3fbaa00640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fbc0b2220 0x7f3fbc138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3fbaa00640 1 -- 172.21.15.67:0/2652484999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc13a530 msgr2=0x7f3fbc073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3fbaa00640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fbc13a530 0x7f3fbc073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3fbaa00640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc13bec0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1d7f400640 1 -- 172.21.15.67:0/1688055354 >> v1:172.21.15.82:6789/0 conn(0x7f1d8015e890 legacy=0x7f1d800cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1d7f400640 1 -- 172.21.15.67:0/1688055354 >> v1:172.21.15.67:6789/0 conn(0x7f1d800b4390 legacy=0x7f1d800d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.168+0000 7f1d7f400640 1 -- 172.21.15.67:0/1688055354 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d800b5560 con 0x7f1d800d4660 2024-04-16T13:05:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f4087e00640 1 --2- 172.21.15.67:0/2418601679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f40900cc4a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f40780097d0 tx=0x7f407802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1723b66776aa09ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8017070 con 0x7f3ab00cd600 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f408e000640 1 -- 172.21.15.67:0/2418601679 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078039070 con 0x7f40900cf1c0 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f408e000640 1 -- 172.21.15.67:0/2418601679 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40780316f0 con 0x7f40900cf1c0 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f408e000640 1 -- 172.21.15.67:0/2418601679 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078031ac0 con 0x7f40900cf1c0 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa8005ab0 con 0x7f3ab00cd600 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800ce20 con 0x7f3ab00cd600 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab0163ee0 con 0x7f3ab00cd600 2024-04-16T13:05:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab01644a0 con 0x7f3ab00cd600 2024-04-16T13:05:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c80001030 con 0x7f1ca80d0450 2024-04-16T13:05:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== osd.1 v2:172.21.15.67:6800/1865615230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfb000ee50 con 0x7fbfa4076140 2024-04-16T13:05:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.169+0000 7f7346800640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7f7328076de0 0x7f7328079280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f7345400640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f732806c940 0x7f732806ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73481f80a0 tx=0x7f7334008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.170+0000 7f1d7f400640 1 --2- 172.21.15.67:0/1688055354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 0x7f1d800d4ae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d700097d0 tx=0x7f1d7002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4593629c0811a30f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== osd.0 v2:172.21.15.67:6809/943685359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7328079950 con 0x7f7328076de0 2024-04-16T13:05:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f1d7ea00640 1 -- 172.21.15.67:0/1688055354 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70035020 con 0x7f1d800d4660 2024-04-16T13:05:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f1d7ea00640 1 -- 172.21.15.67:0/1688055354 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d70031800 con 0x7f1d800d4660 2024-04-16T13:05:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f1d7ea00640 1 -- 172.21.15.67:0/1688055354 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031bd0 con 0x7f1d800d4660 2024-04-16T13:05:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f3fbaa00640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 0x7f3fbc139ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e8f0 tx=0x7f3fac00edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e380074b0 con 0x7f8e480b7a80 2024-04-16T13:05:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ab00aeab0 con 0x7f3ab00cd600 2024-04-16T13:05:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.171+0000 7f4095600640 1 -- 172.21.15.67:0/2418601679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 msgr2=0x7f40900cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f4095600640 1 --2- 172.21.15.67:0/2418601679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f40900cc4a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f40780097d0 tx=0x7f407802b790 comp rx=0 tx=0).stop 2024-04-16T13:05:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 -- 172.21.15.67:0/1688055354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 msgr2=0x7f1d800d4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 --2- 172.21.15.67:0/1688055354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 0x7f1d800d4ae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d700097d0 tx=0x7f1d7002b8a0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac017070 con 0x7f3fbc0ce460 2024-04-16T13:05:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fac00c940 con 0x7f3fbc0ce460 2024-04-16T13:05:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00cd10 con 0x7f3fbc0ce460 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 -- 172.21.15.67:0/1688055354 shutdown_connections 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 --2- 172.21.15.67:0/1688055354 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d800d4660 0x7f1d800d4ae0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 -- 172.21.15.67:0/1688055354 >> 172.21.15.67:0/1688055354 conn(0x7f1d8009da80 msgr2=0x7f1d8008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f4095600640 1 -- 172.21.15.67:0/2418601679 shutdown_connections 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f4095600640 1 --2- 172.21.15.67:0/2418601679 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f40900cc4a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f4095600640 1 -- 172.21.15.67:0/2418601679 >> 172.21.15.67:0/2418601679 conn(0x7f4090067d90 msgr2=0x7f409006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f1d85c00640 1 -- 172.21.15.67:0/1688055354 shutdown_connections 2024-04-16T13:05:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e3ea00640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e2806c9c0 0x7f8e2806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e38093f40 con 0x7f8e480b7a80 2024-04-16T13:05:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc13c1a0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.172+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc13c760 con 0x7f3fbc0ce460 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e3ea00640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f8e280760c0 0x7f8e28078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e38019e70 con 0x7f8e280760c0 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e3805dbb0 con 0x7f8e480b7a80 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f8e45e00640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e2806c9c0 0x7f8e2806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.173+0000 7f1d85c00640 1 -- 172.21.15.67:0/1688055354 wait complete. 2024-04-16T13:05:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.174+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fbc068a70 con 0x7f3fbc0ce460 2024-04-16T13:05:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.174+0000 7f8e47200640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f8e280760c0 0x7f8e28078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.174+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c9401a070 con 0x7f1ca80d0450 2024-04-16T13:05:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.175+0000 7f8e45e00640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e2806c9c0 0x7f8e2806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400a8b0 tx=0x7f8e34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.175+0000 7f8e47200640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f8e280760c0 0x7f8e28078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.175+0000 7f1d85c00640 1 Processor -- start 2024-04-16T13:05:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f4095600640 1 -- 172.21.15.67:0/2418601679 shutdown_connections 2024-04-16T13:05:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1d85c00640 1 -- start start 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f4095600640 1 -- 172.21.15.67:0/2418601679 wait complete. 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1c9f400640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1c8806c9c0 0x7f1c8806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c9408b8c0 con 0x7f1ca80d0450 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1c9f400640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f1c88076140 0x7f1c88078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c88078c50 con 0x7f1c88076140 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.176+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c9408bcb0 con 0x7f1ca80d0450 2024-04-16T13:05:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.177+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3fac01a070 con 0x7f3fbc0ce460 2024-04-16T13:05:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.177+0000 7f1ca7400640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1c8806c9c0 0x7f1c8806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.177+0000 7f1ca7e00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f1c88076140 0x7f1c88078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== osd.2 v2:172.21.15.67:6808/2646355718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e38019e70 con 0x7f8e280760c0 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.177+0000 7f1d85c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 0x7f1d80159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d85c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800d4660 0x7f1d8015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d85c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d8015e890 0x7f1d8015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d85c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1d800b4820 con 0x7f1d800b4390 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d85c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8015ec70 con 0x7f1d800d4660 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d85c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1d800b49a0 con 0x7f1d8015e890 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 0x7f1d80159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 0x7f1d80159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52280/0 (socket says 172.21.15.67:52280) 2024-04-16T13:05:12.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d7fe00640 1 -- 172.21.15.67:0/806175903 learned_addr learned my addr 172.21.15.67:0/806175903 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f4095600640 1 Processor -- start 2024-04-16T13:05:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.178+0000 7f1d7f400640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800d4660 0x7f1d8015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d85200640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d8015e890 0x7f1d8015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 -- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d8015e890 msgr2=0x7f1d8015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1d8015e890 0x7f1d8015f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 -- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800d4660 msgr2=0x7f1d8015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f4095600640 1 -- start start 2024-04-16T13:05:12.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d800d4660 0x7f1d8015edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d800b9520 con 0x7f1d800b4390 2024-04-16T13:05:12.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1ca7400640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1c8806c9c0 0x7f1c8806ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c98034000 tx=0x7f1c98008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3aa801a070 con 0x7f3ab00cd600 2024-04-16T13:05:12.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1ca7e00640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f1c88076140 0x7f1c88078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f1d7fe00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 0x7f1d80159040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b410 tx=0x7f1d7800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f3fb3400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f9806c970 0x7f3f9806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.179+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3fac08c4c0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f3fb3400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f3f980760f0 0x7f3f98078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f98078c00 con 0x7f3f980760f0 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3fac08c9a0 con 0x7f3fbc0ce460 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78015020 con 0x7f1d800b4390 2024-04-16T13:05:12.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d78011830 con 0x7f1d800b4390 2024-04-16T13:05:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d78011c20 con 0x7f1d800b4390 2024-04-16T13:05:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f4095600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40900cc9e0 0x7f4090153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f4095600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f4090150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f4095600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f409015e910 0x7f409013fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8015f940 con 0x7f1d800b4390 2024-04-16T13:05:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f3fbb400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f9806c970 0x7f3f9806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.180+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8015ff00 con 0x7f1d800b4390 2024-04-16T13:05:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f3aad600640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3a9006c9c0 0x7f3a9006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f408ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40900cc9e0 0x7f4090153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4095600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f409015ee70 con 0x7f40900cc9e0 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4095600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f409015ecf0 con 0x7f409015e910 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4095600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f40900b3700 con 0x7f40900cf1c0 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4087e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f4090150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4087e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f4090150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51572/0 (socket says 172.21.15.67:51572) 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f4087e00640 1 -- 172.21.15.67:0/882685970 learned_addr learned my addr 172.21.15.67:0/882685970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.181+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3aa808b930 con 0x7f3ab00cd600 2024-04-16T13:05:12.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d800cbc10 con 0x7f1d800b4390 2024-04-16T13:05:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f3ab5000640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3a9006c9c0 0x7f3a9006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f4087e00640 1 -- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f409015e910 msgr2=0x7f409013fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f4087e00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f409015e910 0x7f409013fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f4087e00640 1 -- 172.21.15.67:0/882685970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40900cc9e0 msgr2=0x7f4090153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f3aad600640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f3a90076140 0x7f3a90078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3aa801ae70 con 0x7f3a90076140 2024-04-16T13:05:12.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3aa808bd20 con 0x7f3ab00cd600 2024-04-16T13:05:12.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== osd.4 v2:172.21.15.82:6816/3746718267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c88078c50 con 0x7f1c88076140 2024-04-16T13:05:12.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f3fbb400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f9806c970 0x7f3f9806ee30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4036000 tx=0x7f3fb403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.182+0000 7f4087e00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40900cc9e0 0x7f4090153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.183+0000 7f4087e00640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40901544c0 con 0x7f40900cf1c0 2024-04-16T13:05:12.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.183+0000 7f3ab6400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f3a90076140 0x7f3a90078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.183+0000 7f408ea00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40900cc9e0 0x7f4090153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.183+0000 7f4087e00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f4090150c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40780097d0 tx=0x7f40780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.183+0000 7f3fbbe00640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f3f980760f0 0x7f3f98078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d78018020 con 0x7f1d800b4390 2024-04-16T13:05:12.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f3ab6400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f3a90076140 0x7f3a90078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f3ab5000640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3a9006c9c0 0x7f3a9006ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4036000 tx=0x7f3aa4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078043070 con 0x7f40900cf1c0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4090154760 con 0x7f40900cf1c0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4090154d20 con 0x7f40900cf1c0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40780346a0 con 0x7f40900cf1c0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.184+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078039040 con 0x7f40900cf1c0 2024-04-16T13:05:12.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.185+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4068001030 con 0x7f40900cf1c0 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.186+0000 7f3fbbe00640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f3f980760f0 0x7f3f98078530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.186+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== osd.3 v2:172.21.15.67:6823/2159316217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3aa801ae70 con 0x7f3a90076140 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.186+0000 7f1d77e00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1d6006c940 0x7f1d6006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.187+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d7808bc60 con 0x7f1d800b4390 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.187+0000 7f1d77e00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f1d600760c0 0x7f1d60078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.187+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d78007e50 con 0x7f1d600760c0 2024-04-16T13:05:12.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.187+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d7808e3b0 con 0x7f1d800b4390 2024-04-16T13:05:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.187+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4078046070 con 0x7f40900cf1c0 2024-04-16T13:05:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.188+0000 7f1d85200640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f1d600760c0 0x7f1d60078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.188+0000 7f1d7f400640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1d6006c940 0x7f1d6006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.188+0000 7f4086a00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f406c075100 0x7f406c0775c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.188+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f40780ae050 con 0x7f40900cf1c0 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f4086a00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f406c07e880 0x7f406c080cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f406c081390 con 0x7f406c07e880 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40780ae440 con 0x7f40900cf1c0 2024-04-16T13:05:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f408ea00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f406c075100 0x7f406c0775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== osd.5 v2:172.21.15.82:6800/2359128195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f98078c00 con 0x7f3f980760f0 2024-04-16T13:05:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.189+0000 7f408f400640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f406c07e880 0x7f406c080cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.190+0000 7f1d7f400640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1d6006c940 0x7f1d6006ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d70036000 tx=0x7f1d7003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.190+0000 7f408ea00640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f406c075100 0x7f406c0775c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4080006d50 tx=0x7f4080006ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.191+0000 7f1d85200640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f1d600760c0 0x7f1d60078500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.191+0000 7f408f400640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f406c07e880 0x7f406c080cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.193+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== osd.7 v2:172.21.15.82:6808/43297624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d78007e50 con 0x7f1d600760c0 2024-04-16T13:05:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.195+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== osd.6 v2:172.21.15.82:6819/87066875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f406c081390 con 0x7f406c07e880 2024-04-16T13:05:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.205+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 --> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbfa0002dd0 con 0x7fbfa4076140 2024-04-16T13:05:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.207+0000 7fbfc4c00640 1 -- 172.21.15.67:0/1926584344 <== osd.1 v2:172.21.15.67:6800/1865615230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbfa0002dd0 con 0x7fbfa4076140 2024-04-16T13:05:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.208+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7fbfa4076140 msgr2=0x7fbfa4078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.208+0000 7fbfce400640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7fbfa4076140 0x7fbfa4078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.208+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 --> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e4815a8f0 con 0x7f8e280760c0 2024-04-16T13:05:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 --> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7348071a20 con 0x7f7328076de0 2024-04-16T13:05:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbfa406c9c0 msgr2=0x7fbfa406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7f733e000640 1 -- 172.21.15.67:0/2222424673 <== osd.0 v2:172.21.15.67:6809/943685359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7348071a20 con 0x7f7328076de0 2024-04-16T13:05:12.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7f8e3ea00640 1 -- 172.21.15.67:0/344060019 <== osd.2 v2:172.21.15.67:6808/2646355718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8e4815a8f0 con 0x7f8e280760c0 2024-04-16T13:05:12.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7fbfce400640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbfa406c9c0 0x7fbfa406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbfc81f4b80 tx=0x7fbfb80094d0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfc80b4390 msgr2=0x7fbfc815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.209+0000 7fbfce400640 1 --2- 172.21.15.67:0/1926584344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfc80b4390 0x7fbfc815caa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c410 tx=0x7fbfb000c8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7fbfcda00640 1 -- 172.21.15.67:0/1926584344 reap_dead start 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 shutdown_connections 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 >> 172.21.15.67:0/1926584344 conn(0x7fbfc809da80 msgr2=0x7fbfc806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7f7328076de0 msgr2=0x7f7328079280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7f7328076de0 0x7f7328079280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f732806c940 msgr2=0x7f732806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f732806c940 0x7f732806ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73481f80a0 tx=0x7f7334008040 comp rx=0 tx=0).stop 2024-04-16T13:05:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c012ae0 msgr2=0x7f734815d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f734cc00640 1 --2- 172.21.15.67:0/2222424673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f732c012ae0 0x7f734815d960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7340007830 tx=0x7f734000e530 comp rx=0 tx=0).stop 2024-04-16T13:05:12.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7f7346800640 1 -- 172.21.15.67:0/2222424673 reap_dead start 2024-04-16T13:05:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 shutdown_connections 2024-04-16T13:05:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.210+0000 7fbfce400640 1 -- 172.21.15.67:0/1926584344 wait complete. 2024-04-16T13:05:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f8e280760c0 msgr2=0x7f8e28078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f8e280760c0 0x7f8e28078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 shutdown_connections 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 >> 172.21.15.67:0/2222424673 conn(0x7f73480b4010 msgr2=0x7f734806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e2806c9c0 msgr2=0x7f8e2806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e2806c9c0 0x7f8e2806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400a8b0 tx=0x7f8e34008040 comp rx=0 tx=0).stop 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 msgr2=0x7f8e481f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 --2- 172.21.15.67:0/344060019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e480b7a80 0x7f8e481f8480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e38001ae0 tx=0x7f8e38014420 comp rx=0 tx=0).stop 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e47200640 1 -- 172.21.15.67:0/344060019 reap_dead start 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 shutdown_connections 2024-04-16T13:05:12.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 >> 172.21.15.67:0/344060019 conn(0x7f8e48067b80 msgr2=0x7f8e48159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.211+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 shutdown_connections 2024-04-16T13:05:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.212+0000 7f734cc00640 1 -- 172.21.15.67:0/2222424673 wait complete. 2024-04-16T13:05:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.212+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 shutdown_connections 2024-04-16T13:05:12.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.212+0000 7f8e4d400640 1 -- 172.21.15.67:0/344060019 wait complete. 2024-04-16T13:05:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.213+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 --> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c80002dd0 con 0x7f1c88076140 2024-04-16T13:05:12.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.214+0000 7f1c9f400640 1 -- 172.21.15.67:0/3949851748 <== osd.4 v2:172.21.15.82:6816/3746718267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c80002dd0 con 0x7f1c88076140 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.216+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f1c88076140 msgr2=0x7f1c88078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.216+0000 7f1cad000640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f1c88076140 0x7f1c88078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.216+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1c8806c9c0 msgr2=0x7f1c8806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.216+0000 7f1cad000640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1c8806c9c0 0x7f1c8806ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c98034000 tx=0x7f1c98008030 comp rx=0 tx=0).stop 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.217+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ca80d0450 msgr2=0x7f1ca809af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.217+0000 7f1cad000640 1 --2- 172.21.15.67:0/3949851748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1ca80d0450 0x7f1ca809af40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c430 tx=0x7f1c9400c8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.217+0000 7f1ca7e00640 1 -- 172.21.15.67:0/3949851748 reap_dead start 2024-04-16T13:05:12.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.218+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 shutdown_connections 2024-04-16T13:05:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.218+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 >> 172.21.15.67:0/3949851748 conn(0x7f1ca806bc00 msgr2=0x7f1ca8161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.218+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 shutdown_connections 2024-04-16T13:05:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.219+0000 7f1cad000640 1 -- 172.21.15.67:0/3949851748 wait complete. 2024-04-16T13:05:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.221+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 --> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ab00caea0 con 0x7f3a90076140 2024-04-16T13:05:12.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.222+0000 7f3aad600640 1 -- 172.21.15.67:0/789636699 <== osd.3 v2:172.21.15.67:6823/2159316217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3ab00caea0 con 0x7f3a90076140 2024-04-16T13:05:12.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.223+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f3a90076140 msgr2=0x7f3a90078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.223+0000 7f3ab8400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f3a90076140 0x7f3a90078580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.223+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 --> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fbc166ce0 con 0x7f3f980760f0 2024-04-16T13:05:12.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3a9006c9c0 msgr2=0x7f3a9006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3a9006c9c0 0x7f3a9006ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4036000 tx=0x7f3aa4030000 comp rx=0 tx=0).stop 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 msgr2=0x7f3ab0205380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 --2- 172.21.15.67:0/789636699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ab00cd600 0x7f3ab0205380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c710 tx=0x7f3aa800cbd0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab6400640 1 -- 172.21.15.67:0/789636699 reap_dead start 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 shutdown_connections 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 >> 172.21.15.67:0/789636699 conn(0x7f3ab00d0410 msgr2=0x7f3ab00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.224+0000 7f3fb3400640 1 -- 172.21.15.67:0/2652484999 <== osd.5 v2:172.21.15.82:6800/2359128195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3fbc166ce0 con 0x7f3f980760f0 2024-04-16T13:05:12.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.225+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 shutdown_connections 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.225+0000 7f3ab8400640 1 -- 172.21.15.67:0/789636699 wait complete. 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.225+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f3f980760f0 msgr2=0x7f3f98078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.225+0000 7f3fc2400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f3f980760f0 0x7f3f98078530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f9806c970 msgr2=0x7f3f9806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f3fc2400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f9806c970 0x7f3f9806ee30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4036000 tx=0x7f3fb403d040 comp rx=0 tx=0).stop 2024-04-16T13:05:12.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 msgr2=0x7f3fbc139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 --> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4068002dd0 con 0x7f406c07e880 2024-04-16T13:05:12.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f3fc2400640 1 --2- 172.21.15.67:0/2652484999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fbc0ce460 0x7f3fbc139ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00e8f0 tx=0x7f3fac00edb0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.226+0000 7f3fbbe00640 1 -- 172.21.15.67:0/2652484999 reap_dead start 2024-04-16T13:05:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.227+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 shutdown_connections 2024-04-16T13:05:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.227+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 >> 172.21.15.67:0/2652484999 conn(0x7f3fbc067d90 msgr2=0x7f3fbc162960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.227+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 shutdown_connections 2024-04-16T13:05:12.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.227+0000 7f3fc2400640 1 -- 172.21.15.67:0/2652484999 wait complete. 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.227+0000 7f4086a00640 1 -- 172.21.15.67:0/882685970 <== osd.6 v2:172.21.15.82:6819/87066875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4068002dd0 con 0x7f406c07e880 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.228+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f406c07e880 msgr2=0x7f406c080cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.228+0000 7f4095600640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f406c07e880 0x7f406c080cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f406c075100 msgr2=0x7f406c0775c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f406c075100 0x7f406c0775c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4080006d50 tx=0x7f4080006ca0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 msgr2=0x7f4090150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 --2- 172.21.15.67:0/882685970 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f40900cf1c0 0x7f4090150c70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40780097d0 tx=0x7f40780046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f408f400640 1 -- 172.21.15.67:0/882685970 reap_dead start 2024-04-16T13:05:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 shutdown_connections 2024-04-16T13:05:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 >> 172.21.15.67:0/882685970 conn(0x7f4090067d90 msgr2=0x7f409006e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 --> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d80075bd0 con 0x7f1d600760c0 2024-04-16T13:05:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.229+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 shutdown_connections 2024-04-16T13:05:12.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.230+0000 7f4095600640 1 -- 172.21.15.67:0/882685970 wait complete. 2024-04-16T13:05:12.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.230+0000 7f1d77e00640 1 -- 172.21.15.67:0/806175903 <== osd.7 v2:172.21.15.82:6808/43297624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1d80075bd0 con 0x7f1d600760c0 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.232+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f1d600760c0 msgr2=0x7f1d60078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.232+0000 7f1d85c00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f1d600760c0 0x7f1d60078500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.233+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1d6006c940 msgr2=0x7f1d6006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.233+0000 7f1d85c00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1d6006c940 0x7f1d6006ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d70036000 tx=0x7f1d7003c040 comp rx=0 tx=0).stop 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.233+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 msgr2=0x7f1d80159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.233+0000 7f1d85c00640 1 --2- 172.21.15.67:0/806175903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d800b4390 0x7f1d80159040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b410 tx=0x7f1d7800b8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.234+0000 7f1d85200640 1 -- 172.21.15.67:0/806175903 reap_dead start 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.234+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 shutdown_connections 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.234+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 >> 172.21.15.67:0/806175903 conn(0x7f1d8009da80 msgr2=0x7f1d8006d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.234+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 shutdown_connections 2024-04-16T13:05:12.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.234+0000 7f1d85c00640 1 -- 172.21.15.67:0/806175903 wait complete. 2024-04-16T13:05:12.252 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:12.252 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:12.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T13:05:12.253 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T13:05:12.254 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:12.255 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T13:05:12.256 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:12.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T13:05:12.257 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:12.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T13:05:12.258 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:12.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T13:05:12.260 INFO:teuthology.orchestra.run.smithi067.stdout:55834574859 2024-04-16T13:05:12.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T13:05:12.261 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:12.261 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T13:05:12.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.592+0000 7fc3f4e00640 1 Processor -- start 2024-04-16T13:05:12.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.592+0000 7fbb9b000640 1 Processor -- start 2024-04-16T13:05:12.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.593+0000 7fc3f4e00640 1 -- start start 2024-04-16T13:05:12.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.593+0000 7fbb9b000640 1 -- start start 2024-04-16T13:05:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fbb9b000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb940d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fbb9b000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb940d4ff0 0x7fbb940b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fc3eea00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc3e80e3420 0x7fc3e8053d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38062/0 (socket says 172.21.15.67:38062) 2024-04-16T13:05:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fc3eea00640 1 -- 172.21.15.67:0/11010201 learned_addr learned my addr 172.21.15.67:0/11010201 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3e803c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fbb9b000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb940d34c0 con 0x7fbb940d2f80 2024-04-16T13:05:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fbb9b000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbb940d37a0 con 0x7fbb940d4ff0 2024-04-16T13:05:12.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.595+0000 7fbb9b000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb940d3a80 con 0x7fbb9415ecc0 2024-04-16T13:05:12.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e8058980 con 0x7fc3e80e3420 2024-04-16T13:05:12.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fbb93e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb940d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fbb99000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb940d4ff0 0x7fbb940b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fbb99000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb940d4ff0 0x7fbb940b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43728/0 (socket says 172.21.15.67:43728) 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.596+0000 7fbb99000640 1 -- 172.21.15.67:0/1763003718 learned_addr learned my addr 172.21.15.67:0/1763003718 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.597+0000 7fbb99000640 1 -- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 msgr2=0x7fbb940d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.597+0000 7fbb99000640 1 --2- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb940d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.597+0000 7fbb99000640 1 -- 172.21.15.67:0/1763003718 >> v1:172.21.15.82:6789/0 conn(0x7fbb940d2f80 legacy=0x7fbb940d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.597+0000 7fbb99000640 1 -- 172.21.15.67:0/1763003718 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb940d3d60 con 0x7fbb940d4ff0 2024-04-16T13:05:12.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.597+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e8058c60 con 0x7fc3e80e3040 2024-04-16T13:05:12.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e8006860 con 0x7fc3e80544a0 2024-04-16T13:05:12.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439898613 0 0) 0x7fc3e8058980 con 0x7fc3e80e3420 2024-04-16T13:05:12.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc3efe00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3e803c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d8003520 con 0x7fc3e80e3420 2024-04-16T13:05:12.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc56ac00640 1 Processor -- start 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651054110 0 0) 0x7fc3e8058c60 con 0x7fc3e80e3040 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e8058980 con 0x7fc3e80e3040 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 593850638 0 0) 0x7fc3d8003520 con 0x7fc3e80e3420 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 msgr2=0x7fc3e803c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3e803c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7f62b3a00640 1 Processor -- start 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 >> v1:172.21.15.82:6789/0 conn(0x7fc3e80e3040 legacy=0x7fc3e8058130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e8006210 con 0x7fc3e80e3420 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fc3dc001690 con 0x7fc3e80e3420 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 >> v1:172.21.15.67:6789/0 conn(0x7fc3e80e3420 legacy=0x7fc3e8053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8004bd0 0x7fc3d8004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3d80037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc3ee000640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3d8003e00 0x7fc3d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8006860 con 0x7fc3d8003e00 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80045c0 con 0x7fc3d8004bd0 2024-04-16T13:05:12.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d8014710 con 0x7fc3e80544a0 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.598+0000 7fc22be00640 1 Processor -- start 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc22be00640 1 -- start start 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7fc22be00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc224163150 0x7fc2240d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7fc3ef400640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8004bd0 0x7fc3d8004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc3efe00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3d8003e00 0x7fc3d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc3eea00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3d80037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc22be00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2241671c0 con 0x7fc2240b6c30 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc22be00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2241674a0 con 0x7fc2240d2040 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc22be00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc224167d40 con 0x7fc224163150 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7f10ca000640 1 Processor -- start 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.599+0000 7fc56ac00640 1 -- start start 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc56ac00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5640d48e0 0x7fc5640d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc56ac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc56ac00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5640d34c0 con 0x7fc56415ecc0 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc56ac00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc5640d37a0 con 0x7fc5640d48e0 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc56ac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5640d3a80 con 0x7fc5640b7a80 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc3efe00640 1 -- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 msgr2=0x7fc3d80037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fc3efe00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3e80544a0 0x7fc3d80037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc3efe00640 1 -- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8004bd0 msgr2=0x7fc3d8004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc3efe00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8004bd0 0x7fc3d8004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc3efe00640 1 -- 172.21.15.67:0/11010201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d8003520 con 0x7fc3d8003e00 2024-04-16T13:05:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc3ef400640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3d8004bd0 0x7fc3d8004fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:12.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7f10ca000640 1 -- start start 2024-04-16T13:05:12.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.600+0000 7f62b3a00640 1 -- start start 2024-04-16T13:05:12.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.601+0000 7fbb99000640 1 --2- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d4ff0 0x7fbb940b7a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009e50 tx=0x7fbb8c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33c1f326357db505 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fbb92a00640 1 -- 172.21.15.67:0/1763003718 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c02ca80 con 0x7fbb940d4ff0 2024-04-16T13:05:12.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fbb92a00640 1 -- 172.21.15.67:0/1763003718 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c02cc20 con 0x7fbb940d4ff0 2024-04-16T13:05:12.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc229400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc224163150 0x7fc2240d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc229400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc224163150 0x7fc2240d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43748/0 (socket says 172.21.15.67:43748) 2024-04-16T13:05:12.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc229400640 1 -- 172.21.15.67:0/3862606506 learned_addr learned my addr 172.21.15.67:0/3862606506 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc568c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc563400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5640d48e0 0x7fc5640d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc563400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5640d48e0 0x7fc5640d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43756/0 (socket says 172.21.15.67:43756) 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc563400640 1 -- 172.21.15.67:0/3115356104 learned_addr learned my addr 172.21.15.67:0/3115356104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc563e00640 1 --1- 172.21.15.67:0/3115356104 >> v1:172.21.15.82:6789/0 conn(0x7fc56415ecc0 0x7fc5640d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38620/0 (socket says 172.21.15.67:38620) 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.602+0000 7fc568c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51602/0 (socket says 172.21.15.67:51602) 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb92a00640 1 -- 172.21.15.67:0/1763003718 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0343f0 con 0x7fbb940d4ff0 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 -- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d4ff0 msgr2=0x7fbb940b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 --2- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d4ff0 0x7fbb940b7a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009e50 tx=0x7fbb8c02bee0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc3efe00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3d8003e00 0x7fc3d800b9c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0051000 tx=0x7fc3d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6fde6a8d2a2b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00ad070 con 0x7fc3d8003e00 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00b1400 con 0x7fc3d8003e00 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc3ee000640 1 -- 172.21.15.67:0/11010201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0063450 con 0x7fc3d8003e00 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 -- 172.21.15.67:0/1763003718 shutdown_connections 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 --2- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d4ff0 0x7fbb940b7a80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 --2- 172.21.15.67:0/1763003718 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb940d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fbb9b000640 1 -- 172.21.15.67:0/1763003718 >> 172.21.15.67:0/1763003718 conn(0x7fbb94067b80 msgr2=0x7fbb94067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fbb9b000640 1 -- 172.21.15.67:0/1763003718 shutdown_connections 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fbb9b000640 1 -- 172.21.15.67:0/1763003718 wait complete. 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc562a00640 1 -- 172.21.15.67:0/3115356104 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795388142 0 0) 0x7fc5640d34c0 con 0x7fc56415ecc0 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc563400640 1 -- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 msgr2=0x7fc5640b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc563400640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7fc563400640 1 -- 172.21.15.67:0/3115356104 >> v1:172.21.15.82:6789/0 conn(0x7fc56415ecc0 legacy=0x7fc5640d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10ca000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 0x7f10c41695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10ca000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c40b93e0 con 0x7f10c40b7020 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10ca000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c40b96c0 con 0x7f10c415e990 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10ca000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f10c40d29e0 con 0x7f10c40d3e80 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10c3400640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f10c415e990 0x7f10c40b6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38638/0 (socket says 172.21.15.67:38638) 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f10c3400640 1 -- 172.21.15.67:0/1549654373 learned_addr learned my addr 172.21.15.67:0/1549654373 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7f62b3a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62ac0cdfb0 0x7f62ac1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7f62b3a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac0ce5d0 con 0x7f62ac15ec70 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f62b3a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac0ce8b0 con 0x7f62ac06ec00 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.604+0000 7f62b3a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac151f00 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc229400640 1 -- 172.21.15.67:0/3862606506 >> v1:172.21.15.82:6789/0 conn(0x7fc2240d2040 legacy=0x7fc224163bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc229400640 1 -- 172.21.15.67:0/3862606506 >> v1:172.21.15.67:6789/0 conn(0x7fc2240b6c30 legacy=0x7fc2240d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.603+0000 7fc229400640 1 -- 172.21.15.67:0/3862606506 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc224167780 con 0x7fc224163150 2024-04-16T13:05:12.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f62b1a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62ac0cdfb0 0x7f62ac1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f10c3e00640 1 --2- 172.21.15.67:0/1549654373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 0x7f10c41695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc563400640 1 -- 172.21.15.67:0/3115356104 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5640d3d60 con 0x7fc5640d48e0 2024-04-16T13:05:12.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f62b1000640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f62ac06ec00 0x7f62ac15e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38626/0 (socket says 172.21.15.67:38626) 2024-04-16T13:05:12.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f62b1000640 1 -- 172.21.15.67:0/2331293203 learned_addr learned my addr 172.21.15.67:0/2331293203 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f62b1a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62ac0cdfb0 0x7f62ac1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52294/0 (socket says 172.21.15.67:52294) 2024-04-16T13:05:12.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc568c00640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:12.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc229400640 1 --2- 172.21.15.67:0/3862606506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc224163150 0x7fc2240d2740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e50 tx=0x7fc21402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473d44b8f1e468b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3d8003e00 msgr2=0x7fc3d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7f62abe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f62ac15ec70 0x7f62ac0cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38092/0 (socket says 172.21.15.67:38092) 2024-04-16T13:05:12.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/11010201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3d8003e00 0x7fc3d800b9c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0051000 tx=0x7fc3d8005830 comp rx=0 tx=0).stop 2024-04-16T13:05:12.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.605+0000 7fc3efe00640 1 -- 172.21.15.67:0/11010201 reap_dead start 2024-04-16T13:05:12.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f10c2000640 1 -- 172.21.15.67:0/1549654373 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556130845 0 0) 0x7f10c40b96c0 con 0x7f10c415e990 2024-04-16T13:05:12.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 shutdown_connections 2024-04-16T13:05:12.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 >> 172.21.15.67:0/11010201 conn(0x7fc3e803aa40 msgr2=0x7fc3e803ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 shutdown_connections 2024-04-16T13:05:12.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470164718 0 0) 0x7f62ac0ce8b0 con 0x7f62ac06ec00 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6294003520 con 0x7f62ac06ec00 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f10c2000640 1 -- 172.21.15.67:0/1549654373 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a8003520 con 0x7f10c415e990 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f10c3e00640 1 -- 172.21.15.67:0/1549654373 >> v1:172.21.15.82:6789/0 conn(0x7f10c415e990 legacy=0x7f10c40b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f10c3e00640 1 -- 172.21.15.67:0/1549654373 >> v1:172.21.15.67:6789/0 conn(0x7f10c40b7020 legacy=0x7f10c40b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7f10c3e00640 1 -- 172.21.15.67:0/1549654373 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c40b99a0 con 0x7f10c40d3e80 2024-04-16T13:05:12.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7f62b1a00640 1 -- 172.21.15.67:0/2331293203 >> v1:172.21.15.82:6789/0 conn(0x7f62ac06ec00 legacy=0x7f62ac15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215806369 0 0) 0x7f62ac0ce5d0 con 0x7f62ac15ec70 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7fc223e00640 1 -- 172.21.15.67:0/3862606506 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21402ca80 con 0x7fc224163150 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7fc223e00640 1 -- 172.21.15.67:0/3862606506 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21402cc20 con 0x7fc224163150 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7fc223e00640 1 -- 172.21.15.67:0/3862606506 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2140343f0 con 0x7fc224163150 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.606+0000 7fc3f4e00640 1 -- 172.21.15.67:0/11010201 wait complete. 2024-04-16T13:05:12.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7f62b1a00640 1 -- 172.21.15.67:0/2331293203 >> v1:172.21.15.67:6789/0 conn(0x7f62ac15ec70 legacy=0x7f62ac0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.607+0000 7f62b1a00640 1 -- 172.21.15.67:0/2331293203 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0cf070 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc563400640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5640d48e0 0x7fc5640d4d70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc554009870 tx=0x7fc55402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=299a1a97e22825e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc22be00640 1 -- 172.21.15.67:0/3862606506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc224163150 msgr2=0x7fc2240d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc22be00640 1 --2- 172.21.15.67:0/3862606506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc224163150 0x7fc2240d2740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc214009e50 tx=0x7fc21402bee0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fbb9b000640 1 Processor -- start 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fbb9b000640 1 -- start start 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7f10c3e00640 1 --2- 172.21.15.67:0/1549654373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 0x7f10c41695d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009dc0 tx=0x7f10bc02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a745ad3181c71d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc22be00640 1 -- 172.21.15.67:0/3862606506 shutdown_connections 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc22be00640 1 --2- 172.21.15.67:0/3862606506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc224163150 0x7fc2240d2740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.608+0000 7fc22be00640 1 -- 172.21.15.67:0/3862606506 >> 172.21.15.67:0/3862606506 conn(0x7fc224067b80 msgr2=0x7fc224067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc562a00640 1 -- 172.21.15.67:0/3115356104 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554034070 con 0x7fc5640d48e0 2024-04-16T13:05:12.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc22be00640 1 -- 172.21.15.67:0/3862606506 shutdown_connections 2024-04-16T13:05:12.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc3f4e00640 1 Processor -- start 2024-04-16T13:05:12.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f10c2000640 1 -- 172.21.15.67:0/1549654373 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc039070 con 0x7f10c40d3e80 2024-04-16T13:05:12.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f10c2000640 1 -- 172.21.15.67:0/1549654373 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10bc02ccc0 con 0x7f10c40d3e80 2024-04-16T13:05:12.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f10c2000640 1 -- 172.21.15.67:0/1549654373 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc034660 con 0x7f10c40d3e80 2024-04-16T13:05:12.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f62b1a00640 1 --2- 172.21.15.67:0/2331293203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac1519c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34957ed2331d1996 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc3f4e00640 1 -- start start 2024-04-16T13:05:12.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc22be00640 1 -- 172.21.15.67:0/3862606506 wait complete. 2024-04-16T13:05:12.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4039070 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a402cd80 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7f62ab400640 1 -- 172.21.15.67:0/2331293203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4034660 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc562a00640 1 -- 172.21.15.67:0/3115356104 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554030840 con 0x7fc5640d48e0 2024-04-16T13:05:12.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.609+0000 7fc562a00640 1 -- 172.21.15.67:0/3115356104 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554030c10 con 0x7fc5640d48e0 2024-04-16T13:05:12.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 0x7fbb941591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb9415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fc56ac00640 1 -- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5640d48e0 msgr2=0x7fc5640d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5640d48e0 0x7fc5640d4d70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc554009870 tx=0x7fc55402b980 comp rx=0 tx=0).stop 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7f62b3a00640 1 -- 172.21.15.67:0/2331293203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 msgr2=0x7f62ac1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7f62b3a00640 1 --2- 172.21.15.67:0/2331293203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac1519c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009d90 tx=0x7f62a402bfd0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9415f0a0 con 0x7fbb940d4ff0 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb940d4560 con 0x7fbb940d2f80 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb9b000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbb940ba7c0 con 0x7fbb9415ecc0 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7fbb93e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb93e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43770/0 (socket says 172.21.15.67:43770) 2024-04-16T13:05:12.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb93e00640 1 -- 172.21.15.67:0/3467812822 learned_addr learned my addr 172.21.15.67:0/3467812822 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 -- 172.21.15.67:0/3115356104 shutdown_connections 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640b7a80 0x7fc5640b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3115356104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5640d48e0 0x7fc5640d4d70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 -- 172.21.15.67:0/3115356104 >> 172.21.15.67:0/3115356104 conn(0x7fc564067b80 msgr2=0x7fc564067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7f10ca000640 1 -- 172.21.15.67:0/1549654373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 msgr2=0x7f10c41695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.610+0000 7f10ca000640 1 --2- 172.21.15.67:0/1549654373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 0x7f10c41695d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009dc0 tx=0x7f10bc02bf10 comp rx=0 tx=0).stop 2024-04-16T13:05:12.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb99000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb9415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7f10ca000640 1 -- 172.21.15.67:0/1549654373 shutdown_connections 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7f10ca000640 1 --2- 172.21.15.67:0/1549654373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c40d3e80 0x7f10c41695d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7f10ca000640 1 -- 172.21.15.67:0/1549654373 >> 172.21.15.67:0/1549654373 conn(0x7f10c4067b80 msgr2=0x7f10c4067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb93400640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 0x7fbb941591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 -- 172.21.15.67:0/3115356104 shutdown_connections 2024-04-16T13:05:12.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc56ac00640 1 -- 172.21.15.67:0/3115356104 wait complete. 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb93e00640 1 -- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 msgr2=0x7fbb9415f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fbb93e00640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb9415f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.611+0000 7fc3f4e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3d8003e00 0x7fc3e80e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3f4e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80d3470 0x7fc3e80d2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3f4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3f4e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e803c300 con 0x7fc3e8050020 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3f4e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e803c180 con 0x7fc3e80d3470 2024-04-16T13:05:12.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3f4e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e803c480 con 0x7fc3d8003e00 2024-04-16T13:05:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7f62b3a00640 1 -- 172.21.15.67:0/2331293203 shutdown_connections 2024-04-16T13:05:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7f62b3a00640 1 --2- 172.21.15.67:0/2331293203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac1519c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7f62b3a00640 1 -- 172.21.15.67:0/2331293203 >> 172.21.15.67:0/2331293203 conn(0x7f62ac06e0e0 msgr2=0x7f62ac06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7f10ca000640 1 -- 172.21.15.67:0/1549654373 shutdown_connections 2024-04-16T13:05:12.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc22be00640 1 Processor -- start 2024-04-16T13:05:12.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7f10ca000640 1 -- 172.21.15.67:0/1549654373 wait complete. 2024-04-16T13:05:12.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3efe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fbb93e00640 1 -- 172.21.15.67:0/3467812822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 msgr2=0x7fbb941591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fbb93e00640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 0x7fbb941591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fbb93e00640 1 -- 172.21.15.67:0/3467812822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb94158140 con 0x7fbb940d2f80 2024-04-16T13:05:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fbb99000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb9415f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fbb93400640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 0x7fbb941591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:12.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3efe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52298/0 (socket says 172.21.15.67:52298) 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc3efe00640 1 -- 172.21.15.67:0/3594005401 learned_addr learned my addr 172.21.15.67:0/3594005401 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3eea00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80d3470 0x7fc3e80d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3ef400640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3d8003e00 0x7fc3e80e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3efe00640 1 -- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3d8003e00 msgr2=0x7fc3e80e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3efe00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3d8003e00 0x7fc3e80e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3efe00640 1 -- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80d3470 msgr2=0x7fc3e80d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3efe00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80d3470 0x7fc3e80d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fc3efe00640 1 -- 172.21.15.67:0/3594005401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e80de6b0 con 0x7fc3e8050020 2024-04-16T13:05:12.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7fbb93e00640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d800 tx=0x7fbb8400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.612+0000 7fc22be00640 1 -- start start 2024-04-16T13:05:12.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400b6c0 con 0x7fbb940d2f80 2024-04-16T13:05:12.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3efe00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0050b40 tx=0x7fc3f00697f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc56ac00640 1 Processor -- start 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40014f0 con 0x7fc3e8050020 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.613+0000 7f62b3a00640 1 -- 172.21.15.67:0/2331293203 shutdown_connections 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e80de990 con 0x7fc3e8050020 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f0063240 con 0x7fc3e8050020 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e80def50 con 0x7fc3e8050020 2024-04-16T13:05:12.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00ba480 con 0x7fc3e8050020 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7f62b3a00640 1 -- 172.21.15.67:0/2331293203 wait complete. 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2240b6c30 0x7fc22415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc228a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc224163150 0x7fc224201c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc224166dc0 con 0x7fc224163150 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2240d2c80 con 0x7fc2240d2040 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc22be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc224166f40 con 0x7fc2240b6c30 2024-04-16T13:05:12.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.615+0000 7fc229400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2240b6c30 0x7fc22415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.615+0000 7fc228a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43788/0 (socket says 172.21.15.67:43788) 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.615+0000 7fc228a00640 1 -- 172.21.15.67:0/1465702201 learned_addr learned my addr 172.21.15.67:0/1465702201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.614+0000 7fc56ac00640 1 -- start start 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7f10ca000640 1 Processor -- start 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7f10ca000640 1 -- start start 2024-04-16T13:05:12.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e803b2e0 con 0x7fc3e8050020 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb84019070 con 0x7fbb940d2f80 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400ba80 con 0x7fbb940d2f80 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc228a00640 1 -- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2240b6c30 msgr2=0x7fc22415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc228a00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2240b6c30 0x7fc22415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc228a00640 1 -- 172.21.15.67:0/1465702201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc224163150 msgr2=0x7fc224201c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc228a00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc224163150 0x7fc224201c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7fc228a00640 1 -- 172.21.15.67:0/1465702201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22415e310 con 0x7fc2240d2040 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb94158420 con 0x7fbb940d2f80 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb941589e0 con 0x7fbb940d2f80 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640d48e0 0x7fc5640ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56415ecc0 0x7fc56414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc56415f0a0 con 0x7fc5640b7a80 2024-04-16T13:05:12.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5640d4560 con 0x7fc56415ecc0 2024-04-16T13:05:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc56ac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc5640d3150 con 0x7fc5640d48e0 2024-04-16T13:05:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7f10ca000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c40b7020 0x7f10c40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7eff1f600640 1 Processor -- start 2024-04-16T13:05:12.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7eff1f600640 1 -- start start 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7fc228a00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc21000c430 tx=0x7fc21000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7f10ca000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7f10ca000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c415e990 0x7f10c40c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7f10ca000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f10c40b9030 con 0x7f10c40d3e80 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7f10ca000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10c415ed70 con 0x7f10c40b7020 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7f10ca000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f10c414f620 con 0x7f10c415e990 2024-04-16T13:05:12.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7fc568c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56415ecc0 0x7fc56414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3f00c2020 con 0x7fc3e8050020 2024-04-16T13:05:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.616+0000 7f62b3a00640 1 Processor -- start 2024-04-16T13:05:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.617+0000 7f62b3a00640 1 -- start start 2024-04-16T13:05:12.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fe025a00640 1 Processor -- start 2024-04-16T13:05:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7f10c2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fe025a00640 1 -- start start 2024-04-16T13:05:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9415cdb0 con 0x7fbb940d2f80 2024-04-16T13:05:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7f10c2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52326/0 (socket says 172.21.15.67:52326) 2024-04-16T13:05:12.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7f10c2a00640 1 -- 172.21.15.67:0/2198122590 learned_addr learned my addr 172.21.15.67:0/2198122590 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7f10c3400640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c40b7020 0x7f10c40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7f10c3e00640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c415e990 0x7f10c40c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.618+0000 7fc563e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc563400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640d48e0 0x7fc5640ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc563e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52310/0 (socket says 172.21.15.67:52310) 2024-04-16T13:05:12.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc563e00640 1 -- 172.21.15.67:0/3014046779 learned_addr learned my addr 172.21.15.67:0/3014046779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc3e3400640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3f0128c20 con 0x7fc3e8050020 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc563e00640 1 -- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640d48e0 msgr2=0x7fc5640ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc563e00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640d48e0 0x7fc5640ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc563e00640 1 -- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56415ecc0 msgr2=0x7fc56414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc563e00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56415ecc0 0x7fc56414dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc563e00640 1 -- 172.21.15.67:0/3014046779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5641556e0 con 0x7fc5640b7a80 2024-04-16T13:05:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f10c2a00640 1 -- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c415e990 msgr2=0x7f10c40c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f62b3a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 0x7f62ac142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fc3ef400640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f10c2a00640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c415e990 0x7f10c40c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f10c2a00640 1 -- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c40b7020 msgr2=0x7f10c40ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f10c2a00640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c40b7020 0x7f10c40ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f10c2a00640 1 -- 172.21.15.67:0/2198122590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c40cdd80 con 0x7f10c40d3e80 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f62b3a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f62b3a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62ac15ec70 0x7f62ac1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7f62b3a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0b3700 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62b3a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0cee20 con 0x7f62ac06ec00 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62b3a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac0b3880 con 0x7f62ac15ec70 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fe025a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe02015ecc0 0x7fe0200d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fe025a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0200d4ff0 0x7fe0200b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fc563e00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc55c002200 tx=0x7fc55c00a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f10c2a00640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c370 tx=0x7f10b000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62abe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62b1a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62ac15ec70 0x7f62ac1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62abe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52340/0 (socket says 172.21.15.67:52340) 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7f62abe00640 1 -- 172.21.15.67:0/3209776701 learned_addr learned my addr 172.21.15.67:0/3209776701 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7f62b1000640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 0x7f62ac142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210011790 con 0x7fc2240d2040 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc210017070 con 0x7fc2240d2040 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.619+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210011b70 con 0x7fc2240d2040 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22415e5f0 con 0x7fc2240d2040 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.620+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2240c9ba0 con 0x7fc2240d2040 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7eff1f600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7eff1806ed50 0x7eff1816dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7eff1f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18149390 con 0x7eff180b5df0 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7eff1f600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff181677e0 con 0x7eff18148fb0 2024-04-16T13:05:12.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7eff1f600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7eff18164310 con 0x7eff1806ed50 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fe025a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0200d34c0 con 0x7fe0200d2f80 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fe025a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe0200d37a0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.621+0000 7fe025a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe0200d3a80 con 0x7fe02015ecc0 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01ea00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe02015ecc0 0x7fe0200d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01e000640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0200d2f80 0x7fe0200d48e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38640/0 (socket says 172.21.15.67:38640) 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01e000640 1 -- 172.21.15.67:0/314636462 learned_addr learned my addr 172.21.15.67:0/314636462 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7eff1cc00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7eff18148fb0 0x7eff180b56e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38644/0 (socket says 172.21.15.67:38644) 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7eff1cc00640 1 -- 172.21.15.67:0/854717335 learned_addr learned my addr 172.21.15.67:0/854717335 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7eff17e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7eff180b5df0 0x7eff1806e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38100/0 (socket says 172.21.15.67:38100) 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7eff1d600640 1 --2- 172.21.15.67:0/854717335 >> v2:172.21.15.82:3300/0 conn(0x7eff1806ed50 0x7eff1816dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01f400640 1 --2- 172.21.15.67:0/314636462 >> v2:172.21.15.67:3300/0 conn(0x7fe0200d4ff0 0x7fe0200b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2240c9da0 con 0x7fc2240d2040 2024-04-16T13:05:12.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01f400640 1 -- 172.21.15.67:0/314636462 >> v2:172.21.15.82:3300/0 conn(0x7fe02015ecc0 msgr2=0x7fe0200d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:12.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.622+0000 7fe01f400640 1 --2- 172.21.15.67:0/314636462 >> v2:172.21.15.82:3300/0 conn(0x7fe02015ecc0 0x7fe0200d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62abe00640 1 -- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62ac15ec70 msgr2=0x7f62ac1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7fe01f400640 1 -- 172.21.15.67:0/314636462 >> v1:172.21.15.82:6789/0 conn(0x7fe0200d2f80 legacy=0x7fe0200d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7fe01f400640 1 -- 172.21.15.67:0/314636462 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0200d3d60 con 0x7fe0200d4ff0 2024-04-16T13:05:12.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb8400bc20 con 0x7fbb940d2f80 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62abe00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62ac15ec70 0x7f62ac1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62abe00640 1 -- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 msgr2=0x7f62ac142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62abe00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 0x7f62ac142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62abe00640 1 -- 172.21.15.67:0/3209776701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac152090 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.623+0000 7f62b1000640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 0x7f62ac142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7eff1d600640 1 -- 172.21.15.67:0/854717335 >> v1:172.21.15.82:6789/0 conn(0x7eff18148fb0 legacy=0x7eff180b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7eff1d600640 1 -- 172.21.15.67:0/854717335 >> v1:172.21.15.67:6789/0 conn(0x7eff180b5df0 legacy=0x7eff1806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7eff1d600640 1 -- 172.21.15.67:0/854717335 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff18166a20 con 0x7eff1806ed50 2024-04-16T13:05:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7f62abe00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f629800c420 tx=0x7f629800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7fc3ef400640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 0x7fc3d006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3e804ff50 tx=0x7fc3e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7fbb8be00640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 0x7fbb7406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbb8408ce50 con 0x7fbb940d2f80 2024-04-16T13:05:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.624+0000 7fe01f400640 1 --2- 172.21.15.67:0/314636462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe0200b7a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0200d22d0 tx=0x7fe01002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4e9c4a7cb6c18e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.625+0000 7fbb93400640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 0x7fbb7406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.625+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc210011d10 con 0x7fc2240d2040 2024-04-16T13:05:12.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.625+0000 7eff1d600640 1 --2- 172.21.15.67:0/854717335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1806ed50 0x7eff1816dc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c5060eab0d55829 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.626+0000 7fbb93400640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 0x7fbb7406ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb9415b610 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.626+0000 7fc221600640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 0x7fc20406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c004d60 con 0x7fc5640b7a80 2024-04-16T13:05:12.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62980074e0 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac152370 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62980047e0 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0017070 con 0x7f10c40d3e80 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c40ca110 con 0x7f10c40d3e80 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b00052d0 con 0x7f10c40d3e80 2024-04-16T13:05:12.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3f00c9020 con 0x7fc3e8050020 2024-04-16T13:05:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0003850 con 0x7f10c40d3e80 2024-04-16T13:05:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c40ca6d0 con 0x7f10c40d3e80 2024-04-16T13:05:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc229400640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 0x7fc20406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac152930 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c0070d0 con 0x7fc5640b7a80 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c007500 con 0x7fc5640b7a80 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.627+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5641559c0 con 0x7fc5640b7a80 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.628+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5640cd800 con 0x7fc5640b7a80 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.628+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298004c10 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ac068a70 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7fe01d600640 1 -- 172.21.15.67:0/314636462 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010039070 con 0x7fe0200d4ff0 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7fe01d600640 1 -- 172.21.15.67:0/314636462 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01002cc80 con 0x7fe0200d4ff0 2024-04-16T13:05:12.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7fe01d600640 1 -- 172.21.15.67:0/314636462 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010034660 con 0x7fe0200d4ff0 2024-04-16T13:05:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c005290 con 0x7f10c40d3e80 2024-04-16T13:05:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.629+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc564068a70 con 0x7fc5640b7a80 2024-04-16T13:05:12.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fc229400640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 0x7fc20406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc214035000 tx=0x7fc214030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 -- 172.21.15.67:0/314636462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 msgr2=0x7fe0200b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 --2- 172.21.15.67:0/314636462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe0200b7a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe0200d22d0 tx=0x7fe01002bed0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 -- 172.21.15.67:0/314636462 shutdown_connections 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 --2- 172.21.15.67:0/314636462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe0200b7a80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 --2- 172.21.15.67:0/314636462 >> v2:172.21.15.82:3300/0 conn(0x7fe02015ecc0 0x7fe0200d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.630+0000 7fe025a00640 1 -- 172.21.15.67:0/314636462 >> 172.21.15.67:0/314636462 conn(0x7fe020067b80 msgr2=0x7fe020067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.631+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6298011070 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.631+0000 7f62a8c00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 0x7f628c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.631+0000 7fe025a00640 1 -- 172.21.15.67:0/314636462 shutdown_connections 2024-04-16T13:05:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.632+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f629808ba20 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.632+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc55c0076a0 con 0x7fc5640b7a80 2024-04-16T13:05:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.632+0000 7f62b1000640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 0x7f628c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.632+0000 7fe025a00640 1 -- 172.21.15.67:0/314636462 wait complete. 2024-04-16T13:05:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.633+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10b001a070 con 0x7f10c40d3e80 2024-04-16T13:05:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.633+0000 7fc55be00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 0x7fc54006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.633+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc55c094440 con 0x7fc5640b7a80 2024-04-16T13:05:12.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.633+0000 7f62b1000640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 0x7f628c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62a0005880 tx=0x7f62a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.634+0000 7f10bb400640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 0x7f10a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.634+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10b008b500 con 0x7f10c40d3e80 2024-04-16T13:05:12.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.634+0000 7fc563400640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 0x7fc54006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.634+0000 7f10c3400640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 0x7f10a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.635+0000 7fe025a00640 1 Processor -- start 2024-04-16T13:05:12.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.635+0000 7fe025a00640 1 -- start start 2024-04-16T13:05:12.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.635+0000 7fc563400640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 0x7fc54006ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc554036000 tx=0x7fc554008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7f10c3400640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 0x7f10a406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007ac0 tx=0x7f10b4007a10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10b0021020 con 0x7f10c40d3e80 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0200d2f80 0x7fe02014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe02015ecc0 0x7fe02015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe02015f0a0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0200d4560 con 0x7fe0200d2f80 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.636+0000 7fe025a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0200ba7c0 con 0x7fe02015ecc0 2024-04-16T13:05:12.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.637+0000 7fe01e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.637+0000 7fe01e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52364/0 (socket says 172.21.15.67:52364) 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.637+0000 7fe01e000640 1 -- 172.21.15.67:0/2049940817 learned_addr learned my addr 172.21.15.67:0/2049940817 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.637+0000 7fe01ea00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0200d2f80 0x7fe02014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.637+0000 7fe01f400640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe02015ecc0 0x7fe02015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 -- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe02015ecc0 msgr2=0x7fe02015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe02015ecc0 0x7fe02015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 -- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0200d2f80 msgr2=0x7fe02014e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0200d2f80 0x7fe02014e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 -- 172.21.15.67:0/2049940817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0200cb2e0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.638+0000 7fe01e000640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c3c0 tx=0x7fe00800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.642+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62980593a0 con 0x7f62ac0cdfb0 2024-04-16T13:05:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.643+0000 7eff17400640 1 -- 172.21.15.67:0/854717335 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10039070 con 0x7eff1806ed50 2024-04-16T13:05:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.643+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc210058220 con 0x7fc2240d2040 2024-04-16T13:05:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.644+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb9415cdb0 con 0x7fbb940d2f80 2024-04-16T13:05:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008017070 con 0x7fe0200d4ff0 2024-04-16T13:05:12.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc55c061e40 con 0x7fc5640b7a80 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe008005ce0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0080072d0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0200c97a0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.647+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0200c9d20 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.649+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020068a70 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.650+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe00801a070 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.651+0000 7fe016a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 0x7fdffc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.651+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe00808b130 con 0x7fe0200d4ff0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.651+0000 7fe01ea00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 0x7fdffc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.653+0000 7fe01ea00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 0x7fdffc06ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe018008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.658+0000 7eff17400640 1 -- 172.21.15.67:0/854717335 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1002cc60 con 0x7eff1806ed50 2024-04-16T13:05:12.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.658+0000 7eff17400640 1 -- 172.21.15.67:0/854717335 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10034660 con 0x7eff1806ed50 2024-04-16T13:05:12.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.658+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2240c9da0 con 0x7fc2240d2040 2024-04-16T13:05:12.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.659+0000 7eff1f600640 1 -- 172.21.15.67:0/854717335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1806ed50 msgr2=0x7eff1816dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.659+0000 7eff1f600640 1 --2- 172.21.15.67:0/854717335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1806ed50 0x7eff1816dc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff10009d90 tx=0x7eff1002beb0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7eff1f600640 1 -- 172.21.15.67:0/854717335 shutdown_connections 2024-04-16T13:05:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7eff1f600640 1 --2- 172.21.15.67:0/854717335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1806ed50 0x7eff1816dc80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7eff1f600640 1 -- 172.21.15.67:0/854717335 >> 172.21.15.67:0/854717335 conn(0x7eff18067b80 msgr2=0x7eff1806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:12.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe008058bb0 con 0x7fe0200d4ff0 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7eff1f600640 1 -- 172.21.15.67:0/854717335 shutdown_connections 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.660+0000 7eff1f600640 1 -- 172.21.15.67:0/854717335 wait complete. 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.663+0000 7eff1f600640 1 Processor -- start 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.663+0000 7eff1f600640 1 -- start start 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.665+0000 7eff1f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1f600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff180b5df0 0x7eff18147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1f600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 0x7eff180b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff18166fe0 con 0x7eff1806ed50 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1f600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff1806f370 con 0x7eff18148fb0 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1f600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7eff1816e1c0 con 0x7eff180b5df0 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.666+0000 7eff1cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.667+0000 7eff1cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52368/0 (socket says 172.21.15.67:52368) 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.667+0000 7eff1cc00640 1 -- 172.21.15.67:0/3264880683 learned_addr learned my addr 172.21.15.67:0/3264880683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1d600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 0x7eff180b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff17e00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff180b5df0 0x7eff18147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1cc00640 1 -- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff180b5df0 msgr2=0x7eff18147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1cc00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff180b5df0 0x7eff18147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1cc00640 1 -- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 msgr2=0x7eff180b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1cc00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 0x7eff180b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.668+0000 7eff1cc00640 1 -- 172.21.15.67:0/3264880683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff181456f0 con 0x7eff1806ed50 2024-04-16T13:05:12.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.669+0000 7eff1d600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 0x7eff180b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.669+0000 7eff1cc00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c480 tx=0x7eff0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.670+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08017070 con 0x7eff1806ed50 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.670+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff18146470 con 0x7eff1806ed50 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.670+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08005ce0 con 0x7eff1806ed50 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.674+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08017070 con 0x7eff1806ed50 2024-04-16T13:05:12.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.674+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff18145990 con 0x7eff1806ed50 2024-04-16T13:05:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.675+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff0801a070 con 0x7eff1806ed50 2024-04-16T13:05:12.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.675+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff18068a70 con 0x7eff1806ed50 2024-04-16T13:05:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.677+0000 7eff14c00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 0x7efef806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:12.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.677+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7eff0808abd0 con 0x7eff1806ed50 2024-04-16T13:05:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.682+0000 7eff17e00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 0x7efef806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:12.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.683+0000 7eff17e00640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 0x7efef806efb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff180ce920 tx=0x7eff04007c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:12.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:12.686+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff08058dd0 con 0x7eff1806ed50 2024-04-16T13:05:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.067+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc3e804c860 con 0x7fc3e8050020 2024-04-16T13:05:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.068+0000 7fc3e3400640 1 -- 172.21.15.67:0/3594005401 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3f00f6b60 con 0x7fc3e8050020 2024-04-16T13:05:13.071 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-16T13:05:13.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.072+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 msgr2=0x7fc3d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.072+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 0x7fc3d006edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3e804ff50 tx=0x7fc3e4009040 comp rx=0 tx=0).stop 2024-04-16T13:05:13.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.072+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 msgr2=0x7fc3e80389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.072+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0050b40 tx=0x7fc3f00697f0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 shutdown_connections 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3e8050020 0x7fc3e80389b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80d3470 0x7fc3e80d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 --2- 172.21.15.67:0/3594005401 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3d8003e00 0x7fc3e80e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.073+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 >> 172.21.15.67:0/3594005401 conn(0x7fc3e803aa40 msgr2=0x7fc3e8039cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.074+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 shutdown_connections 2024-04-16T13:05:13.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.074+0000 7fc3f4e00640 1 -- 172.21.15.67:0/3594005401 wait complete. 2024-04-16T13:05:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.090+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f62ac1434f0 con 0x7f62ac0cdfb0 2024-04-16T13:05:13.096 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.092+0000 7f62a8c00640 1 -- 172.21.15.67:0/3209776701 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f629805d6a0 con 0x7f62ac0cdfb0 2024-04-16T13:05:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.095+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f109c005850 con 0x7f10c40d3e80 2024-04-16T13:05:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.096+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 msgr2=0x7f628c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.096+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 0x7f628c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62a0005880 tx=0x7f62a0009040 comp rx=0 tx=0).stop 2024-04-16T13:05:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.096+0000 7f10bb400640 1 -- 172.21.15.67:0/2198122590 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10b0059010 con 0x7f10c40d3e80 2024-04-16T13:05:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.096+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 msgr2=0x7f62ac13f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.098 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.096+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f629800c420 tx=0x7f629800c8e0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 shutdown_connections 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f628c06c920 0x7f628c06ede0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62a0005880 tx=0x7f62a0009040 comp rx=0 tx=0).stop 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f62ac15ec70 0x7f62ac1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62ac0cdfb0 0x7f62ac13f900 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 --2- 172.21.15.67:0/3209776701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ac06ec00 0x7f62ac142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.097+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 >> 172.21.15.67:0/3209776701 conn(0x7f62ac06e0e0 msgr2=0x7f62ac142600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.098+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 shutdown_connections 2024-04-16T13:05:13.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.098+0000 7f62b3a00640 1 -- 172.21.15.67:0/3209776701 wait complete. 2024-04-16T13:05:13.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.099+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbb94068a70 con 0x7fbb940d2f80 2024-04-16T13:05:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.099+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 msgr2=0x7f10a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 0x7f10a406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007ac0 tx=0x7f10b4007a10 comp rx=0 tx=0).stop 2024-04-16T13:05:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 msgr2=0x7f10c40c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c370 tx=0x7f10b000c830 comp rx=0 tx=0).stop 2024-04-16T13:05:13.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc56415b0c0 con 0x7fc5640b7a80 2024-04-16T13:05:13.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 shutdown_connections 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f10a406c8f0 0x7f10a406edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10c415e990 0x7f10c40c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10c40d3e80 0x7f10c40c95e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7fbb8be00640 1 -- 172.21.15.67:0/3467812822 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb8405afb0 con 0x7fbb940d2f80 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 --2- 172.21.15.67:0/2198122590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c40b7020 0x7f10c40ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.100+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 >> 172.21.15.67:0/2198122590 conn(0x7f10c4067b80 msgr2=0x7f10c40b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.104 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:13.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.101+0000 7fc55be00640 1 -- 172.21.15.67:0/3014046779 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc55c066140 con 0x7fc5640b7a80 2024-04-16T13:05:13.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.101+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 shutdown_connections 2024-04-16T13:05:13.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.101+0000 7f10ca000640 1 -- 172.21.15.67:0/2198122590 wait complete. 2024-04-16T13:05:13.105 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-16T13:05:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 msgr2=0x7fbb7406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 0x7fbb7406ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb9415b610 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 msgr2=0x7fbb940c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d800 tx=0x7fbb8400dcc0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 shutdown_connections 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbb7406c940 0x7fbb7406ee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbb9415ecc0 0x7fbb9415f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb940d4ff0 0x7fbb941591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 --2- 172.21.15.67:0/3467812822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb940d2f80 0x7fbb940c74f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.103+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 >> 172.21.15.67:0/3467812822 conn(0x7fbb94067b80 msgr2=0x7fbb940b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.104+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 shutdown_connections 2024-04-16T13:05:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.104+0000 7fbb9b000640 1 -- 172.21.15.67:0/3467812822 wait complete. 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 msgr2=0x7fc54006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 0x7fc54006ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc554036000 tx=0x7fc554008030 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 msgr2=0x7fc5640b9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc55c002200 tx=0x7fc55c00a4f0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 shutdown_connections 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc54006c920 0x7fc54006ede0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc554036000 tx=0x7fc554008030 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56415ecc0 0x7fc56414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc5640d48e0 0x7fc5640ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 --2- 172.21.15.67:0/3014046779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5640b7a80 0x7fc5640b9f00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.105+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 >> 172.21.15.67:0/3014046779 conn(0x7fc564067b80 msgr2=0x7fc564159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.106+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 shutdown_connections 2024-04-16T13:05:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.106+0000 7fc56ac00640 1 -- 172.21.15.67:0/3014046779 wait complete. 2024-04-16T13:05:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.107+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc224068a70 con 0x7fc2240d2040 2024-04-16T13:05:13.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.108+0000 7fc221600640 1 -- 172.21.15.67:0/1465702201 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc21005a880 con 0x7fc2240d2040 2024-04-16T13:05:13.110 INFO:teuthology.orchestra.run.smithi067.stdout:55834574856 2024-04-16T13:05:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.112+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe0200c7b90 con 0x7fe0200d4ff0 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.112+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 msgr2=0x7fc20406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.112+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 0x7fc20406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc214035000 tx=0x7fc214030000 comp rx=0 tx=0).stop 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.112+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 msgr2=0x7fc2240ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.112+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc21000c430 tx=0x7fc21000c8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 shutdown_connections 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc20406c8f0 0x7fc20406edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc224163150 0x7fc224201c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2240d2040 0x7fc2240ce5c0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc21000c430 tx=0x7fc21000c8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 --2- 172.21.15.67:0/1465702201 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2240b6c30 0x7fc22415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 >> 172.21.15.67:0/1465702201 conn(0x7fc224067b80 msgr2=0x7fc224164410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fe016a00640 1 -- 172.21.15.67:0/2049940817 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe00805ceb0 con 0x7fe0200d4ff0 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 shutdown_connections 2024-04-16T13:05:13.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.113+0000 7fc22be00640 1 -- 172.21.15.67:0/1465702201 wait complete. 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 msgr2=0x7fdffc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 0x7fdffc06ee80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe018008040 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 msgr2=0x7fe02015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe00800c3c0 tx=0x7fe00800c880 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 shutdown_connections 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdffc06c9c0 0x7fdffc06ee80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe02015ecc0 0x7fe02015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0200d4ff0 0x7fe02015c120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 --2- 172.21.15.67:0/2049940817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0200d2f80 0x7fe02014e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.117+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 >> 172.21.15.67:0/2049940817 conn(0x7fe020067b80 msgr2=0x7fe02015b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.118+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 shutdown_connections 2024-04-16T13:05:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.118+0000 7fe025a00640 1 -- 172.21.15.67:0/2049940817 wait complete. 2024-04-16T13:05:13.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-16T13:05:13.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-16T13:05:13.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-04-16T13:05:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.132+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7eff1806c640 con 0x7eff1806ed50 2024-04-16T13:05:13.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.133+0000 7eff14c00640 1 -- 172.21.15.67:0/3264880683 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff080586d0 con 0x7eff1806ed50 2024-04-16T13:05:13.134 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:13.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-16T13:05:13.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 msgr2=0x7efef806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 0x7efef806efb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff180ce920 tx=0x7eff04007c80 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 msgr2=0x7eff18140770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c480 tx=0x7eff0800c940 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 shutdown_connections 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efef806caf0 0x7efef806efb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff18148fb0 0x7eff180b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7eff180b5df0 0x7eff18147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 --2- 172.21.15.67:0/3264880683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1806ed50 0x7eff18140770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.139+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 >> 172.21.15.67:0/3264880683 conn(0x7eff18067b80 msgr2=0x7eff1815b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.140+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 shutdown_connections 2024-04-16T13:05:13.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:13.140+0000 7eff1f600640 1 -- 172.21.15.67:0/3264880683 wait complete. 2024-04-16T13:05:13.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-16T13:05:13.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-16T13:05:14.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-16T13:05:14.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-16T13:05:14.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-16T13:05:14.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-16T13:05:14.141 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-16T13:05:14.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-16T13:05:14.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-16T13:05:14.161 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-16T13:05:14.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.405+0000 7fd18b000640 1 Processor -- start 2024-04-16T13:05:14.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.405+0000 7fd18b000640 1 -- start start 2024-04-16T13:05:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.409+0000 7fd18b000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1841517d0 0x7fd18415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.410+0000 7fd189000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd184072480 0x7fd1840b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38104/0 (socket says 172.21.15.67:38104) 2024-04-16T13:05:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.410+0000 7fd189000640 1 -- 172.21.15.67:0/3770054309 learned_addr learned my addr 172.21.15.67:0/3770054309 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.411+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd18406efd0 con 0x7fd184072480 2024-04-16T13:05:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.411+0000 7fd183e00640 1 --2- 172.21.15.67:0/3770054309 >> v2:172.21.15.82:3300/0 conn(0x7fd1841517d0 0x7fd18415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.412+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd18406f2b0 con 0x7fd18406e880 2024-04-16T13:05:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.412+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd18406f590 con 0x7fd1841517d0 2024-04-16T13:05:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.412+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327568248 0 0) 0x7fd18406efd0 con 0x7fd184072480 2024-04-16T13:05:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.412+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd168003520 con 0x7fd184072480 2024-04-16T13:05:14.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.413+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4067491614 0 0) 0x7fd168003520 con 0x7fd184072480 2024-04-16T13:05:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.413+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 >> v2:172.21.15.82:3300/0 conn(0x7fd1841517d0 msgr2=0x7fd18415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.413+0000 7fd182a00640 1 --2- 172.21.15.67:0/3770054309 >> v2:172.21.15.82:3300/0 conn(0x7fd1841517d0 0x7fd18415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 >> v1:172.21.15.82:6789/0 conn(0x7fd18406e880 legacy=0x7fd184071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18406f870 con 0x7fd184072480 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fd17c0019d0 con 0x7fd184072480 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 >> v1:172.21.15.67:6789/0 conn(0x7fd184072480 legacy=0x7fd1840b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd168003a00 0x7fd168003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 0x7fd168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1680051c0 0x7fd16800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd18406f590 con 0x7fd168004800 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd16800c0c0 con 0x7fd1680051c0 2024-04-16T13:05:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.414+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd16800c2c0 con 0x7fd168003a00 2024-04-16T13:05:14.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.416+0000 7fd189000640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1680051c0 0x7fd16800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.416+0000 7fd183400640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 0x7fd168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.416+0000 7fd183e00640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd168003a00 0x7fd168003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.417+0000 7fd183400640 1 -- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd168003a00 msgr2=0x7fd168003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.417+0000 7fd183400640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd168003a00 0x7fd168003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.417+0000 7fd183400640 1 -- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1680051c0 msgr2=0x7fd16800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.417+0000 7fd183400640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1680051c0 0x7fd16800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.417+0000 7fd183400640 1 -- 172.21.15.67:0/3770054309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd168003520 con 0x7fd168004800 2024-04-16T13:05:14.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.419+0000 7fd189000640 1 -- 172.21.15.67:0/3770054309 reap_dead start 2024-04-16T13:05:14.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.420+0000 7fd183400640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 0x7fd168004c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd174001750 tx=0x7fd168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69044b168dabebf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.421+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174001370 con 0x7fd168004800 2024-04-16T13:05:14.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.421+0000 7fd182a00640 1 -- 172.21.15.67:0/3770054309 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1740052f0 con 0x7fd168004800 2024-04-16T13:05:14.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.422+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 msgr2=0x7fd168004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.422+0000 7fd18b000640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 0x7fd168004c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd174001750 tx=0x7fd168005830 comp rx=0 tx=0).stop 2024-04-16T13:05:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.423+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 shutdown_connections 2024-04-16T13:05:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.423+0000 7fd18b000640 1 --2- 172.21.15.67:0/3770054309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd168004800 0x7fd168004c80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.423+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 >> 172.21.15.67:0/3770054309 conn(0x7fd184067760 msgr2=0x7fd184067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.423+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 shutdown_connections 2024-04-16T13:05:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.423+0000 7fd18b000640 1 -- 172.21.15.67:0/3770054309 wait complete. 2024-04-16T13:05:14.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.427+0000 7fd18b000640 1 Processor -- start 2024-04-16T13:05:14.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.427+0000 7fd18b000640 1 -- start start 2024-04-16T13:05:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.430+0000 7fd18b000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 0x7fd1841fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.430+0000 7fd18b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 0x7fd184161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.431+0000 7fd183e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 0x7fd1841fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.431+0000 7fd183e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 0x7fd1841fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43878/0 (socket says 172.21.15.67:43878) 2024-04-16T13:05:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.431+0000 7fd183e00640 1 -- 172.21.15.67:0/3913353156 learned_addr learned my addr 172.21.15.67:0/3913353156 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.431+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 0x7fd1841f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.432+0000 7fd183400640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 0x7fd184161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.432+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd184151bb0 con 0x7fd1841610c0 2024-04-16T13:05:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.432+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd18406ecf0 con 0x7fd168004800 2024-04-16T13:05:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.432+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd18406bac0 con 0x7fd1841f8e50 2024-04-16T13:05:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.432+0000 7fd189000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 0x7fd1841f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.433+0000 7fd189000640 1 -- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 msgr2=0x7fd1841fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.433+0000 7fd189000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 0x7fd1841fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.433+0000 7fd189000640 1 -- 172.21.15.67:0/3913353156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 msgr2=0x7fd184161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.434+0000 7fd189000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 0x7fd184161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.434+0000 7fd189000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1841fc740 con 0x7fd1841f8e50 2024-04-16T13:05:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.434+0000 7fd183400640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 0x7fd184161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:14.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.435+0000 7fd189000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 0x7fd1841f92d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd18406de40 tx=0x7fd17c007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.435+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c017020 con 0x7fd1841f8e50 2024-04-16T13:05:14.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.436+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c0133f0 con 0x7fd1841f8e50 2024-04-16T13:05:14.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.436+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0137e0 con 0x7fd1841f8e50 2024-04-16T13:05:14.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.436+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1841fca20 con 0x7fd1841f8e50 2024-04-16T13:05:14.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.436+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1841fcfe0 con 0x7fd1841f8e50 2024-04-16T13:05:14.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.440+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15c005290 con 0x7fd1841f8e50 2024-04-16T13:05:14.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.441+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd17c01a020 con 0x7fd1841f8e50 2024-04-16T13:05:14.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.442+0000 7fd17be00640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 0x7fd16406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.443+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd17c08c510 con 0x7fd1841f8e50 2024-04-16T13:05:14.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.443+0000 7fd183e00640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 0x7fd16406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.445+0000 7fd183e00640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 0x7fd16406ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.452+0000 7f5aef200640 1 Processor -- start 2024-04-16T13:05:14.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.453+0000 7f5aef200640 1 -- start start 2024-04-16T13:05:14.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.455+0000 7f5aef200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 0x7f5af00d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.455+0000 7f5aef200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.455+0000 7f5aef200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00d2b10 con 0x7f5af015e7e0 2024-04-16T13:05:14.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.455+0000 7f5aef200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5af00d1a80 con 0x7f5af00d0240 2024-04-16T13:05:14.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.455+0000 7f5aef200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00d2df0 con 0x7f5af00d1620 2024-04-16T13:05:14.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.456+0000 7f5aed400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 0x7f5af00d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.456+0000 7f5aed400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 0x7f5af00d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52398/0 (socket says 172.21.15.67:52398) 2024-04-16T13:05:14.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.456+0000 7f5aed400640 1 -- 172.21.15.67:0/1214950360 learned_addr learned my addr 172.21.15.67:0/1214950360 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.456+0000 7f5aee800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.457+0000 7f5aee800640 1 -- 172.21.15.67:0/1214950360 >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 msgr2=0x7f5af00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.457+0000 7f5aee800640 1 --2- 172.21.15.67:0/1214950360 >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 0x7f5af00d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.457+0000 7f5aee800640 1 -- 172.21.15.67:0/1214950360 >> v1:172.21.15.67:6789/0 conn(0x7f5af015e7e0 legacy=0x7f5af00d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.457+0000 7f5aee800640 1 -- 172.21.15.67:0/1214950360 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00d30d0 con 0x7f5af00d1620 2024-04-16T13:05:14.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.459+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd17c021030 con 0x7fd1841f8e50 2024-04-16T13:05:14.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.459+0000 7f5aee800640 1 --2- 172.21.15.67:0/1214950360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af006d330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d90 tx=0x7f5ae802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d538932f95b83f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.460+0000 7f5aeca00640 1 -- 172.21.15.67:0/1214950360 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8039070 con 0x7f5af00d1620 2024-04-16T13:05:14.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.460+0000 7f5aeca00640 1 -- 172.21.15.67:0/1214950360 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae802cc50 con 0x7f5af00d1620 2024-04-16T13:05:14.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.460+0000 7f5aeca00640 1 -- 172.21.15.67:0/1214950360 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8034440 con 0x7f5af00d1620 2024-04-16T13:05:14.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.461+0000 7f5aef200640 1 -- 172.21.15.67:0/1214950360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 msgr2=0x7f5af006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.461+0000 7f5aef200640 1 --2- 172.21.15.67:0/1214950360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af006d330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d90 tx=0x7f5ae802bea0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7fee2c400640 1 Processor -- start 2024-04-16T13:05:14.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 -- 172.21.15.67:0/1214950360 shutdown_connections 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 --2- 172.21.15.67:0/1214950360 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af006d330 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 --2- 172.21.15.67:0/1214950360 >> v2:172.21.15.67:3300/0 conn(0x7f5af00d0240 0x7f5af00d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 -- 172.21.15.67:0/1214950360 >> 172.21.15.67:0/1214950360 conn(0x7f5af009da60 msgr2=0x7f5af008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 -- 172.21.15.67:0/1214950360 shutdown_connections 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7fee2c400640 1 -- start start 2024-04-16T13:05:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f5aef200640 1 -- 172.21.15.67:0/1214950360 wait complete. 2024-04-16T13:05:14.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.462+0000 7f2790a00640 1 Processor -- start 2024-04-16T13:05:14.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.464+0000 7fee2c400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee240d48e0 0x7fee240d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.464+0000 7fee2c400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee240d34c0 con 0x7fee240b7a80 2024-04-16T13:05:14.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.464+0000 7fee2c400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee240d37a0 con 0x7fee2415ecc0 2024-04-16T13:05:14.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.464+0000 7fee2c400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fee240d3a80 con 0x7fee240d48e0 2024-04-16T13:05:14.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fee29000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee240d48e0 0x7fee240d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.464+0000 7f5aef200640 1 Processor -- start 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f5aef200640 1 -- start start 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fee2a400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fee240b7a80 0x7fee240b7eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38132/0 (socket says 172.21.15.67:38132) 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fee2a400640 1 -- 172.21.15.67:0/1652330195 learned_addr learned my addr 172.21.15.67:0/1652330195 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fee29000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee240d48e0 0x7fee240d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52414/0 (socket says 172.21.15.67:52414) 2024-04-16T13:05:14.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fbb03e00640 1 Processor -- start 2024-04-16T13:05:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.463+0000 7f2790a00640 1 -- start start 2024-04-16T13:05:14.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f2790a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f278c0b7740 0x7f278c0b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f2790a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c0b68b0 0x7f278c0b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f2790a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c0b8f00 con 0x7f278c1633e0 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f2790a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f278c0b6d20 con 0x7f278c0b7740 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7f2790a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f278c1637c0 con 0x7f278c0b68b0 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.466+0000 7f5aef200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.465+0000 7fee29a00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fee2415ecc0 0x7fee240d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38670/0 (socket says 172.21.15.67:38670) 2024-04-16T13:05:14.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.466+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837722022 0 0) 0x7fee240d34c0 con 0x7fee240b7a80 2024-04-16T13:05:14.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f2781400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f278c0b7740 0x7f278c0b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f2789e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f278c1633e0 0x7f278c0cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38148/0 (socket says 172.21.15.67:38148) 2024-04-16T13:05:14.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f2781400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f278c0b7740 0x7f278c0b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43894/0 (socket says 172.21.15.67:43894) 2024-04-16T13:05:14.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f2781400640 1 -- 172.21.15.67:0/854164643 learned_addr learned my addr 172.21.15.67:0/854164643 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee0c003520 con 0x7fee240b7a80 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252224435 0 0) 0x7fee240d37a0 con 0x7fee2415ecc0 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f5aef200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af00ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f5aef200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af015e7e0 0x7f5af00cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f5aef200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5af015ebc0 con 0x7f5af015e7e0 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f5aef200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00d3690 con 0x7f5af00d0240 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7f5aef200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5af015ed40 con 0x7f5af00d1620 2024-04-16T13:05:14.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f5aede00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f2781400640 1 -- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c0b68b0 msgr2=0x7f278c0b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f278a800640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c0b68b0 0x7f278c0b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f2781400640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c0b68b0 0x7f278c0b9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f2781400640 1 -- 172.21.15.67:0/854164643 >> v1:172.21.15.67:6789/0 conn(0x7f278c1633e0 legacy=0x7f278c0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f2781400640 1 -- 172.21.15.67:0/854164643 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0d25f0 con 0x7f278c0b7740 2024-04-16T13:05:14.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f5aede00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43904/0 (socket says 172.21.15.67:43904) 2024-04-16T13:05:14.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7f5aede00640 1 -- 172.21.15.67:0/2070488584 learned_addr learned my addr 172.21.15.67:0/2070488584 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aed400640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af00ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.468+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee240d34c0 con 0x7fee2415ecc0 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aede00640 1 -- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 msgr2=0x7f5af00ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aede00640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af00ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aede00640 1 -- 172.21.15.67:0/2070488584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af015e7e0 msgr2=0x7f5af00cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aede00640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af015e7e0 0x7f5af00cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7f5aede00640 1 -- 172.21.15.67:0/2070488584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af016b560 con 0x7f5af00d0240 2024-04-16T13:05:14.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3648462686 0 0) 0x7fee0c003520 con 0x7fee240b7a80 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.467+0000 7fbb03e00640 1 -- start start 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb03e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbafc15e980 0x7fbafc0b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb03e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbafc0b6e50 0x7fbafc0d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb03e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbafc0d2a40 con 0x7fbafc0d2480 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb03e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc0d3650 con 0x7fbafc15e980 2024-04-16T13:05:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb03e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbafc0b7280 con 0x7fbafc0b6e50 2024-04-16T13:05:14.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7fee29000640 1 -- 172.21.15.67:0/1652330195 >> v1:172.21.15.82:6789/0 conn(0x7fee2415ecc0 legacy=0x7fee240d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7fee29000640 1 -- 172.21.15.67:0/1652330195 >> v1:172.21.15.67:6789/0 conn(0x7fee240b7a80 legacy=0x7fee240b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.469+0000 7fee29000640 1 -- 172.21.15.67:0/1652330195 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240d3d60 con 0x7fee240d48e0 2024-04-16T13:05:14.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7f5aede00640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c430 tx=0x7f5ae000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7f33c3600640 1 Processor -- start 2024-04-16T13:05:14.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb00a00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbafc0d2480 0x7fbafc0b7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:38680/0 (socket says 172.21.15.67:38680) 2024-04-16T13:05:14.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb00a00640 1 -- 172.21.15.67:0/3044986344 learned_addr learned my addr 172.21.15.67:0/3044986344 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7fbb01e00640 1 --2- 172.21.15.67:0/3044986344 >> v2:172.21.15.82:3300/0 conn(0x7fbafc0b6e50 0x7fbafc0d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.470+0000 7f33c3600640 1 -- start start 2024-04-16T13:05:14.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbb01400640 1 --2- 172.21.15.67:0/3044986344 >> v2:172.21.15.67:3300/0 conn(0x7fbafc15e980 0x7fbafc0b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00052d0 con 0x7f5af00d0240 2024-04-16T13:05:14.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0007020 con 0x7f5af00d0240 2024-04-16T13:05:14.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00054b0 con 0x7f5af00d0240 2024-04-16T13:05:14.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af015f5d0 con 0x7f5af00d0240 2024-04-16T13:05:14.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af015fb90 con 0x7f5af00d0240 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbafbe00640 1 -- 172.21.15.67:0/3044986344 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281747561 0 0) 0x7fbafc0d2a40 con 0x7fbafc0d2480 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbafbe00640 1 -- 172.21.15.67:0/3044986344 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae4003520 con 0x7fbafc0d2480 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbb01400640 1 -- 172.21.15.67:0/3044986344 >> v2:172.21.15.82:3300/0 conn(0x7fbafc0b6e50 msgr2=0x7fbafc0d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbb01400640 1 --2- 172.21.15.67:0/3044986344 >> v2:172.21.15.82:3300/0 conn(0x7fbafc0b6e50 0x7fbafc0d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbb01400640 1 -- 172.21.15.67:0/3044986344 >> v1:172.21.15.82:6789/0 conn(0x7fbafc0d2480 legacy=0x7fbafc0b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fbb01400640 1 -- 172.21.15.67:0/3044986344 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc0d2d20 con 0x7fbafc15e980 2024-04-16T13:05:14.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.471+0000 7fee29000640 1 --2- 172.21.15.67:0/1652330195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee240d4d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee180097a0 tx=0x7fee1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff45b3de756e231 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18038070 con 0x7fee240d48e0 2024-04-16T13:05:14.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee18031520 con 0x7fee240d48e0 2024-04-16T13:05:14.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7fee23e00640 1 -- 172.21.15.67:0/1652330195 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0019f0 con 0x7fee240d48e0 2024-04-16T13:05:14.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7f33c3600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f33bc0d48e0 0x7f33bc0d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7f33c3600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33bc0d34c0 con 0x7f33bc15ecc0 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7f33c3600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33bc0d37a0 con 0x7f33bc0b7a80 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.472+0000 7f33c3600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f33bc0d3a80 con 0x7f33bc0d48e0 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7fee2c400640 1 -- 172.21.15.67:0/1652330195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 msgr2=0x7fee240d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7fee2c400640 1 --2- 172.21.15.67:0/1652330195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee240d4d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee180097a0 tx=0x7fee1802b840 comp rx=0 tx=0).stop 2024-04-16T13:05:14.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f2781400640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b7740 0x7f278c0b6370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f277402b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b50d62d430461c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af0075bd0 con 0x7f5af00d0240 2024-04-16T13:05:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f33c0c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33bc15ecc0 0x7f33bc0d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38156/0 (socket says 172.21.15.67:38156) 2024-04-16T13:05:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f33c0c00640 1 -- 172.21.15.67:0/2036364773 learned_addr learned my addr 172.21.15.67:0/2036364773 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f2789400640 1 -- 172.21.15.67:0/854164643 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774037070 con 0x7f278c0b7740 2024-04-16T13:05:14.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.473+0000 7f33bbe00640 1 --2- 172.21.15.67:0/2036364773 >> v2:172.21.15.82:3300/0 conn(0x7f33bc0d48e0 0x7f33bc0d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7fee2c400640 1 -- 172.21.15.67:0/1652330195 shutdown_connections 2024-04-16T13:05:14.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7fee2c400640 1 --2- 172.21.15.67:0/1652330195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee240d4d70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f2789400640 1 -- 172.21.15.67:0/854164643 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774030710 con 0x7f278c0b7740 2024-04-16T13:05:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f2789400640 1 -- 172.21.15.67:0/854164643 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774030b20 con 0x7f278c0b7740 2024-04-16T13:05:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f33bb400640 1 -- 172.21.15.67:0/2036364773 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 311849289 0 0) 0x7f33bc0d34c0 con 0x7f33bc15ecc0 2024-04-16T13:05:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7fee2c400640 1 -- 172.21.15.67:0/1652330195 >> 172.21.15.67:0/1652330195 conn(0x7fee24067b80 msgr2=0x7fee24067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f33bb400640 1 -- 172.21.15.67:0/2036364773 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a0003520 con 0x7f33bc15ecc0 2024-04-16T13:05:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f33bbe00640 1 -- 172.21.15.67:0/2036364773 >> v1:172.21.15.82:6789/0 conn(0x7f33bc0b7a80 legacy=0x7f33bc0b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f33bbe00640 1 -- 172.21.15.67:0/2036364773 >> v1:172.21.15.67:6789/0 conn(0x7f33bc15ecc0 legacy=0x7f33bc0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7f33bbe00640 1 -- 172.21.15.67:0/2036364773 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc0d3d60 con 0x7f33bc0d48e0 2024-04-16T13:05:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.474+0000 7fee2c400640 1 -- 172.21.15.67:0/1652330195 shutdown_connections 2024-04-16T13:05:14.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7fee2c400640 1 -- 172.21.15.67:0/1652330195 wait complete. 2024-04-16T13:05:14.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 -- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b7740 msgr2=0x7f278c0b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b7740 0x7f278c0b6370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2774009870 tx=0x7f277402b6d0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7fbb01400640 1 --2- 172.21.15.67:0/3044986344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc15e980 0x7fbafc0b6910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0b4280 tx=0x7fbaf402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40477f252af9009 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f33bbe00640 1 --2- 172.21.15.67:0/2036364773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0d4d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0097a0 tx=0x7f33ac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f0b7fbbdbdb56 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ae0007410 con 0x7f5af00d0240 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7fbafbe00640 1 -- 172.21.15.67:0/3044986344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4039070 con 0x7fbafc15e980 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7fbafbe00640 1 -- 172.21.15.67:0/3044986344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf402cc70 con 0x7fbafc15e980 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7fbafbe00640 1 -- 172.21.15.67:0/3044986344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4034660 con 0x7fbafc15e980 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f33bb400640 1 -- 172.21.15.67:0/2036364773 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac034070 con 0x7f33bc0d48e0 2024-04-16T13:05:14.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f33bb400640 1 -- 172.21.15.67:0/2036364773 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac030610 con 0x7f33bc0d48e0 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f33bb400640 1 -- 172.21.15.67:0/2036364773 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0309e0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 -- 172.21.15.67:0/854164643 shutdown_connections 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c0b68b0 0x7f278c0b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 --2- 172.21.15.67:0/854164643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b7740 0x7f278c0b6370 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.476+0000 7f2790a00640 1 -- 172.21.15.67:0/854164643 >> 172.21.15.67:0/854164643 conn(0x7f278c0d1370 msgr2=0x7f278c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.477+0000 7f2790a00640 1 -- 172.21.15.67:0/854164643 shutdown_connections 2024-04-16T13:05:14.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.477+0000 7f2790a00640 1 -- 172.21.15.67:0/854164643 wait complete. 2024-04-16T13:05:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7fbb03e00640 1 -- 172.21.15.67:0/3044986344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc15e980 msgr2=0x7fbafc0b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7fbb03e00640 1 --2- 172.21.15.67:0/3044986344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc15e980 0x7fbafc0b6910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0b4280 tx=0x7fbaf402bec0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7fee2c400640 1 Processor -- start 2024-04-16T13:05:14.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f5ae6000640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 0x7f5ad006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 -- 172.21.15.67:0/2036364773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 msgr2=0x7f33bc0d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 --2- 172.21.15.67:0/2036364773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0d4d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0097a0 tx=0x7f33ac02b960 comp rx=0 tx=0).stop 2024-04-16T13:05:14.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 -- 172.21.15.67:0/2036364773 shutdown_connections 2024-04-16T13:05:14.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 --2- 172.21.15.67:0/2036364773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0d4d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 -- 172.21.15.67:0/2036364773 >> 172.21.15.67:0/2036364773 conn(0x7f33bc067b80 msgr2=0x7f33bc067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae008b2e0 con 0x7f5af00d0240 2024-04-16T13:05:14.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7f33c3600640 1 -- 172.21.15.67:0/2036364773 shutdown_connections 2024-04-16T13:05:14.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.479+0000 7f33c3600640 1 -- 172.21.15.67:0/2036364773 wait complete. 2024-04-16T13:05:14.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.479+0000 7f27b7c00640 1 Processor -- start 2024-04-16T13:05:14.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.479+0000 7f5aed400640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 0x7f5ad006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.479+0000 7f27b7c00640 1 -- start start 2024-04-16T13:05:14.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.478+0000 7fee2c400640 1 -- start start 2024-04-16T13:05:14.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 -- 172.21.15.67:0/3044986344 shutdown_connections 2024-04-16T13:05:14.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 --2- 172.21.15.67:0/3044986344 >> v2:172.21.15.82:3300/0 conn(0x7fbafc0b6e50 0x7fbafc0d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 --2- 172.21.15.67:0/3044986344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc15e980 0x7fbafc0b6910 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 -- 172.21.15.67:0/3044986344 >> 172.21.15.67:0/3044986344 conn(0x7fbafc067b80 msgr2=0x7fbafc067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee24160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 0x7fee240cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee2415f0a0 con 0x7fee240d48e0 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee240d4560 con 0x7fee2415ecc0 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fee2c400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fee240d3150 con 0x7fee240b7a80 2024-04-16T13:05:14.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7f2790a00640 1 Processor -- start 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7fee29a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7fee29a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51756/0 (socket says 172.21.15.67:51756) 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7fee29a00640 1 -- 172.21.15.67:0/2332720097 learned_addr learned my addr 172.21.15.67:0/2332720097 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7fee29000640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee24160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7fee2a400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 0x7fee240cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f2790a00640 1 -- start start 2024-04-16T13:05:14.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f27b7c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f27b00b50a0 0x7f27b00b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f27b7c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b015c290 con 0x7f27b013e880 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f27b7c00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b015c570 con 0x7f27b015bc60 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f27b7c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f27b01622d0 con 0x7f27b00b50a0 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f27b5200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f27b013e880 0x7f27b01418d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38164/0 (socket says 172.21.15.67:38164) 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7f27b5200640 1 -- 172.21.15.67:0/2616286461 learned_addr learned my addr 172.21.15.67:0/2616286461 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7f33c3600640 1 Processor -- start 2024-04-16T13:05:14.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.481+0000 7f5aed400640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 0x7f5ad006ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5af0073120 tx=0x7f5adc009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee29a00640 1 -- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 msgr2=0x7fee240cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee29a00640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 0x7fee240cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee29a00640 1 -- 172.21.15.67:0/2332720097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 msgr2=0x7fee24160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee29a00640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee24160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 -- 172.21.15.67:0/3044986344 shutdown_connections 2024-04-16T13:05:14.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.480+0000 7fbb03e00640 1 -- 172.21.15.67:0/3044986344 wait complete. 2024-04-16T13:05:14.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee29a00640 1 -- 172.21.15.67:0/2332720097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240c8a40 con 0x7fee240b7a80 2024-04-16T13:05:14.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7fee2a400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 0x7fee240cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:14.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7f27b5c00640 1 --2- 172.21.15.67:0/2616286461 >> v2:172.21.15.82:3300/0 conn(0x7f27b00b50a0 0x7f27b00b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131329261 0 0) 0x7f27b015c290 con 0x7f27b013e880 2024-04-16T13:05:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2798003520 con 0x7f27b013e880 2024-04-16T13:05:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fee29a00640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c410 tx=0x7fee1400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fbb03e00640 1 Processor -- start 2024-04-16T13:05:14.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b68b0 0x7f278c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c1633e0 0x7f278c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0b9760 con 0x7f278c0b7740 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0b9480 con 0x7f278c0b68b0 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f2790a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0d33e0 con 0x7f278c1633e0 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14017070 con 0x7fee240b7a80 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee140074e0 con 0x7fee240b7a80 2024-04-16T13:05:14.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14005a10 con 0x7fee240b7a80 2024-04-16T13:05:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602627363 0 0) 0x7f2798003520 con 0x7f27b013e880 2024-04-16T13:05:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee240c8d20 con 0x7fee240b7a80 2024-04-16T13:05:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 >> v2:172.21.15.82:3300/0 conn(0x7f27b00b50a0 msgr2=0x7f27b00b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f27af400640 1 --2- 172.21.15.67:0/2616286461 >> v2:172.21.15.82:3300/0 conn(0x7f27b00b50a0 0x7f27b00b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.482+0000 7f33c3600640 1 -- start start 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33bc0b7a80 0x7f33bc0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 0x7f33bc0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc15f0a0 con 0x7f33bc15ecc0 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc0d4560 con 0x7f33bc0d48e0 2024-04-16T13:05:14.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f33c3600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc0d3150 con 0x7f33bc0b7a80 2024-04-16T13:05:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f2781400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f2781400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52454/0 (socket says 172.21.15.67:52454) 2024-04-16T13:05:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f2781400640 1 -- 172.21.15.67:0/4278610514 learned_addr learned my addr 172.21.15.67:0/4278610514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 >> v1:172.21.15.82:6789/0 conn(0x7f27b015bc60 legacy=0x7f27b013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f278a800640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c1633e0 0x7f278c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7f2781400640 1 -- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c1633e0 msgr2=0x7f278c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f2781400640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c1633e0 0x7f278c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f2781400640 1 -- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b68b0 msgr2=0x7f278c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.483+0000 7fbb03e00640 1 -- start start 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f2781400640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b68b0 0x7f278c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f2781400640 1 -- 172.21.15.67:0/4278610514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c153530 con 0x7f278c0b7740 2024-04-16T13:05:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f33c1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 0x7f33bc0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f33c0c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33bc0b7a80 0x7f33bc0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43940/0 (socket says 172.21.15.67:43940) 2024-04-16T13:05:14.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f33bbe00640 1 -- 172.21.15.67:0/1832292057 learned_addr learned my addr 172.21.15.67:0/1832292057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b015c850 con 0x7f27b013e880 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f27a4001670 con 0x7f27b013e880 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 >> v1:172.21.15.67:6789/0 conn(0x7f27b013e880 legacy=0x7f27b01418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 0x7f2798003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f2781400640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2774000c00 tx=0x7f27740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01622d0 con 0x7f27980039b0 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f279800c060 con 0x7f2798004800 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.485+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f279800c260 con 0x7f27980051c0 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.484+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee240c9790 con 0x7fee240b7a80 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774041020 con 0x7f278c0b7740 2024-04-16T13:05:14.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27740329d0 con 0x7f278c0b7740 2024-04-16T13:05:14.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 0x7f2798003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774037040 con 0x7f278c0b7740 2024-04-16T13:05:14.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c153810 con 0x7f278c0b7740 2024-04-16T13:05:14.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5c00640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27afe00640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 -- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27980051c0 msgr2=0x7f279800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f33bbe00640 1 -- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33bc0b7a80 msgr2=0x7f33bc0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c153dd0 con 0x7f278c0b7740 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 -- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798004800 msgr2=0x7f2798004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.486+0000 7f27b5200640 1 -- 172.21.15.67:0/2616286461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b015c850 con 0x7f27980039b0 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f33bbe00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33bc0b7a80 0x7f33bc0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f33bbe00640 1 -- 172.21.15.67:0/1832292057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 msgr2=0x7f33bc0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f27b5c00640 1 -- 172.21.15.67:0/2616286461 reap_dead start 2024-04-16T13:05:14.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f33bbe00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 0x7f33bc0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f33bbe00640 1 -- 172.21.15.67:0/1832292057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc1f83c0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7fbb03e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0b6e50 0x7fbafc15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7f33c1600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 0x7f33bc0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:14.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.487+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee24068a70 con 0x7fee240b7a80 2024-04-16T13:05:14.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7fbb03e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7fbb03e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbafc15e980 0x7fbafc160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7f33bbe00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f33ac02bf70 tx=0x7f33ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7fbb03e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc0d55d0 con 0x7fbafc0b6e50 2024-04-16T13:05:14.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7fbb03e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc0d32e0 con 0x7fbafc0d2480 2024-04-16T13:05:14.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7fbb03e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbafc15ed60 con 0x7fbafc15e980 2024-04-16T13:05:14.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.488+0000 7f27b5200640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 0x7f2798003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001050 tx=0x7f2798005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6ee42500cda402 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7fbb00a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7fbb00a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43958/0 (socket says 172.21.15.67:43958) 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7fbb00a00640 1 -- 172.21.15.67:0/437048258 learned_addr learned my addr 172.21.15.67:0/437048258 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7fbb01e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbafc15e980 0x7fbafc160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4007d10 con 0x7f27980039b0 2024-04-16T13:05:14.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a4030070 con 0x7f27980039b0 2024-04-16T13:05:14.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7fbb01400640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0b6e50 0x7fbafc15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764005290 con 0x7f278c0b7740 2024-04-16T13:05:14.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.489+0000 7f27af400640 1 -- 172.21.15.67:0/2616286461 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4005d90 con 0x7f27980039b0 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 -- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbafc15e980 msgr2=0x7fbafc160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbafc15e980 0x7fbafc160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 -- 172.21.15.67:0/437048258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0b6e50 msgr2=0x7fbafc15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0b6e50 0x7fbafc15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 -- 172.21.15.67:0/437048258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc0ce680 con 0x7fbafc0d2480 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f27b7c00640 1 -- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 msgr2=0x7f2798003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f27b7c00640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 0x7f2798003dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001050 tx=0x7f2798005830 comp rx=0 tx=0).stop 2024-04-16T13:05:14.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2774044020 con 0x7f278c0b7740 2024-04-16T13:05:14.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7fbb00a00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c3c0 tx=0x7fbaf000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f27b7c00640 1 -- 172.21.15.67:0/2616286461 shutdown_connections 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f27b7c00640 1 --2- 172.21.15.67:0/2616286461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980039b0 0x7f2798003dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.490+0000 7f27b7c00640 1 -- 172.21.15.67:0/2616286461 >> 172.21.15.67:0/2616286461 conn(0x7f27b0067d90 msgr2=0x7f27b006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.491+0000 7f27b7c00640 1 -- 172.21.15.67:0/2616286461 shutdown_connections 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.491+0000 7f27b7c00640 1 -- 172.21.15.67:0/2616286461 wait complete. 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.491+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee1401a070 con 0x7fee240b7a80 2024-04-16T13:05:14.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.492+0000 7f27b7c00640 1 Processor -- start 2024-04-16T13:05:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.493+0000 7f2782a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 0x7f276806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.493+0000 7f27b7c00640 1 -- start start 2024-04-16T13:05:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.492+0000 7fee21600640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 0x7fee0806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.492+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fee1408b1c0 con 0x7fee240b7a80 2024-04-16T13:05:14.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.493+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f27740ada40 con 0x7f278c0b7740 2024-04-16T13:05:14.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.493+0000 7fee29000640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 0x7fee0806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.493+0000 7f2789e00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 0x7f276806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 0x7f27b0154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 0x7f27b01351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0141a50 con 0x7f27b0158ad0 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01418d0 con 0x7f27980039b0 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27b7c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f27b0141bd0 con 0x7f27b0158f50 2024-04-16T13:05:14.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52490/0 (socket says 172.21.15.67:52490) 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.494+0000 7f27afe00640 1 -- 172.21.15.67:0/635627129 learned_addr learned my addr 172.21.15.67:0/635627129 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27b5200640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 0x7f27b0154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27b5c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 0x7f27b01351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f2789e00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 0x7f276806ee00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f277c007fd0 tx=0x7f277c0079a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7fee29000640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 0x7fee0806eeb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee18035000 tx=0x7fee18030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27afe00640 1 -- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 msgr2=0x7f27b01351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27afe00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 0x7f27b01351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27afe00640 1 -- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 msgr2=0x7f27b0154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27afe00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 0x7f27b0154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27afe00640 1 -- 172.21.15.67:0/635627129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b0155180 con 0x7f27b0158ad0 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27b5200640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 0x7f27b0154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:14.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f27b5c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 0x7f27b01351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:14.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac034040 con 0x7f33bc0d48e0 2024-04-16T13:05:14.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0017070 con 0x7fbafc0d2480 2024-04-16T13:05:14.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc1f8680 con 0x7f33bc0d48e0 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac039990 con 0x7f33bc0d48e0 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc1f8c40 con 0x7f33bc0d48e0 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.495+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc0cd5e0 con 0x7fbafc0d2480 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc0cdba0 con 0x7fbafc0d2480 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf0005ce0 con 0x7fbafc0d2480 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00072d0 con 0x7fbafc0d2480 2024-04-16T13:05:14.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.496+0000 7f27afe00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f279c00e4b0 tx=0x7f279c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5af016b560 con 0x7f5af00d0240 2024-04-16T13:05:14.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0052e0 con 0x7f27b0158ad0 2024-04-16T13:05:14.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c018070 con 0x7f27b0158ad0 2024-04-16T13:05:14.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c003810 con 0x7f27b0158ad0 2024-04-16T13:05:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac039da0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc0d2500 con 0x7f33bc0d48e0 2024-04-16T13:05:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b0143ef0 con 0x7f27b0158ad0 2024-04-16T13:05:14.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.497+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b01444b0 con 0x7f27b0158ad0 2024-04-16T13:05:14.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.498+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad8005290 con 0x7fbafc0d2480 2024-04-16T13:05:14.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.500+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c005290 con 0x7f27b0158ad0 2024-04-16T13:05:14.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.500+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f277404b030 con 0x7f278c0b7740 2024-04-16T13:05:14.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.500+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33ac037070 con 0x7f33bc0d48e0 2024-04-16T13:05:14.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.501+0000 7f33b8c00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 0x7f339c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.501+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaf001a070 con 0x7fbafc0d2480 2024-04-16T13:05:14.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.501+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f33ac0adfc0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.502+0000 7fbaf9600640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 0x7fbadc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.502+0000 7f33c0c00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 0x7f339c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.502+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbaf008b680 con 0x7fbafc0d2480 2024-04-16T13:05:14.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.503+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f279c0039b0 con 0x7f27b0158ad0 2024-04-16T13:05:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.504+0000 7fbb01400640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 0x7fbadc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.504+0000 7f33c0c00640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 0x7f339c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001560 tx=0x7f33b40019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.504+0000 7f27acc00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 0x7f279006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.504+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f279c08bae0 con 0x7f27b0158ad0 2024-04-16T13:05:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.505+0000 7f27b5200640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 0x7f279006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.505+0000 7fbb01400640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 0x7fbadc06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4036000 tx=0x7fbaf4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.506+0000 7f27b5200640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 0x7f279006ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27a4034000 tx=0x7f27a4009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.509+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee14058d00 con 0x7fee240b7a80 2024-04-16T13:05:14.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.513+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33bc0d2500 con 0x7f33bc0d48e0 2024-04-16T13:05:14.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.515+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f279c059bb0 con 0x7f27b0158ad0 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.522+0000 7f64b8a00640 1 Processor -- start 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.522+0000 7f64b8a00640 1 -- start start 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.524+0000 7f64b8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 0x7f64b40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.524+0000 7f64b8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40d2b10 con 0x7f64b40d22c0 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.524+0000 7f64b8a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40d2df0 con 0x7f64b40d17f0 2024-04-16T13:05:14.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.524+0000 7f64b8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f64b40d30d0 con 0x7f64b415e7e0 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.525+0000 7f64b2a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f64b40d22c0 0x7f64b40d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38170/0 (socket says 172.21.15.67:38170) 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.525+0000 7f64b2a00640 1 -- 172.21.15.67:0/1880819144 learned_addr learned my addr 172.21.15.67:0/1880819144 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.525+0000 7f64b3400640 1 --2- 172.21.15.67:0/1880819144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 0x7f64b40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.526+0000 7f64b3400640 1 -- 172.21.15.67:0/1880819144 >> v1:172.21.15.82:6789/0 conn(0x7f64b40d17f0 legacy=0x7f64b406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.526+0000 7f64b3400640 1 -- 172.21.15.67:0/1880819144 >> v1:172.21.15.67:6789/0 conn(0x7f64b40d22c0 legacy=0x7f64b40d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.526+0000 7f64b3400640 1 -- 172.21.15.67:0/1880819144 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40d33b0 con 0x7f64b415e7e0 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.528+0000 7f64b3400640 1 --2- 172.21.15.67:0/1880819144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 0x7f64b40d0240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f64a40097c0 tx=0x7f64a402b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e0e548bc586550 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.528+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbaf0059080 con 0x7fbafc0d2480 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.528+0000 7f64b2000640 1 -- 172.21.15.67:0/1880819144 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4035020 con 0x7f64b415e7e0 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.528+0000 7f64b2000640 1 -- 172.21.15.67:0/1880819144 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a4031880 con 0x7f64b415e7e0 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.528+0000 7f64b2000640 1 -- 172.21.15.67:0/1880819144 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4031c50 con 0x7f64b415e7e0 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.529+0000 7f64b8a00640 1 -- 172.21.15.67:0/1880819144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 msgr2=0x7f64b40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.529+0000 7f64b8a00640 1 --2- 172.21.15.67:0/1880819144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 0x7f64b40d0240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f64a40097c0 tx=0x7f64a402b920 comp rx=0 tx=0).stop 2024-04-16T13:05:14.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.530+0000 7f64b8a00640 1 -- 172.21.15.67:0/1880819144 shutdown_connections 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.530+0000 7f64b8a00640 1 --2- 172.21.15.67:0/1880819144 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b415e7e0 0x7f64b40d0240 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.530+0000 7f64b8a00640 1 -- 172.21.15.67:0/1880819144 >> 172.21.15.67:0/1880819144 conn(0x7f64b409da60 msgr2=0x7f64b408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.530+0000 7f64b8a00640 1 -- 172.21.15.67:0/1880819144 shutdown_connections 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.530+0000 7f64b8a00640 1 -- 172.21.15.67:0/1880819144 wait complete. 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.533+0000 7f64b8a00640 1 Processor -- start 2024-04-16T13:05:14.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.533+0000 7f64b8a00640 1 -- start start 2024-04-16T13:05:14.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.536+0000 7f64b8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.536+0000 7f64b8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.536+0000 7f64b3400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.536+0000 7f64b8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 0x7f64b40ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.537+0000 7f64b3400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51826/0 (socket says 172.21.15.67:51826) 2024-04-16T13:05:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.537+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.537+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52496/0 (socket says 172.21.15.67:52496) 2024-04-16T13:05:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.537+0000 7f64b2a00640 1 -- 172.21.15.67:0/3204601161 learned_addr learned my addr 172.21.15.67:0/3204601161 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:14.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.538+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40d28a0 con 0x7f64b40d22c0 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.538+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40d2720 con 0x7f64b415e7e0 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.538+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f64b415ebc0 con 0x7f64b40d17f0 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.538+0000 7f64b2a00640 1 -- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 msgr2=0x7f64b406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.537+0000 7f64b3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 0x7f64b40ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b2a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b2a00640 1 -- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 msgr2=0x7f64b40ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b2a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 0x7f64b40ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b2a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b415eef0 con 0x7f64b40d22c0 2024-04-16T13:05:14.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b2a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c4a0 tx=0x7f64a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.539+0000 7f64b3e00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 0x7f64b40ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:14.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.540+0000 7f64b3400640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-16T13:05:14.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.540+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0017070 con 0x7f64b40d22c0 2024-04-16T13:05:14.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.540+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b41f7bd0 con 0x7f64b40d22c0 2024-04-16T13:05:14.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.541+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b41f8190 con 0x7f64b40d22c0 2024-04-16T13:05:14.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.541+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a0005ce0 con 0x7f64b40d22c0 2024-04-16T13:05:14.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.541+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0007270 con 0x7f64b40d22c0 2024-04-16T13:05:14.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.543+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4075bd0 con 0x7f64b40d22c0 2024-04-16T13:05:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.546+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64a001a070 con 0x7f64b40d22c0 2024-04-16T13:05:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.550+0000 7f64ab400640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 0x7f649406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.551+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f64a008b1a0 con 0x7f64b40d22c0 2024-04-16T13:05:14.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.551+0000 7f64b3400640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 0x7f649406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:14.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.556+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64a0058ba0 con 0x7f64b40d22c0 2024-04-16T13:05:14.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.556+0000 7f64b3400640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 0x7f649406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a4036000 tx=0x7f64a4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:14.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.901+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd15c005580 con 0x7fd1841f8e50 2024-04-16T13:05:14.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.903+0000 7fd17be00640 1 -- 172.21.15.67:0/3913353156 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd17c05a670 con 0x7fd1841f8e50 2024-04-16T13:05:14.906 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:14.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.906+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 msgr2=0x7fd16406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.906+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 0x7fd16406ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170008040 comp rx=0 tx=0).stop 2024-04-16T13:05:14.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.906+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 msgr2=0x7fd1841f92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.907+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 0x7fd1841f92d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd18406de40 tx=0x7fd17c007d00 comp rx=0 tx=0).stop 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.907+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 shutdown_connections 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.907+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd16406c9c0 0x7fd16406ee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.907+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd1841f8e50 0x7fd1841f92d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.907+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1841610c0 0x7fd184161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.908+0000 7fd18b000640 1 --2- 172.21.15.67:0/3913353156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd168004800 0x7fd1841fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.908+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 >> 172.21.15.67:0/3913353156 conn(0x7fd184067760 msgr2=0x7fd1840b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.908+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 shutdown_connections 2024-04-16T13:05:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.909+0000 7fd18b000640 1 -- 172.21.15.67:0/3913353156 wait complete. 2024-04-16T13:05:14.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-16T13:05:14.938 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.941+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5af008c380 con 0x7f5af00d0240 2024-04-16T13:05:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.941+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2764005580 con 0x7f278c0b7740 2024-04-16T13:05:14.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.942+0000 7f2782a00640 1 -- 172.21.15.67:0/4278610514 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f277407bba0 con 0x7f278c0b7740 2024-04-16T13:05:14.943 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:14.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.942+0000 7f5ae6000640 1 -- 172.21.15.67:0/2070488584 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ae0058d60 con 0x7f5af00d0240 2024-04-16T13:05:14.944 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:14.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 msgr2=0x7f5ad006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 0x7f5ad006ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5af0073120 tx=0x7f5adc009240 comp rx=0 tx=0).stop 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 msgr2=0x7f276806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 0x7f276806ee00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f277c007fd0 tx=0x7f277c0079a0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 msgr2=0x7f278c1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.945+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2774000c00 tx=0x7f27740046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 msgr2=0x7f5af015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c430 tx=0x7f5ae000c8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 shutdown_connections 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f276806c940 0x7f276806ee00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f278c1633e0 0x7f278c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f278c0b7740 0x7f278c1505f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 --2- 172.21.15.67:0/4278610514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f278c0b68b0 0x7f278c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 >> 172.21.15.67:0/4278610514 conn(0x7f278c0d1370 msgr2=0x7f278c0c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 shutdown_connections 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ad006c9c0 0x7f5ad006ee80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5af015e7e0 0x7f5af00cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5af00d1620 0x7f5af00ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 --2- 172.21.15.67:0/2070488584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af00d0240 0x7f5af015ef40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.946+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 >> 172.21.15.67:0/2070488584 conn(0x7f5af009da60 msgr2=0x7f5af0152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.947+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 shutdown_connections 2024-04-16T13:05:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.947+0000 7f2790a00640 1 -- 172.21.15.67:0/4278610514 wait complete. 2024-04-16T13:05:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.947+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 shutdown_connections 2024-04-16T13:05:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.947+0000 7f5aef200640 1 -- 172.21.15.67:0/2070488584 wait complete. 2024-04-16T13:05:14.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.960+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fee24153650 con 0x7fee240b7a80 2024-04-16T13:05:14.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.961+0000 7fee21600640 1 -- 172.21.15.67:0/2332720097 <== mon.2 v2:172.21.15.82:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee1405d000 con 0x7fee240b7a80 2024-04-16T13:05:14.962 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.964+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 msgr2=0x7fee0806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.964+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 0x7fee0806eeb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee18035000 tx=0x7fee18030000 comp rx=0 tx=0).stop 2024-04-16T13:05:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 msgr2=0x7fee240c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c410 tx=0x7fee1400c8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 shutdown_connections 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fee0806c9f0 0x7fee0806eeb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee2415ecc0 0x7fee240cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee240d48e0 0x7fee24160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 --2- 172.21.15.67:0/2332720097 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fee240b7a80 0x7fee240c82d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 >> 172.21.15.67:0/2332720097 conn(0x7fee24067b80 msgr2=0x7fee2415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 shutdown_connections 2024-04-16T13:05:14.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.965+0000 7fee2c400640 1 -- 172.21.15.67:0/2332720097 wait complete. 2024-04-16T13:05:14.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.968+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f33bc1596a0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.969+0000 7f33b8c00640 1 -- 172.21.15.67:0/1832292057 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33bc1596a0 con 0x7f33bc0d48e0 2024-04-16T13:05:14.970 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:14.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f278c005580 con 0x7f27b0158ad0 2024-04-16T13:05:14.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 msgr2=0x7f339c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 0x7f339c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001560 tx=0x7f33b40019f0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 msgr2=0x7f33bc0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f33ac02bf70 tx=0x7f33ac0046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 shutdown_connections 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f339c06c8f0 0x7f339c06edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33bc15ecc0 0x7f33bc0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33bc0d48e0 0x7f33bc0cdb60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 --2- 172.21.15.67:0/1832292057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33bc0b7a80 0x7f33bc0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 >> 172.21.15.67:0/1832292057 conn(0x7f33bc067b80 msgr2=0x7f33bc1587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.972+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 shutdown_connections 2024-04-16T13:05:14.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.973+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbad8005850 con 0x7fbafc0d2480 2024-04-16T13:05:14.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.973+0000 7f33c3600640 1 -- 172.21.15.67:0/1832292057 wait complete. 2024-04-16T13:05:14.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-16T13:05:14.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.973+0000 7fbaf9600640 1 -- 172.21.15.67:0/437048258 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbaf005d380 con 0x7fbafc0d2480 2024-04-16T13:05:14.979 INFO:teuthology.orchestra.run.smithi067.stdout:55834574858 2024-04-16T13:05:14.979 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:14.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.973+0000 7f27acc00640 1 -- 172.21.15.67:0/635627129 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f279c0594b0 con 0x7f27b0158ad0 2024-04-16T13:05:14.980 INFO:teuthology.orchestra.run.smithi067.stdout:55834574857 2024-04-16T13:05:14.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-16T13:05:14.981 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 msgr2=0x7fbadc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 0x7fbadc06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4036000 tx=0x7fbaf4030000 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 msgr2=0x7fbafc0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000c3c0 tx=0x7fbaf000c880 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 shutdown_connections 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbadc06c8f0 0x7fbadc06edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbafc15e980 0x7fbafc160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbafc0d2480 0x7fbafc0ccb20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 --2- 172.21.15.67:0/437048258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbafc0b6e50 0x7fbafc15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 >> 172.21.15.67:0/437048258 conn(0x7fbafc067b80 msgr2=0x7fbafc0b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.976+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 shutdown_connections 2024-04-16T13:05:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7fbb03e00640 1 -- 172.21.15.67:0/437048258 wait complete. 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 msgr2=0x7f279006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 0x7f279006ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f27a4034000 tx=0x7f27a4009030 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 msgr2=0x7f27b0134ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f279c00e4b0 tx=0x7f279c00e970 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 shutdown_connections 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.977+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f279006c9c0 0x7f279006ee80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27b0158f50 0x7f27b01351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27b0158ad0 0x7f27b0134ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 --2- 172.21.15.67:0/635627129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27980039b0 0x7f27b0154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 >> 172.21.15.67:0/635627129 conn(0x7f27b0067d90 msgr2=0x7f27b0072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 shutdown_connections 2024-04-16T13:05:14.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.978+0000 7f27b7c00640 1 -- 172.21.15.67:0/635627129 wait complete. 2024-04-16T13:05:14.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.982+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f64b40d10f0 con 0x7f64b40d22c0 2024-04-16T13:05:14.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.983+0000 7f64ab400640 1 -- 172.21.15.67:0/3204601161 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64a005cea0 con 0x7f64b40d22c0 2024-04-16T13:05:14.984 INFO:teuthology.orchestra.run.smithi067.stdout:55834574859 2024-04-16T13:05:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 msgr2=0x7f649406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 0x7f649406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f64a4036000 tx=0x7f64a4008030 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 msgr2=0x7f64b40ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c4a0 tx=0x7f64a000c960 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 shutdown_connections 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f649406c8f0 0x7f649406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64b415e7e0 0x7f64b40ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b40d22c0 0x7f64b40ca3c0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c4a0 tx=0x7f64a000c960 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 --2- 172.21.15.67:0/3204601161 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64b40d17f0 0x7f64b406e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.985+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 >> 172.21.15.67:0/3204601161 conn(0x7f64b409da60 msgr2=0x7f64b40b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.986+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 shutdown_connections 2024-04-16T13:05:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:14.986+0000 7f64b8a00640 1 -- 172.21.15.67:0/3204601161 wait complete. 2024-04-16T13:05:14.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-16T13:05:14.991 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:14.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-16T13:05:14.999 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:15.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-16T13:05:15.004 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:15.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-16T13:05:15.005 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:15.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-16T13:05:15.005 DEBUG:teuthology.parallel:result is None 2024-04-16T13:05:15.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T13:05:15.006 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:05:15.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.257+0000 7f7a92a00640 1 Processor -- start 2024-04-16T13:05:15.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.257+0000 7f7a92a00640 1 -- start start 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.258+0000 7f7a92a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7a8c15b3a0 0x7f7a8c15f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.258+0000 7f7a92a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.258+0000 7f7a92a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8c15ff30 con 0x7f7a8c0cd280 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.258+0000 7f7a92a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c15f970 con 0x7f7a8c15bb60 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.258+0000 7f7a92a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c15fc50 con 0x7f7a8c15b3a0 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52498/0 (socket says 172.21.15.67:52498) 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 -- 172.21.15.67:0/1177357568 learned_addr learned my addr 172.21.15.67:0/1177357568 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a91600640 1 --2- 172.21.15.67:0/1177357568 >> v2:172.21.15.82:3300/0 conn(0x7f7a8c15b3a0 0x7f7a8c15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 -- 172.21.15.67:0/1177357568 >> v2:172.21.15.82:3300/0 conn(0x7f7a8c15b3a0 msgr2=0x7f7a8c15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 --2- 172.21.15.67:0/1177357568 >> v2:172.21.15.82:3300/0 conn(0x7f7a8c15b3a0 0x7f7a8c15f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 -- 172.21.15.67:0/1177357568 >> v1:172.21.15.82:6789/0 conn(0x7f7a8c0cd280 legacy=0x7f7a8c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.259+0000 7f7a90c00640 1 -- 172.21.15.67:0/1177357568 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0cc540 con 0x7f7a8c15bb60 2024-04-16T13:05:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.260+0000 7f7a90c00640 1 --2- 172.21.15.67:0/1177357568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cdc50 tx=0x7f7a7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d770566ec40abe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.260+0000 7f7a8be00640 1 -- 172.21.15.67:0/1177357568 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7802e070 con 0x7f7a8c15bb60 2024-04-16T13:05:15.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.260+0000 7f7a8be00640 1 -- 172.21.15.67:0/1177357568 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78037070 con 0x7f7a8c15bb60 2024-04-16T13:05:15.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.260+0000 7f7a8be00640 1 -- 172.21.15.67:0/1177357568 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78031a00 con 0x7f7a8c15bb60 2024-04-16T13:05:15.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 -- 172.21.15.67:0/1177357568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c15bb60 msgr2=0x7f7a8c0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 --2- 172.21.15.67:0/1177357568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cdc50 tx=0x7f7a7802b880 comp rx=0 tx=0).stop 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 -- 172.21.15.67:0/1177357568 shutdown_connections 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 --2- 172.21.15.67:0/1177357568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c0ccd40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 --2- 172.21.15.67:0/1177357568 >> v2:172.21.15.82:3300/0 conn(0x7f7a8c15b3a0 0x7f7a8c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 -- 172.21.15.67:0/1177357568 >> 172.21.15.67:0/1177357568 conn(0x7f7a8c0b2070 msgr2=0x7f7a8c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 -- 172.21.15.67:0/1177357568 shutdown_connections 2024-04-16T13:05:15.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.261+0000 7f7a92a00640 1 -- 172.21.15.67:0/1177357568 wait complete. 2024-04-16T13:05:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.263+0000 7f7a92a00640 1 Processor -- start 2024-04-16T13:05:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.263+0000 7f7a92a00640 1 -- start start 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a8c15b3a0 0x7f7a8c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c15f6c0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c15f540 con 0x7f7a8c15bb60 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a92a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c0cafa0 con 0x7f7a8c15b3a0 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a91600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a91600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52506/0 (socket says 172.21.15.67:52506) 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.264+0000 7f7a91600640 1 -- 172.21.15.67:0/4286785602 learned_addr learned my addr 172.21.15.67:0/4286785602 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 -- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a8c15b3a0 msgr2=0x7f7a8c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a8c15b3a0 0x7f7a8c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 -- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8c15bb60 msgr2=0x7f7a8c15a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a92000640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 -- 172.21.15.67:0/4286785602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c1f40f0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a91600640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c7f0 tx=0x7f7a8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80015070 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a80004240 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80007620 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c15e6a0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.265+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c1f43b0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.266+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c075bd0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.267+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a800079d0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.269+0000 7f7a89600640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 0x7f7a6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.269+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7a8008c2b0 con 0x7f7a8c0cd280 2024-04-16T13:05:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.269+0000 7f7a90c00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 0x7f7a6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.270+0000 7f7a90c00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 0x7f7a6c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a78036000 tx=0x7f7a78030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.273+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a8005a390 con 0x7f7a8c0cd280 2024-04-16T13:05:15.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.472+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a8c0b50d0 con 0x7f7a6c06c8f0 2024-04-16T13:05:15.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.497+0000 7f7a89600640 1 -- 172.21.15.67:0/4286785602 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f7a8c0b50d0 con 0x7f7a6c06c8f0 2024-04-16T13:05:15.503 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:15.504 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:05:15.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 msgr2=0x7f7a6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 0x7f7a6c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a78036000 tx=0x7f7a78030000 comp rx=0 tx=0).stop 2024-04-16T13:05:15.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 msgr2=0x7f7a8c1f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c7f0 tx=0x7f7a8000ccb0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 shutdown_connections 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7a6c06c8f0 0x7f7a6c06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a8c15bb60 0x7f7a8c15a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7a8c15b3a0 0x7f7a8c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 --2- 172.21.15.67:0/4286785602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a8c0cd280 0x7f7a8c1f4bb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 >> 172.21.15.67:0/4286785602 conn(0x7f7a8c0b2070 msgr2=0x7f7a8c0b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 shutdown_connections 2024-04-16T13:05:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.504+0000 7f7a92a00640 1 -- 172.21.15.67:0/4286785602 wait complete. 2024-04-16T13:05:15.523 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-16T13:05:14.499998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005546"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.138090+0000","last_change":"2024-04-16T13:04:45.017212+0000","last_active":"2024-04-16T13:04:53.138090+0000","last_peered":"2024-04-16T13:04:53.138090+0000","last_clean":"2024-04-16T13:04:53.138090+0000","last_became_active":"2024-04-16T13:04:45.016908+0000","last_became_peered":"2024-04-16T13:04:45.016908+0000","last_unstale":"2024-04-16T13:04:53.138090+0000","last_undegraded":"2024-04-16T13:04:53.138090+0000","last_fullsized":"2024-04-16T13:04:53.138090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:53:15.736911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141192+0000","last_change":"2024-04-16T13:04:46.029051+0000","last_active":"2024-04-16T13:04:52.141192+0000","last_peered":"2024-04-16T13:04:52.141192+0000","last_clean":"2024-04-16T13:04:52.141192+0000","last_became_active":"2024-04-16T13:04:46.028414+0000","last_became_peered":"2024-04-16T13:04:46.028414+0000","last_unstale":"2024-04-16T13:04:52.141192+0000","last_undegraded":"2024-04-16T13:04:52.141192+0000","last_fullsized":"2024-04-16T13:04:52.141192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140594+0000","last_change":"2024-04-16T13:04:50.716406+0000","last_active":"2024-04-16T13:04:52.140594+0000","last_peered":"2024-04-16T13:04:52.140594+0000","last_clean":"2024-04-16T13:04:52.140594+0000","last_became_active":"2024-04-16T13:04:50.715298+0000","last_became_peered":"2024-04-16T13:04:50.715298+0000","last_unstale":"2024-04-16T13:04:52.140594+0000","last_undegraded":"2024-04-16T13:04:52.140594+0000","last_fullsized":"2024-04-16T13:04:52.140594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:35.233459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141394+0000","last_change":"2024-04-16T13:04:45.011371+0000","last_active":"2024-04-16T13:04:52.141394+0000","last_peered":"2024-04-16T13:04:52.141394+0000","last_clean":"2024-04-16T13:04:52.141394+0000","last_became_active":"2024-04-16T13:04:45.010921+0000","last_became_peered":"2024-04-16T13:04:45.010921+0000","last_unstale":"2024-04-16T13:04:52.141394+0000","last_undegraded":"2024-04-16T13:04:52.141394+0000","last_fullsized":"2024-04-16T13:04:52.141394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137685+0000","last_change":"2024-04-16T13:04:46.010566+0000","last_active":"2024-04-16T13:04:53.137685+0000","last_peered":"2024-04-16T13:04:53.137685+0000","last_clean":"2024-04-16T13:04:53.137685+0000","last_became_active":"2024-04-16T13:04:46.010271+0000","last_became_peered":"2024-04-16T13:04:46.010271+0000","last_unstale":"2024-04-16T13:04:53.137685+0000","last_undegraded":"2024-04-16T13:04:53.137685+0000","last_fullsized":"2024-04-16T13:04:53.137685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141893+0000","last_change":"2024-04-16T13:04:50.172684+0000","last_active":"2024-04-16T13:04:52.141893+0000","last_peered":"2024-04-16T13:04:52.141893+0000","last_clean":"2024-04-16T13:04:52.141893+0000","last_became_active":"2024-04-16T13:04:50.171569+0000","last_became_peered":"2024-04-16T13:04:50.171569+0000","last_unstale":"2024-04-16T13:04:52.141893+0000","last_undegraded":"2024-04-16T13:04:52.141893+0000","last_fullsized":"2024-04-16T13:04:52.141893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525149+0000","last_change":"2024-04-16T13:04:45.024578+0000","last_active":"2024-04-16T13:04:53.525149+0000","last_peered":"2024-04-16T13:04:53.525149+0000","last_clean":"2024-04-16T13:04:53.525149+0000","last_became_active":"2024-04-16T13:04:45.024333+0000","last_became_peered":"2024-04-16T13:04:45.024333+0000","last_unstale":"2024-04-16T13:04:53.525149+0000","last_undegraded":"2024-04-16T13:04:53.525149+0000","last_fullsized":"2024-04-16T13:04:53.525149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129517+0000","last_change":"2024-04-16T13:04:46.009310+0000","last_active":"2024-04-16T13:04:53.129517+0000","last_peered":"2024-04-16T13:04:53.129517+0000","last_clean":"2024-04-16T13:04:53.129517+0000","last_became_active":"2024-04-16T13:04:46.008657+0000","last_became_peered":"2024-04-16T13:04:46.008657+0000","last_unstale":"2024-04-16T13:04:53.129517+0000","last_undegraded":"2024-04-16T13:04:53.129517+0000","last_fullsized":"2024-04-16T13:04:53.129517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143101+0000","last_change":"2024-04-16T13:04:50.166861+0000","last_active":"2024-04-16T13:04:52.143101+0000","last_peered":"2024-04-16T13:04:52.143101+0000","last_clean":"2024-04-16T13:04:52.143101+0000","last_became_active":"2024-04-16T13:04:50.166201+0000","last_became_peered":"2024-04-16T13:04:50.166201+0000","last_unstale":"2024-04-16T13:04:52.143101+0000","last_undegraded":"2024-04-16T13:04:52.143101+0000","last_fullsized":"2024-04-16T13:04:52.143101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526586+0000","last_change":"2024-04-16T13:04:45.022779+0000","last_active":"2024-04-16T13:04:53.526586+0000","last_peered":"2024-04-16T13:04:53.526586+0000","last_clean":"2024-04-16T13:04:53.526586+0000","last_became_active":"2024-04-16T13:04:45.022445+0000","last_became_peered":"2024-04-16T13:04:45.022445+0000","last_unstale":"2024-04-16T13:04:53.526586+0000","last_undegraded":"2024-04-16T13:04:53.526586+0000","last_fullsized":"2024-04-16T13:04:53.526586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:35.238732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129942+0000","last_change":"2024-04-16T13:04:46.008470+0000","last_active":"2024-04-16T13:04:53.129942+0000","last_peered":"2024-04-16T13:04:53.129942+0000","last_clean":"2024-04-16T13:04:53.129942+0000","last_became_active":"2024-04-16T13:04:46.007901+0000","last_became_peered":"2024-04-16T13:04:46.007901+0000","last_unstale":"2024-04-16T13:04:53.129942+0000","last_undegraded":"2024-04-16T13:04:53.129942+0000","last_fullsized":"2024-04-16T13:04:53.129942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142378+0000","last_change":"2024-04-16T13:04:50.163286+0000","last_active":"2024-04-16T13:04:52.142378+0000","last_peered":"2024-04-16T13:04:52.142378+0000","last_clean":"2024-04-16T13:04:52.142378+0000","last_became_active":"2024-04-16T13:04:50.161658+0000","last_became_peered":"2024-04-16T13:04:50.161658+0000","last_unstale":"2024-04-16T13:04:52.142378+0000","last_undegraded":"2024-04-16T13:04:52.142378+0000","last_fullsized":"2024-04-16T13:04:52.142378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015548+0000","last_change":"2024-04-16T13:04:46.014646+0000","last_active":"2024-04-16T13:04:53.015548+0000","last_peered":"2024-04-16T13:04:53.015548+0000","last_clean":"2024-04-16T13:04:53.015548+0000","last_became_active":"2024-04-16T13:04:46.014332+0000","last_became_peered":"2024-04-16T13:04:46.014332+0000","last_unstale":"2024-04-16T13:04:53.015548+0000","last_undegraded":"2024-04-16T13:04:53.015548+0000","last_fullsized":"2024-04-16T13:04:53.015548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525140+0000","last_change":"2024-04-16T13:04:45.018345+0000","last_active":"2024-04-16T13:04:53.525140+0000","last_peered":"2024-04-16T13:04:53.525140+0000","last_clean":"2024-04-16T13:04:53.525140+0000","last_became_active":"2024-04-16T13:04:45.018023+0000","last_became_peered":"2024-04-16T13:04:45.018023+0000","last_unstale":"2024-04-16T13:04:53.525140+0000","last_undegraded":"2024-04-16T13:04:53.525140+0000","last_fullsized":"2024-04-16T13:04:53.525140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144101+0000","last_change":"2024-04-16T13:04:50.166377+0000","last_active":"2024-04-16T13:04:52.144101+0000","last_peered":"2024-04-16T13:04:52.144101+0000","last_clean":"2024-04-16T13:04:52.144101+0000","last_became_active":"2024-04-16T13:04:50.165706+0000","last_became_peered":"2024-04-16T13:04:50.165706+0000","last_unstale":"2024-04-16T13:04:52.144101+0000","last_undegraded":"2024-04-16T13:04:52.144101+0000","last_fullsized":"2024-04-16T13:04:52.144101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140626+0000","last_change":"2024-04-16T13:04:46.004518+0000","last_active":"2024-04-16T13:04:52.140626+0000","last_peered":"2024-04-16T13:04:52.140626+0000","last_clean":"2024-04-16T13:04:52.140626+0000","last_became_active":"2024-04-16T13:04:46.004307+0000","last_became_peered":"2024-04-16T13:04:46.004307+0000","last_unstale":"2024-04-16T13:04:52.140626+0000","last_undegraded":"2024-04-16T13:04:52.140626+0000","last_fullsized":"2024-04-16T13:04:52.140626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137806+0000","last_change":"2024-04-16T13:04:44.994353+0000","last_active":"2024-04-16T13:04:52.137806+0000","last_peered":"2024-04-16T13:04:52.137806+0000","last_clean":"2024-04-16T13:04:52.137806+0000","last_became_active":"2024-04-16T13:04:44.993983+0000","last_became_peered":"2024-04-16T13:04:44.993983+0000","last_unstale":"2024-04-16T13:04:52.137806+0000","last_undegraded":"2024-04-16T13:04:52.137806+0000","last_fullsized":"2024-04-16T13:04:52.137806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144015+0000","last_change":"2024-04-16T13:04:50.172131+0000","last_active":"2024-04-16T13:04:52.144015+0000","last_peered":"2024-04-16T13:04:52.144015+0000","last_clean":"2024-04-16T13:04:52.144015+0000","last_became_active":"2024-04-16T13:04:50.171610+0000","last_became_peered":"2024-04-16T13:04:50.171610+0000","last_unstale":"2024-04-16T13:04:52.144015+0000","last_undegraded":"2024-04-16T13:04:52.144015+0000","last_fullsized":"2024-04-16T13:04:52.144015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140915+0000","last_change":"2024-04-16T13:04:46.006324+0000","last_active":"2024-04-16T13:04:52.140915+0000","last_peered":"2024-04-16T13:04:52.140915+0000","last_clean":"2024-04-16T13:04:52.140915+0000","last_became_active":"2024-04-16T13:04:46.005807+0000","last_became_peered":"2024-04-16T13:04:46.005807+0000","last_unstale":"2024-04-16T13:04:52.140915+0000","last_undegraded":"2024-04-16T13:04:52.140915+0000","last_fullsized":"2024-04-16T13:04:52.140915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137099+0000","last_change":"2024-04-16T13:04:45.000438+0000","last_active":"2024-04-16T13:04:52.137099+0000","last_peered":"2024-04-16T13:04:52.137099+0000","last_clean":"2024-04-16T13:04:52.137099+0000","last_became_active":"2024-04-16T13:04:45.000089+0000","last_became_peered":"2024-04-16T13:04:45.000089+0000","last_unstale":"2024-04-16T13:04:52.137099+0000","last_undegraded":"2024-04-16T13:04:52.137099+0000","last_fullsized":"2024-04-16T13:04:52.137099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139470+0000","last_change":"2024-04-16T13:04:50.711220+0000","last_active":"2024-04-16T13:04:52.139470+0000","last_peered":"2024-04-16T13:04:52.139470+0000","last_clean":"2024-04-16T13:04:52.139470+0000","last_became_active":"2024-04-16T13:04:50.709851+0000","last_became_peered":"2024-04-16T13:04:50.709851+0000","last_unstale":"2024-04-16T13:04:52.139470+0000","last_undegraded":"2024-04-16T13:04:52.139470+0000","last_fullsized":"2024-04-16T13:04:52.139470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142413+0000","last_change":"2024-04-16T13:04:46.003322+0000","last_active":"2024-04-16T13:04:52.142413+0000","last_peered":"2024-04-16T13:04:52.142413+0000","last_clean":"2024-04-16T13:04:52.142413+0000","last_became_active":"2024-04-16T13:04:46.003054+0000","last_became_peered":"2024-04-16T13:04:46.003054+0000","last_unstale":"2024-04-16T13:04:52.142413+0000","last_undegraded":"2024-04-16T13:04:52.142413+0000","last_fullsized":"2024-04-16T13:04:52.142413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:20.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525718+0000","last_change":"2024-04-16T13:04:45.017508+0000","last_active":"2024-04-16T13:04:53.525718+0000","last_peered":"2024-04-16T13:04:53.525718+0000","last_clean":"2024-04-16T13:04:53.525718+0000","last_became_active":"2024-04-16T13:04:45.017191+0000","last_became_peered":"2024-04-16T13:04:45.017191+0000","last_unstale":"2024-04-16T13:04:53.525718+0000","last_undegraded":"2024-04-16T13:04:53.525718+0000","last_fullsized":"2024-04-16T13:04:53.525718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143665+0000","last_change":"2024-04-16T13:04:50.172094+0000","last_active":"2024-04-16T13:04:52.143665+0000","last_peered":"2024-04-16T13:04:52.143665+0000","last_clean":"2024-04-16T13:04:52.143665+0000","last_became_active":"2024-04-16T13:04:50.171583+0000","last_became_peered":"2024-04-16T13:04:50.171583+0000","last_unstale":"2024-04-16T13:04:52.143665+0000","last_undegraded":"2024-04-16T13:04:52.143665+0000","last_fullsized":"2024-04-16T13:04:52.143665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137578+0000","last_change":"2024-04-16T13:04:46.006452+0000","last_active":"2024-04-16T13:04:53.137578+0000","last_peered":"2024-04-16T13:04:53.137578+0000","last_clean":"2024-04-16T13:04:53.137578+0000","last_became_active":"2024-04-16T13:04:46.006110+0000","last_became_peered":"2024-04-16T13:04:46.006110+0000","last_unstale":"2024-04-16T13:04:53.137578+0000","last_undegraded":"2024-04-16T13:04:53.137578+0000","last_fullsized":"2024-04-16T13:04:53.137578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016559+0000","last_change":"2024-04-16T13:04:45.017007+0000","last_active":"2024-04-16T13:04:53.016559+0000","last_peered":"2024-04-16T13:04:53.016559+0000","last_clean":"2024-04-16T13:04:53.016559+0000","last_became_active":"2024-04-16T13:04:45.016628+0000","last_became_peered":"2024-04-16T13:04:45.016628+0000","last_unstale":"2024-04-16T13:04:53.016559+0000","last_undegraded":"2024-04-16T13:04:53.016559+0000","last_fullsized":"2024-04-16T13:04:53.016559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141982+0000","last_change":"2024-04-16T13:04:50.714894+0000","last_active":"2024-04-16T13:04:52.141982+0000","last_peered":"2024-04-16T13:04:52.141982+0000","last_clean":"2024-04-16T13:04:52.141982+0000","last_became_active":"2024-04-16T13:04:50.707478+0000","last_became_peered":"2024-04-16T13:04:50.707478+0000","last_unstale":"2024-04-16T13:04:52.141982+0000","last_undegraded":"2024-04-16T13:04:52.141982+0000","last_fullsized":"2024-04-16T13:04:52.141982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141377+0000","last_change":"2024-04-16T13:04:45.998408+0000","last_active":"2024-04-16T13:04:52.141377+0000","last_peered":"2024-04-16T13:04:52.141377+0000","last_clean":"2024-04-16T13:04:52.141377+0000","last_became_active":"2024-04-16T13:04:45.998086+0000","last_became_peered":"2024-04-16T13:04:45.998086+0000","last_unstale":"2024-04-16T13:04:52.141377+0000","last_undegraded":"2024-04-16T13:04:52.141377+0000","last_fullsized":"2024-04-16T13:04:52.141377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139111+0000","last_change":"2024-04-16T13:04:45.006718+0000","last_active":"2024-04-16T13:04:52.139111+0000","last_peered":"2024-04-16T13:04:52.139111+0000","last_clean":"2024-04-16T13:04:52.139111+0000","last_became_active":"2024-04-16T13:04:45.006418+0000","last_became_peered":"2024-04-16T13:04:45.006418+0000","last_unstale":"2024-04-16T13:04:52.139111+0000","last_undegraded":"2024-04-16T13:04:52.139111+0000","last_fullsized":"2024-04-16T13:04:52.139111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140164+0000","last_change":"2024-04-16T13:04:50.699284+0000","last_active":"2024-04-16T13:04:52.140164+0000","last_peered":"2024-04-16T13:04:52.140164+0000","last_clean":"2024-04-16T13:04:52.140164+0000","last_became_active":"2024-04-16T13:04:50.696999+0000","last_became_peered":"2024-04-16T13:04:50.696999+0000","last_unstale":"2024-04-16T13:04:52.140164+0000","last_undegraded":"2024-04-16T13:04:52.140164+0000","last_fullsized":"2024-04-16T13:04:52.140164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:47:43.788831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138077+0000","last_change":"2024-04-16T13:04:45.996654+0000","last_active":"2024-04-16T13:04:52.138077+0000","last_peered":"2024-04-16T13:04:52.138077+0000","last_clean":"2024-04-16T13:04:52.138077+0000","last_became_active":"2024-04-16T13:04:45.996251+0000","last_became_peered":"2024-04-16T13:04:45.996251+0000","last_unstale":"2024-04-16T13:04:52.138077+0000","last_undegraded":"2024-04-16T13:04:52.138077+0000","last_fullsized":"2024-04-16T13:04:52.138077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527291+0000","last_change":"2024-04-16T13:04:45.018375+0000","last_active":"2024-04-16T13:04:53.527291+0000","last_peered":"2024-04-16T13:04:53.527291+0000","last_clean":"2024-04-16T13:04:53.527291+0000","last_became_active":"2024-04-16T13:04:45.018125+0000","last_became_peered":"2024-04-16T13:04:45.018125+0000","last_unstale":"2024-04-16T13:04:53.527291+0000","last_undegraded":"2024-04-16T13:04:53.527291+0000","last_fullsized":"2024-04-16T13:04:53.527291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:38.002313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137111+0000","last_change":"2024-04-16T13:04:50.698690+0000","last_active":"2024-04-16T13:04:53.137111+0000","last_peered":"2024-04-16T13:04:53.137111+0000","last_clean":"2024-04-16T13:04:53.137111+0000","last_became_active":"2024-04-16T13:04:50.697358+0000","last_became_peered":"2024-04-16T13:04:50.697358+0000","last_unstale":"2024-04-16T13:04:53.137111+0000","last_undegraded":"2024-04-16T13:04:53.137111+0000","last_fullsized":"2024-04-16T13:04:53.137111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130111+0000","last_change":"2024-04-16T13:04:46.007829+0000","last_active":"2024-04-16T13:04:53.130111+0000","last_peered":"2024-04-16T13:04:53.130111+0000","last_clean":"2024-04-16T13:04:53.130111+0000","last_became_active":"2024-04-16T13:04:46.007537+0000","last_became_peered":"2024-04-16T13:04:46.007537+0000","last_unstale":"2024-04-16T13:04:53.130111+0000","last_undegraded":"2024-04-16T13:04:53.130111+0000","last_fullsized":"2024-04-16T13:04:53.130111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138200+0000","last_change":"2024-04-16T13:04:45.008507+0000","last_active":"2024-04-16T13:04:52.138200+0000","last_peered":"2024-04-16T13:04:52.138200+0000","last_clean":"2024-04-16T13:04:52.138200+0000","last_became_active":"2024-04-16T13:04:45.008217+0000","last_became_peered":"2024-04-16T13:04:45.008217+0000","last_unstale":"2024-04-16T13:04:52.138200+0000","last_undegraded":"2024-04-16T13:04:52.138200+0000","last_fullsized":"2024-04-16T13:04:52.138200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137403+0000","last_change":"2024-04-16T13:04:50.167171+0000","last_active":"2024-04-16T13:04:52.137403+0000","last_peered":"2024-04-16T13:04:52.137403+0000","last_clean":"2024-04-16T13:04:52.137403+0000","last_became_active":"2024-04-16T13:04:50.164681+0000","last_became_peered":"2024-04-16T13:04:50.164681+0000","last_unstale":"2024-04-16T13:04:52.137403+0000","last_undegraded":"2024-04-16T13:04:52.137403+0000","last_fullsized":"2024-04-16T13:04:52.137403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143872+0000","last_change":"2024-04-16T13:04:46.021438+0000","last_active":"2024-04-16T13:04:52.143872+0000","last_peered":"2024-04-16T13:04:52.143872+0000","last_clean":"2024-04-16T13:04:52.143872+0000","last_became_active":"2024-04-16T13:04:46.021184+0000","last_became_peered":"2024-04-16T13:04:46.021184+0000","last_unstale":"2024-04-16T13:04:52.143872+0000","last_undegraded":"2024-04-16T13:04:52.143872+0000","last_fullsized":"2024-04-16T13:04:52.143872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.055670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127965+0000","last_change":"2024-04-16T13:04:45.014922+0000","last_active":"2024-04-16T13:04:53.127965+0000","last_peered":"2024-04-16T13:04:53.127965+0000","last_clean":"2024-04-16T13:04:53.127965+0000","last_became_active":"2024-04-16T13:04:45.014037+0000","last_became_peered":"2024-04-16T13:04:45.014037+0000","last_unstale":"2024-04-16T13:04:53.127965+0000","last_undegraded":"2024-04-16T13:04:53.127965+0000","last_fullsized":"2024-04-16T13:04:53.127965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138224+0000","last_change":"2024-04-16T13:04:50.172451+0000","last_active":"2024-04-16T13:04:52.138224+0000","last_peered":"2024-04-16T13:04:52.138224+0000","last_clean":"2024-04-16T13:04:52.138224+0000","last_became_active":"2024-04-16T13:04:50.171709+0000","last_became_peered":"2024-04-16T13:04:50.171709+0000","last_unstale":"2024-04-16T13:04:52.138224+0000","last_undegraded":"2024-04-16T13:04:52.138224+0000","last_fullsized":"2024-04-16T13:04:52.138224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136931+0000","last_change":"2024-04-16T13:04:45.990241+0000","last_active":"2024-04-16T13:04:52.136931+0000","last_peered":"2024-04-16T13:04:52.136931+0000","last_clean":"2024-04-16T13:04:52.136931+0000","last_became_active":"2024-04-16T13:04:45.989713+0000","last_became_peered":"2024-04-16T13:04:45.989713+0000","last_unstale":"2024-04-16T13:04:52.136931+0000","last_undegraded":"2024-04-16T13:04:52.136931+0000","last_fullsized":"2024-04-16T13:04:52.136931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017464+0000","last_change":"2024-04-16T13:04:44.999454+0000","last_active":"2024-04-16T13:04:53.017464+0000","last_peered":"2024-04-16T13:04:53.017464+0000","last_clean":"2024-04-16T13:04:53.017464+0000","last_became_active":"2024-04-16T13:04:44.999166+0000","last_became_peered":"2024-04-16T13:04:44.999166+0000","last_unstale":"2024-04-16T13:04:53.017464+0000","last_undegraded":"2024-04-16T13:04:53.017464+0000","last_fullsized":"2024-04-16T13:04:53.017464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139649+0000","last_change":"2024-04-16T13:04:50.166374+0000","last_active":"2024-04-16T13:04:52.139649+0000","last_peered":"2024-04-16T13:04:52.139649+0000","last_clean":"2024-04-16T13:04:52.139649+0000","last_became_active":"2024-04-16T13:04:50.166029+0000","last_became_peered":"2024-04-16T13:04:50.166029+0000","last_unstale":"2024-04-16T13:04:52.139649+0000","last_undegraded":"2024-04-16T13:04:52.139649+0000","last_fullsized":"2024-04-16T13:04:52.139649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136502+0000","last_change":"2024-04-16T13:04:46.013116+0000","last_active":"2024-04-16T13:04:53.136502+0000","last_peered":"2024-04-16T13:04:53.136502+0000","last_clean":"2024-04-16T13:04:53.136502+0000","last_became_active":"2024-04-16T13:04:46.012724+0000","last_became_peered":"2024-04-16T13:04:46.012724+0000","last_unstale":"2024-04-16T13:04:53.136502+0000","last_undegraded":"2024-04-16T13:04:53.136502+0000","last_fullsized":"2024-04-16T13:04:53.136502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525117+0000","last_change":"2024-04-16T13:04:45.022061+0000","last_active":"2024-04-16T13:04:53.525117+0000","last_peered":"2024-04-16T13:04:53.525117+0000","last_clean":"2024-04-16T13:04:53.525117+0000","last_became_active":"2024-04-16T13:04:45.021784+0000","last_became_peered":"2024-04-16T13:04:45.021784+0000","last_unstale":"2024-04-16T13:04:53.525117+0000","last_undegraded":"2024-04-16T13:04:53.525117+0000","last_fullsized":"2024-04-16T13:04:53.525117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137504+0000","last_change":"2024-04-16T13:04:50.698726+0000","last_active":"2024-04-16T13:04:53.137504+0000","last_peered":"2024-04-16T13:04:53.137504+0000","last_clean":"2024-04-16T13:04:53.137504+0000","last_became_active":"2024-04-16T13:04:50.697335+0000","last_became_peered":"2024-04-16T13:04:50.697335+0000","last_unstale":"2024-04-16T13:04:53.137504+0000","last_undegraded":"2024-04-16T13:04:53.137504+0000","last_fullsized":"2024-04-16T13:04:53.137504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140431+0000","last_change":"2024-04-16T13:04:46.007441+0000","last_active":"2024-04-16T13:04:52.140431+0000","last_peered":"2024-04-16T13:04:52.140431+0000","last_clean":"2024-04-16T13:04:52.140431+0000","last_became_active":"2024-04-16T13:04:46.006232+0000","last_became_peered":"2024-04-16T13:04:46.006232+0000","last_unstale":"2024-04-16T13:04:52.140431+0000","last_undegraded":"2024-04-16T13:04:52.140431+0000","last_fullsized":"2024-04-16T13:04:52.140431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129402+0000","last_change":"2024-04-16T13:04:45.014153+0000","last_active":"2024-04-16T13:04:53.129402+0000","last_peered":"2024-04-16T13:04:53.129402+0000","last_clean":"2024-04-16T13:04:53.129402+0000","last_became_active":"2024-04-16T13:04:45.012884+0000","last_became_peered":"2024-04-16T13:04:45.012884+0000","last_unstale":"2024-04-16T13:04:53.129402+0000","last_undegraded":"2024-04-16T13:04:53.129402+0000","last_fullsized":"2024-04-16T13:04:53.129402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525920+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:04:53.525920+0000","last_peered":"2024-04-16T13:04:53.525920+0000","last_clean":"2024-04-16T13:04:53.525920+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:04:53.525920+0000","last_undegraded":"2024-04-16T13:04:53.525920+0000","last_fullsized":"2024-04-16T13:04:53.525920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017152+0000","last_change":"2024-04-16T13:04:50.706193+0000","last_active":"2024-04-16T13:04:53.017152+0000","last_peered":"2024-04-16T13:04:53.017152+0000","last_clean":"2024-04-16T13:04:53.017152+0000","last_became_active":"2024-04-16T13:04:50.705129+0000","last_became_peered":"2024-04-16T13:04:50.705129+0000","last_unstale":"2024-04-16T13:04:53.017152+0000","last_undegraded":"2024-04-16T13:04:53.017152+0000","last_fullsized":"2024-04-16T13:04:53.017152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526940+0000","last_change":"2024-04-16T13:04:46.010068+0000","last_active":"2024-04-16T13:04:53.526940+0000","last_peered":"2024-04-16T13:04:53.526940+0000","last_clean":"2024-04-16T13:04:53.526940+0000","last_became_active":"2024-04-16T13:04:46.009661+0000","last_became_peered":"2024-04-16T13:04:46.009661+0000","last_unstale":"2024-04-16T13:04:53.526940+0000","last_undegraded":"2024-04-16T13:04:53.526940+0000","last_fullsized":"2024-04-16T13:04:53.526940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018774+0000","last_change":"2024-04-16T13:04:45.009675+0000","last_active":"2024-04-16T13:04:53.018774+0000","last_peered":"2024-04-16T13:04:53.018774+0000","last_clean":"2024-04-16T13:04:53.018774+0000","last_became_active":"2024-04-16T13:04:45.009208+0000","last_became_peered":"2024-04-16T13:04:45.009208+0000","last_unstale":"2024-04-16T13:04:53.018774+0000","last_undegraded":"2024-04-16T13:04:53.018774+0000","last_fullsized":"2024-04-16T13:04:53.018774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015724+0000","last_change":"2024-04-16T13:04:50.700561+0000","last_active":"2024-04-16T13:04:53.015724+0000","last_peered":"2024-04-16T13:04:53.015724+0000","last_clean":"2024-04-16T13:04:53.015724+0000","last_became_active":"2024-04-16T13:04:50.697511+0000","last_became_peered":"2024-04-16T13:04:50.697511+0000","last_unstale":"2024-04-16T13:04:53.015724+0000","last_undegraded":"2024-04-16T13:04:53.015724+0000","last_fullsized":"2024-04-16T13:04:53.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129832+0000","last_change":"2024-04-16T13:04:46.008012+0000","last_active":"2024-04-16T13:04:53.129832+0000","last_peered":"2024-04-16T13:04:53.129832+0000","last_clean":"2024-04-16T13:04:53.129832+0000","last_became_active":"2024-04-16T13:04:46.007687+0000","last_became_peered":"2024-04-16T13:04:46.007687+0000","last_unstale":"2024-04-16T13:04:53.129832+0000","last_undegraded":"2024-04-16T13:04:53.129832+0000","last_fullsized":"2024-04-16T13:04:53.129832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138728+0000","last_change":"2024-04-16T13:04:45.003115+0000","last_active":"2024-04-16T13:04:52.138728+0000","last_peered":"2024-04-16T13:04:52.138728+0000","last_clean":"2024-04-16T13:04:52.138728+0000","last_became_active":"2024-04-16T13:04:45.002827+0000","last_became_peered":"2024-04-16T13:04:45.002827+0000","last_unstale":"2024-04-16T13:04:52.138728+0000","last_undegraded":"2024-04-16T13:04:52.138728+0000","last_fullsized":"2024-04-16T13:04:52.138728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137007+0000","last_change":"2024-04-16T13:04:50.170429+0000","last_active":"2024-04-16T13:04:53.137007+0000","last_peered":"2024-04-16T13:04:53.137007+0000","last_clean":"2024-04-16T13:04:53.137007+0000","last_became_active":"2024-04-16T13:04:50.168276+0000","last_became_peered":"2024-04-16T13:04:50.168276+0000","last_unstale":"2024-04-16T13:04:53.137007+0000","last_undegraded":"2024-04-16T13:04:53.137007+0000","last_fullsized":"2024-04-16T13:04:53.137007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527648+0000","last_change":"2024-04-16T13:04:45.996001+0000","last_active":"2024-04-16T13:04:53.527648+0000","last_peered":"2024-04-16T13:04:53.527648+0000","last_clean":"2024-04-16T13:04:53.527648+0000","last_became_active":"2024-04-16T13:04:45.994462+0000","last_became_peered":"2024-04-16T13:04:45.994462+0000","last_unstale":"2024-04-16T13:04:53.527648+0000","last_undegraded":"2024-04-16T13:04:53.527648+0000","last_fullsized":"2024-04-16T13:04:53.527648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:14.137296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017648+0000","last_change":"2024-04-16T13:04:45.001424+0000","last_active":"2024-04-16T13:04:53.017648+0000","last_peered":"2024-04-16T13:04:53.017648+0000","last_clean":"2024-04-16T13:04:53.017648+0000","last_became_active":"2024-04-16T13:04:45.001151+0000","last_became_peered":"2024-04-16T13:04:45.001151+0000","last_unstale":"2024-04-16T13:04:53.017648+0000","last_undegraded":"2024-04-16T13:04:53.017648+0000","last_fullsized":"2024-04-16T13:04:53.017648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128506+0000","last_change":"2024-04-16T13:04:50.711246+0000","last_active":"2024-04-16T13:04:53.128506+0000","last_peered":"2024-04-16T13:04:53.128506+0000","last_clean":"2024-04-16T13:04:53.128506+0000","last_became_active":"2024-04-16T13:04:50.704394+0000","last_became_peered":"2024-04-16T13:04:50.704394+0000","last_unstale":"2024-04-16T13:04:53.128506+0000","last_undegraded":"2024-04-16T13:04:53.128506+0000","last_fullsized":"2024-04-16T13:04:53.128506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:15.746451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526983+0000","last_change":"2024-04-16T13:04:45.985184+0000","last_active":"2024-04-16T13:04:53.526983+0000","last_peered":"2024-04-16T13:04:53.526983+0000","last_clean":"2024-04-16T13:04:53.526983+0000","last_became_active":"2024-04-16T13:04:45.984518+0000","last_became_peered":"2024-04-16T13:04:45.984518+0000","last_unstale":"2024-04-16T13:04:53.526983+0000","last_undegraded":"2024-04-16T13:04:53.526983+0000","last_fullsized":"2024-04-16T13:04:53.526983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144199+0000","last_change":"2024-04-16T13:04:45.009363+0000","last_active":"2024-04-16T13:04:52.144199+0000","last_peered":"2024-04-16T13:04:52.144199+0000","last_clean":"2024-04-16T13:04:52.144199+0000","last_became_active":"2024-04-16T13:04:45.008983+0000","last_became_peered":"2024-04-16T13:04:45.008983+0000","last_unstale":"2024-04-16T13:04:52.144199+0000","last_undegraded":"2024-04-16T13:04:52.144199+0000","last_fullsized":"2024-04-16T13:04:52.144199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:08:10.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141720+0000","last_change":"2024-04-16T13:04:50.166542+0000","last_active":"2024-04-16T13:04:52.141720+0000","last_peered":"2024-04-16T13:04:52.141720+0000","last_clean":"2024-04-16T13:04:52.141720+0000","last_became_active":"2024-04-16T13:04:50.166094+0000","last_became_peered":"2024-04-16T13:04:50.166094+0000","last_unstale":"2024-04-16T13:04:52.141720+0000","last_undegraded":"2024-04-16T13:04:52.141720+0000","last_fullsized":"2024-04-16T13:04:52.141720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:03.750621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526209+0000","last_change":"2024-04-16T13:04:45.985012+0000","last_active":"2024-04-16T13:04:53.526209+0000","last_peered":"2024-04-16T13:04:53.526209+0000","last_clean":"2024-04-16T13:04:53.526209+0000","last_became_active":"2024-04-16T13:04:45.984021+0000","last_became_peered":"2024-04-16T13:04:45.984021+0000","last_unstale":"2024-04-16T13:04:53.526209+0000","last_undegraded":"2024-04-16T13:04:53.526209+0000","last_fullsized":"2024-04-16T13:04:53.526209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017519+0000","last_change":"2024-04-16T13:04:44.997650+0000","last_active":"2024-04-16T13:04:53.017519+0000","last_peered":"2024-04-16T13:04:53.017519+0000","last_clean":"2024-04-16T13:04:53.017519+0000","last_became_active":"2024-04-16T13:04:44.997334+0000","last_became_peered":"2024-04-16T13:04:44.997334+0000","last_unstale":"2024-04-16T13:04:53.017519+0000","last_undegraded":"2024-04-16T13:04:53.017519+0000","last_fullsized":"2024-04-16T13:04:53.017519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137461+0000","last_change":"2024-04-16T13:04:50.161820+0000","last_active":"2024-04-16T13:04:53.137461+0000","last_peered":"2024-04-16T13:04:53.137461+0000","last_clean":"2024-04-16T13:04:53.137461+0000","last_became_active":"2024-04-16T13:04:50.161334+0000","last_became_peered":"2024-04-16T13:04:50.161334+0000","last_unstale":"2024-04-16T13:04:53.137461+0000","last_undegraded":"2024-04-16T13:04:53.137461+0000","last_fullsized":"2024-04-16T13:04:53.137461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015516+0000","last_change":"2024-04-16T13:04:46.002411+0000","last_active":"2024-04-16T13:04:53.015516+0000","last_peered":"2024-04-16T13:04:53.015516+0000","last_clean":"2024-04-16T13:04:53.015516+0000","last_became_active":"2024-04-16T13:04:46.002107+0000","last_became_peered":"2024-04-16T13:04:46.002107+0000","last_unstale":"2024-04-16T13:04:53.015516+0000","last_undegraded":"2024-04-16T13:04:53.015516+0000","last_fullsized":"2024-04-16T13:04:53.015516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.014730+0000","last_change":"2024-04-16T13:04:45.013545+0000","last_active":"2024-04-16T13:04:53.014730+0000","last_peered":"2024-04-16T13:04:53.014730+0000","last_clean":"2024-04-16T13:04:53.014730+0000","last_became_active":"2024-04-16T13:04:45.013202+0000","last_became_peered":"2024-04-16T13:04:45.013202+0000","last_unstale":"2024-04-16T13:04:53.014730+0000","last_undegraded":"2024-04-16T13:04:53.014730+0000","last_fullsized":"2024-04-16T13:04:53.014730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141020+0000","last_change":"2024-04-16T13:04:50.708122+0000","last_active":"2024-04-16T13:04:52.141020+0000","last_peered":"2024-04-16T13:04:52.141020+0000","last_clean":"2024-04-16T13:04:52.141020+0000","last_became_active":"2024-04-16T13:04:50.706711+0000","last_became_peered":"2024-04-16T13:04:50.706711+0000","last_unstale":"2024-04-16T13:04:52.141020+0000","last_undegraded":"2024-04-16T13:04:52.141020+0000","last_fullsized":"2024-04-16T13:04:52.141020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:34.429700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526079+0000","last_change":"2024-04-16T13:04:45.988616+0000","last_active":"2024-04-16T13:04:53.526079+0000","last_peered":"2024-04-16T13:04:53.526079+0000","last_clean":"2024-04-16T13:04:53.526079+0000","last_became_active":"2024-04-16T13:04:45.986360+0000","last_became_peered":"2024-04-16T13:04:45.986360+0000","last_unstale":"2024-04-16T13:04:53.526079+0000","last_undegraded":"2024-04-16T13:04:53.526079+0000","last_fullsized":"2024-04-16T13:04:53.526079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127989+0000","last_change":"2024-04-16T13:04:45.014011+0000","last_active":"2024-04-16T13:04:53.127989+0000","last_peered":"2024-04-16T13:04:53.127989+0000","last_clean":"2024-04-16T13:04:53.127989+0000","last_became_active":"2024-04-16T13:04:45.013245+0000","last_became_peered":"2024-04-16T13:04:45.013245+0000","last_unstale":"2024-04-16T13:04:53.127989+0000","last_undegraded":"2024-04-16T13:04:53.127989+0000","last_fullsized":"2024-04-16T13:04:53.127989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141019+0000","last_change":"2024-04-16T13:04:50.699221+0000","last_active":"2024-04-16T13:04:52.141019+0000","last_peered":"2024-04-16T13:04:52.141019+0000","last_clean":"2024-04-16T13:04:52.141019+0000","last_became_active":"2024-04-16T13:04:50.697803+0000","last_became_peered":"2024-04-16T13:04:50.697803+0000","last_unstale":"2024-04-16T13:04:52.141019+0000","last_undegraded":"2024-04-16T13:04:52.141019+0000","last_fullsized":"2024-04-16T13:04:52.141019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:55.380620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136601+0000","last_change":"2024-04-16T13:04:46.012519+0000","last_active":"2024-04-16T13:04:53.136601+0000","last_peered":"2024-04-16T13:04:53.136601+0000","last_clean":"2024-04-16T13:04:53.136601+0000","last_became_active":"2024-04-16T13:04:46.001053+0000","last_became_peered":"2024-04-16T13:04:46.001053+0000","last_unstale":"2024-04-16T13:04:53.136601+0000","last_undegraded":"2024-04-16T13:04:53.136601+0000","last_fullsized":"2024-04-16T13:04:53.136601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.135925+0000","last_change":"2024-04-16T13:04:45.008591+0000","last_active":"2024-04-16T13:04:53.135925+0000","last_peered":"2024-04-16T13:04:53.135925+0000","last_clean":"2024-04-16T13:04:53.135925+0000","last_became_active":"2024-04-16T13:04:45.008078+0000","last_became_peered":"2024-04-16T13:04:45.008078+0000","last_unstale":"2024-04-16T13:04:53.135925+0000","last_undegraded":"2024-04-16T13:04:53.135925+0000","last_fullsized":"2024-04-16T13:04:53.135925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130019+0000","last_change":"2024-04-16T13:04:50.705924+0000","last_active":"2024-04-16T13:04:53.130019+0000","last_peered":"2024-04-16T13:04:53.130019+0000","last_clean":"2024-04-16T13:04:53.130019+0000","last_became_active":"2024-04-16T13:04:50.704821+0000","last_became_peered":"2024-04-16T13:04:50.704821+0000","last_unstale":"2024-04-16T13:04:53.130019+0000","last_undegraded":"2024-04-16T13:04:53.130019+0000","last_fullsized":"2024-04-16T13:04:53.130019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:11.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526614+0000","last_change":"2024-04-16T13:04:45.998493+0000","last_active":"2024-04-16T13:04:53.526614+0000","last_peered":"2024-04-16T13:04:53.526614+0000","last_clean":"2024-04-16T13:04:53.526614+0000","last_became_active":"2024-04-16T13:04:45.998193+0000","last_became_peered":"2024-04-16T13:04:45.998193+0000","last_unstale":"2024-04-16T13:04:53.526614+0000","last_undegraded":"2024-04-16T13:04:53.526614+0000","last_fullsized":"2024-04-16T13:04:53.526614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:05:05.120063+0000","last_change":"2024-04-16T13:04:45.015482+0000","last_active":"2024-04-16T13:05:05.120063+0000","last_peered":"2024-04-16T13:05:05.120063+0000","last_clean":"2024-04-16T13:05:05.120063+0000","last_became_active":"2024-04-16T13:04:45.015101+0000","last_became_peered":"2024-04-16T13:04:45.015101+0000","last_unstale":"2024-04-16T13:05:05.120063+0000","last_undegraded":"2024-04-16T13:05:05.120063+0000","last_fullsized":"2024-04-16T13:05:05.120063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137698+0000","last_change":"2024-04-16T13:04:50.167914+0000","last_active":"2024-04-16T13:04:52.137698+0000","last_peered":"2024-04-16T13:04:52.137698+0000","last_clean":"2024-04-16T13:04:52.137698+0000","last_became_active":"2024-04-16T13:04:50.167516+0000","last_became_peered":"2024-04-16T13:04:50.167516+0000","last_unstale":"2024-04-16T13:04:52.137698+0000","last_undegraded":"2024-04-16T13:04:52.137698+0000","last_fullsized":"2024-04-16T13:04:52.137698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143485+0000","last_change":"2024-04-16T13:04:45.990047+0000","last_active":"2024-04-16T13:04:52.143485+0000","last_peered":"2024-04-16T13:04:52.143485+0000","last_clean":"2024-04-16T13:04:52.143485+0000","last_became_active":"2024-04-16T13:04:45.989544+0000","last_became_peered":"2024-04-16T13:04:45.989544+0000","last_unstale":"2024-04-16T13:04:52.143485+0000","last_undegraded":"2024-04-16T13:04:52.143485+0000","last_fullsized":"2024-04-16T13:04:52.143485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:41.080920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138591+0000","last_change":"2024-04-16T13:04:45.016272+0000","last_active":"2024-04-16T13:04:52.138591+0000","last_peered":"2024-04-16T13:04:52.138591+0000","last_clean":"2024-04-16T13:04:52.138591+0000","last_became_active":"2024-04-16T13:04:45.015942+0000","last_became_peered":"2024-04-16T13:04:45.015942+0000","last_unstale":"2024-04-16T13:04:52.138591+0000","last_undegraded":"2024-04-16T13:04:52.138591+0000","last_fullsized":"2024-04-16T13:04:52.138591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142942+0000","last_change":"2024-04-16T13:04:50.167454+0000","last_active":"2024-04-16T13:04:52.142942+0000","last_peered":"2024-04-16T13:04:52.142942+0000","last_clean":"2024-04-16T13:04:52.142942+0000","last_became_active":"2024-04-16T13:04:50.166243+0000","last_became_peered":"2024-04-16T13:04:50.166243+0000","last_unstale":"2024-04-16T13:04:52.142942+0000","last_undegraded":"2024-04-16T13:04:52.142942+0000","last_fullsized":"2024-04-16T13:04:52.142942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:44.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137930+0000","last_change":"2024-04-16T13:04:46.010441+0000","last_active":"2024-04-16T13:04:53.137930+0000","last_peered":"2024-04-16T13:04:53.137930+0000","last_clean":"2024-04-16T13:04:53.137930+0000","last_became_active":"2024-04-16T13:04:46.010071+0000","last_became_peered":"2024-04-16T13:04:46.010071+0000","last_unstale":"2024-04-16T13:04:53.137930+0000","last_undegraded":"2024-04-16T13:04:53.137930+0000","last_fullsized":"2024-04-16T13:04:53.137930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127981+0000","last_change":"2024-04-16T13:04:45.019809+0000","last_active":"2024-04-16T13:04:53.127981+0000","last_peered":"2024-04-16T13:04:53.127981+0000","last_clean":"2024-04-16T13:04:53.127981+0000","last_became_active":"2024-04-16T13:04:45.019299+0000","last_became_peered":"2024-04-16T13:04:45.019299+0000","last_unstale":"2024-04-16T13:04:53.127981+0000","last_undegraded":"2024-04-16T13:04:53.127981+0000","last_fullsized":"2024-04-16T13:04:53.127981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140403+0000","last_change":"2024-04-16T13:04:50.164233+0000","last_active":"2024-04-16T13:04:52.140403+0000","last_peered":"2024-04-16T13:04:52.140403+0000","last_clean":"2024-04-16T13:04:52.140403+0000","last_became_active":"2024-04-16T13:04:50.161088+0000","last_became_peered":"2024-04-16T13:04:50.161088+0000","last_unstale":"2024-04-16T13:04:52.140403+0000","last_undegraded":"2024-04-16T13:04:52.140403+0000","last_fullsized":"2024-04-16T13:04:52.140403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:52:19.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130074+0000","last_change":"2024-04-16T13:04:46.009061+0000","last_active":"2024-04-16T13:04:53.130074+0000","last_peered":"2024-04-16T13:04:53.130074+0000","last_clean":"2024-04-16T13:04:53.130074+0000","last_became_active":"2024-04-16T13:04:46.008721+0000","last_became_peered":"2024-04-16T13:04:46.008721+0000","last_unstale":"2024-04-16T13:04:53.130074+0000","last_undegraded":"2024-04-16T13:04:53.130074+0000","last_fullsized":"2024-04-16T13:04:53.130074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017766+0000","last_change":"2024-04-16T13:04:45.021156+0000","last_active":"2024-04-16T13:04:53.017766+0000","last_peered":"2024-04-16T13:04:53.017766+0000","last_clean":"2024-04-16T13:04:53.017766+0000","last_became_active":"2024-04-16T13:04:45.020854+0000","last_became_peered":"2024-04-16T13:04:45.020854+0000","last_unstale":"2024-04-16T13:04:53.017766+0000","last_undegraded":"2024-04-16T13:04:53.017766+0000","last_fullsized":"2024-04-16T13:04:53.017766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140351+0000","last_change":"2024-04-16T13:04:50.707455+0000","last_active":"2024-04-16T13:04:52.140351+0000","last_peered":"2024-04-16T13:04:52.140351+0000","last_clean":"2024-04-16T13:04:52.140351+0000","last_became_active":"2024-04-16T13:04:50.706437+0000","last_became_peered":"2024-04-16T13:04:50.706437+0000","last_unstale":"2024-04-16T13:04:52.140351+0000","last_undegraded":"2024-04-16T13:04:52.140351+0000","last_fullsized":"2024-04-16T13:04:52.140351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:07:07.045544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137384+0000","last_change":"2024-04-16T13:04:50.708826+0000","last_active":"2024-04-16T13:04:53.137384+0000","last_peered":"2024-04-16T13:04:53.137384+0000","last_clean":"2024-04-16T13:04:53.137384+0000","last_became_active":"2024-04-16T13:04:50.707859+0000","last_became_peered":"2024-04-16T13:04:50.707859+0000","last_unstale":"2024-04-16T13:04:53.137384+0000","last_undegraded":"2024-04-16T13:04:53.137384+0000","last_fullsized":"2024-04-16T13:04:53.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136926+0000","last_change":"2024-04-16T13:04:46.000392+0000","last_active":"2024-04-16T13:04:52.136926+0000","last_peered":"2024-04-16T13:04:52.136926+0000","last_clean":"2024-04-16T13:04:52.136926+0000","last_became_active":"2024-04-16T13:04:46.000078+0000","last_became_peered":"2024-04-16T13:04:46.000078+0000","last_unstale":"2024-04-16T13:04:52.136926+0000","last_undegraded":"2024-04-16T13:04:52.136926+0000","last_fullsized":"2024-04-16T13:04:52.136926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127941+0000","last_change":"2024-04-16T13:04:45.006496+0000","last_active":"2024-04-16T13:04:53.127941+0000","last_peered":"2024-04-16T13:04:53.127941+0000","last_clean":"2024-04-16T13:04:53.127941+0000","last_became_active":"2024-04-16T13:04:45.006186+0000","last_became_peered":"2024-04-16T13:04:45.006186+0000","last_unstale":"2024-04-16T13:04:53.127941+0000","last_undegraded":"2024-04-16T13:04:53.127941+0000","last_fullsized":"2024-04-16T13:04:53.127941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017419+0000","last_change":"2024-04-16T13:04:50.176861+0000","last_active":"2024-04-16T13:04:53.017419+0000","last_peered":"2024-04-16T13:04:53.017419+0000","last_clean":"2024-04-16T13:04:53.017419+0000","last_became_active":"2024-04-16T13:04:50.176348+0000","last_became_peered":"2024-04-16T13:04:50.176348+0000","last_unstale":"2024-04-16T13:04:53.017419+0000","last_undegraded":"2024-04-16T13:04:53.017419+0000","last_fullsized":"2024-04-16T13:04:53.017419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140739+0000","last_change":"2024-04-16T13:04:46.000621+0000","last_active":"2024-04-16T13:04:52.140739+0000","last_peered":"2024-04-16T13:04:52.140739+0000","last_clean":"2024-04-16T13:04:52.140739+0000","last_became_active":"2024-04-16T13:04:46.000319+0000","last_became_peered":"2024-04-16T13:04:46.000319+0000","last_unstale":"2024-04-16T13:04:52.140739+0000","last_undegraded":"2024-04-16T13:04:52.140739+0000","last_fullsized":"2024-04-16T13:04:52.140739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141221+0000","last_change":"2024-04-16T13:04:45.006224+0000","last_active":"2024-04-16T13:04:52.141221+0000","last_peered":"2024-04-16T13:04:52.141221+0000","last_clean":"2024-04-16T13:04:52.141221+0000","last_became_active":"2024-04-16T13:04:45.005898+0000","last_became_peered":"2024-04-16T13:04:45.005898+0000","last_unstale":"2024-04-16T13:04:52.141221+0000","last_undegraded":"2024-04-16T13:04:52.141221+0000","last_fullsized":"2024-04-16T13:04:52.141221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015851+0000","last_change":"2024-04-16T13:04:45.019025+0000","last_active":"2024-04-16T13:04:53.015851+0000","last_peered":"2024-04-16T13:04:53.015851+0000","last_clean":"2024-04-16T13:04:53.015851+0000","last_became_active":"2024-04-16T13:04:45.015700+0000","last_became_peered":"2024-04-16T13:04:45.015700+0000","last_unstale":"2024-04-16T13:04:53.015851+0000","last_undegraded":"2024-04-16T13:04:53.015851+0000","last_fullsized":"2024-04-16T13:04:53.015851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137290+0000","last_change":"2024-04-16T13:04:46.018489+0000","last_active":"2024-04-16T13:04:53.137290+0000","last_peered":"2024-04-16T13:04:53.137290+0000","last_clean":"2024-04-16T13:04:53.137290+0000","last_became_active":"2024-04-16T13:04:46.018109+0000","last_became_peered":"2024-04-16T13:04:46.018109+0000","last_unstale":"2024-04-16T13:04:53.137290+0000","last_undegraded":"2024-04-16T13:04:53.137290+0000","last_fullsized":"2024-04-16T13:04:53.137290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018321+0000","last_change":"2024-04-16T13:04:50.172707+0000","last_active":"2024-04-16T13:04:53.018321+0000","last_peered":"2024-04-16T13:04:53.018321+0000","last_clean":"2024-04-16T13:04:53.018321+0000","last_became_active":"2024-04-16T13:04:50.172280+0000","last_became_peered":"2024-04-16T13:04:50.172280+0000","last_unstale":"2024-04-16T13:04:53.018321+0000","last_undegraded":"2024-04-16T13:04:53.018321+0000","last_fullsized":"2024-04-16T13:04:53.018321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:04.522503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140744+0000","last_change":"2024-04-16T13:04:45.005110+0000","last_active":"2024-04-16T13:04:52.140744+0000","last_peered":"2024-04-16T13:04:52.140744+0000","last_clean":"2024-04-16T13:04:52.140744+0000","last_became_active":"2024-04-16T13:04:45.004820+0000","last_became_peered":"2024-04-16T13:04:45.004820+0000","last_unstale":"2024-04-16T13:04:52.140744+0000","last_undegraded":"2024-04-16T13:04:52.140744+0000","last_fullsized":"2024-04-16T13:04:52.140744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142646+0000","last_change":"2024-04-16T13:04:45.992254+0000","last_active":"2024-04-16T13:04:52.142646+0000","last_peered":"2024-04-16T13:04:52.142646+0000","last_clean":"2024-04-16T13:04:52.142646+0000","last_became_active":"2024-04-16T13:04:45.991789+0000","last_became_peered":"2024-04-16T13:04:45.991789+0000","last_unstale":"2024-04-16T13:04:52.142646+0000","last_undegraded":"2024-04-16T13:04:52.142646+0000","last_fullsized":"2024-04-16T13:04:52.142646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:40.238739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141125+0000","last_change":"2024-04-16T13:04:50.166825+0000","last_active":"2024-04-16T13:04:52.141125+0000","last_peered":"2024-04-16T13:04:52.141125+0000","last_clean":"2024-04-16T13:04:52.141125+0000","last_became_active":"2024-04-16T13:04:50.163810+0000","last_became_peered":"2024-04-16T13:04:50.163810+0000","last_unstale":"2024-04-16T13:04:52.141125+0000","last_undegraded":"2024-04-16T13:04:52.141125+0000","last_fullsized":"2024-04-16T13:04:52.141125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:27.336747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015243+0000","last_change":"2024-04-16T13:04:46.003053+0000","last_active":"2024-04-16T13:04:53.015243+0000","last_peered":"2024-04-16T13:04:53.015243+0000","last_clean":"2024-04-16T13:04:53.015243+0000","last_became_active":"2024-04-16T13:04:46.002349+0000","last_became_peered":"2024-04-16T13:04:46.002349+0000","last_unstale":"2024-04-16T13:04:53.015243+0000","last_undegraded":"2024-04-16T13:04:53.015243+0000","last_fullsized":"2024-04-16T13:04:53.015243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017790+0000","last_change":"2024-04-16T13:04:46.012253+0000","last_active":"2024-04-16T13:04:53.017790+0000","last_peered":"2024-04-16T13:04:53.017790+0000","last_clean":"2024-04-16T13:04:53.017790+0000","last_became_active":"2024-04-16T13:04:46.011827+0000","last_became_peered":"2024-04-16T13:04:46.011827+0000","last_unstale":"2024-04-16T13:04:53.017790+0000","last_undegraded":"2024-04-16T13:04:53.017790+0000","last_fullsized":"2024-04-16T13:04:53.017790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129257+0000","last_change":"2024-04-16T13:04:46.005260+0000","last_active":"2024-04-16T13:04:53.129257+0000","last_peered":"2024-04-16T13:04:53.129257+0000","last_clean":"2024-04-16T13:04:53.129257+0000","last_became_active":"2024-04-16T13:04:46.004249+0000","last_became_peered":"2024-04-16T13:04:46.004249+0000","last_unstale":"2024-04-16T13:04:53.129257+0000","last_undegraded":"2024-04-16T13:04:53.129257+0000","last_fullsized":"2024-04-16T13:04:53.129257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137145+0000","last_change":"2024-04-16T13:04:46.004033+0000","last_active":"2024-04-16T13:04:53.137145+0000","last_peered":"2024-04-16T13:04:53.137145+0000","last_clean":"2024-04-16T13:04:53.137145+0000","last_became_active":"2024-04-16T13:04:46.002797+0000","last_became_peered":"2024-04-16T13:04:46.002797+0000","last_unstale":"2024-04-16T13:04:53.137145+0000","last_undegraded":"2024-04-16T13:04:53.137145+0000","last_fullsized":"2024-04-16T13:04:53.137145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:33.289858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141301+0000","last_change":"2024-04-16T13:04:46.004426+0000","last_active":"2024-04-16T13:04:52.141301+0000","last_peered":"2024-04-16T13:04:52.141301+0000","last_clean":"2024-04-16T13:04:52.141301+0000","last_became_active":"2024-04-16T13:04:46.004142+0000","last_became_peered":"2024-04-16T13:04:46.004142+0000","last_unstale":"2024-04-16T13:04:52.141301+0000","last_undegraded":"2024-04-16T13:04:52.141301+0000","last_fullsized":"2024-04-16T13:04:52.141301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138556+0000","last_change":"2024-04-16T13:04:45.996051+0000","last_active":"2024-04-16T13:04:52.138556+0000","last_peered":"2024-04-16T13:04:52.138556+0000","last_clean":"2024-04-16T13:04:52.138556+0000","last_became_active":"2024-04-16T13:04:45.995786+0000","last_became_peered":"2024-04-16T13:04:45.995786+0000","last_unstale":"2024-04-16T13:04:52.138556+0000","last_undegraded":"2024-04-16T13:04:52.138556+0000","last_fullsized":"2024-04-16T13:04:52.138556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017733+0000","last_change":"2024-04-16T13:04:46.014233+0000","last_active":"2024-04-16T13:04:53.017733+0000","last_peered":"2024-04-16T13:04:53.017733+0000","last_clean":"2024-04-16T13:04:53.017733+0000","last_became_active":"2024-04-16T13:04:46.007756+0000","last_became_peered":"2024-04-16T13:04:46.007756+0000","last_unstale":"2024-04-16T13:04:53.017733+0000","last_undegraded":"2024-04-16T13:04:53.017733+0000","last_fullsized":"2024-04-16T13:04:53.017733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141176+0000","last_change":"2024-04-16T13:04:46.002910+0000","last_active":"2024-04-16T13:04:52.141176+0000","last_peered":"2024-04-16T13:04:52.141176+0000","last_clean":"2024-04-16T13:04:52.141176+0000","last_became_active":"2024-04-16T13:04:46.002453+0000","last_became_peered":"2024-04-16T13:04:46.002453+0000","last_unstale":"2024-04-16T13:04:52.141176+0000","last_undegraded":"2024-04-16T13:04:52.141176+0000","last_fullsized":"2024-04-16T13:04:52.141176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128952+0000","last_change":"2024-04-16T13:04:46.004049+0000","last_active":"2024-04-16T13:04:53.128952+0000","last_peered":"2024-04-16T13:04:53.128952+0000","last_clean":"2024-04-16T13:04:53.128952+0000","last_became_active":"2024-04-16T13:04:46.003706+0000","last_became_peered":"2024-04-16T13:04:46.003706+0000","last_unstale":"2024-04-16T13:04:53.128952+0000","last_undegraded":"2024-04-16T13:04:53.128952+0000","last_fullsized":"2024-04-16T13:04:53.128952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141077+0000","last_change":"2024-04-16T13:04:45.995750+0000","last_active":"2024-04-16T13:04:52.141077+0000","last_peered":"2024-04-16T13:04:52.141077+0000","last_clean":"2024-04-16T13:04:52.141077+0000","last_became_active":"2024-04-16T13:04:45.995236+0000","last_became_peered":"2024-04-16T13:04:45.995236+0000","last_unstale":"2024-04-16T13:04:52.141077+0000","last_undegraded":"2024-04-16T13:04:52.141077+0000","last_fullsized":"2024-04-16T13:04:52.141077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129172+0000","last_change":"2024-04-16T13:04:46.004985+0000","last_active":"2024-04-16T13:04:53.129172+0000","last_peered":"2024-04-16T13:04:53.129172+0000","last_clean":"2024-04-16T13:04:53.129172+0000","last_became_active":"2024-04-16T13:04:46.003800+0000","last_became_peered":"2024-04-16T13:04:46.003800+0000","last_unstale":"2024-04-16T13:04:53.129172+0000","last_undegraded":"2024-04-16T13:04:53.129172+0000","last_fullsized":"2024-04-16T13:04:53.129172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136544+0000","last_change":"2024-04-16T13:04:46.004265+0000","last_active":"2024-04-16T13:04:53.136544+0000","last_peered":"2024-04-16T13:04:53.136544+0000","last_clean":"2024-04-16T13:04:53.136544+0000","last_became_active":"2024-04-16T13:04:46.003115+0000","last_became_peered":"2024-04-16T13:04:46.003115+0000","last_unstale":"2024-04-16T13:04:53.136544+0000","last_undegraded":"2024-04-16T13:04:53.136544+0000","last_fullsized":"2024-04-16T13:04:53.136544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:52.579674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016869+0000","last_change":"2024-04-16T13:04:46.018522+0000","last_active":"2024-04-16T13:04:53.016869+0000","last_peered":"2024-04-16T13:04:53.016869+0000","last_clean":"2024-04-16T13:04:53.016869+0000","last_became_active":"2024-04-16T13:04:46.008619+0000","last_became_peered":"2024-04-16T13:04:46.008619+0000","last_unstale":"2024-04-16T13:04:53.016869+0000","last_undegraded":"2024-04-16T13:04:53.016869+0000","last_fullsized":"2024-04-16T13:04:53.016869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527232+0000","last_change":"2024-04-16T13:04:45.996736+0000","last_active":"2024-04-16T13:04:53.527232+0000","last_peered":"2024-04-16T13:04:53.527232+0000","last_clean":"2024-04-16T13:04:53.527232+0000","last_became_active":"2024-04-16T13:04:45.996437+0000","last_became_peered":"2024-04-16T13:04:45.996437+0000","last_unstale":"2024-04-16T13:04:53.527232+0000","last_undegraded":"2024-04-16T13:04:53.527232+0000","last_fullsized":"2024-04-16T13:04:53.527232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.019040+0000","last_change":"2024-04-16T13:04:46.000008+0000","last_active":"2024-04-16T13:04:53.019040+0000","last_peered":"2024-04-16T13:04:53.019040+0000","last_clean":"2024-04-16T13:04:53.019040+0000","last_became_active":"2024-04-16T13:04:45.999290+0000","last_became_peered":"2024-04-16T13:04:45.999290+0000","last_unstale":"2024-04-16T13:04:53.019040+0000","last_undegraded":"2024-04-16T13:04:53.019040+0000","last_fullsized":"2024-04-16T13:04:53.019040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:39.017477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130606+0000","last_change":"2024-04-16T13:04:46.010682+0000","last_active":"2024-04-16T13:04:53.130606+0000","last_peered":"2024-04-16T13:04:53.130606+0000","last_clean":"2024-04-16T13:04:53.130606+0000","last_became_active":"2024-04-16T13:04:46.008966+0000","last_became_peered":"2024-04-16T13:04:46.008966+0000","last_unstale":"2024-04-16T13:04:53.130606+0000","last_undegraded":"2024-04-16T13:04:53.130606+0000","last_fullsized":"2024-04-16T13:04:53.130606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128870+0000","last_change":"2024-04-16T13:04:46.003968+0000","last_active":"2024-04-16T13:04:53.128870+0000","last_peered":"2024-04-16T13:04:53.128870+0000","last_clean":"2024-04-16T13:04:53.128870+0000","last_became_active":"2024-04-16T13:04:46.003377+0000","last_became_peered":"2024-04-16T13:04:46.003377+0000","last_unstale":"2024-04-16T13:04:53.128870+0000","last_undegraded":"2024-04-16T13:04:53.128870+0000","last_fullsized":"2024-04-16T13:04:53.128870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136997+0000","last_change":"2024-04-16T13:04:45.986929+0000","last_active":"2024-04-16T13:04:52.136997+0000","last_peered":"2024-04-16T13:04:52.136997+0000","last_clean":"2024-04-16T13:04:52.136997+0000","last_became_active":"2024-04-16T13:04:45.986136+0000","last_became_peered":"2024-04-16T13:04:45.986136+0000","last_unstale":"2024-04-16T13:04:52.136997+0000","last_undegraded":"2024-04-16T13:04:52.136997+0000","last_fullsized":"2024-04-16T13:04:52.136997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136540+0000","last_change":"2024-04-16T13:04:46.006745+0000","last_active":"2024-04-16T13:04:53.136540+0000","last_peered":"2024-04-16T13:04:53.136540+0000","last_clean":"2024-04-16T13:04:53.136540+0000","last_became_active":"2024-04-16T13:04:46.005822+0000","last_became_peered":"2024-04-16T13:04:46.005822+0000","last_unstale":"2024-04-16T13:04:53.136540+0000","last_undegraded":"2024-04-16T13:04:53.136540+0000","last_fullsized":"2024-04-16T13:04:53.136540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:36.399411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141458+0000","last_change":"2024-04-16T13:04:46.019457+0000","last_active":"2024-04-16T13:04:52.141458+0000","last_peered":"2024-04-16T13:04:52.141458+0000","last_clean":"2024-04-16T13:04:52.141458+0000","last_became_active":"2024-04-16T13:04:46.017865+0000","last_became_peered":"2024-04-16T13:04:46.017865+0000","last_unstale":"2024-04-16T13:04:52.141458+0000","last_undegraded":"2024-04-16T13:04:52.141458+0000","last_fullsized":"2024-04-16T13:04:52.141458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143225+0000","last_change":"2024-04-16T13:04:46.008099+0000","last_active":"2024-04-16T13:04:52.143225+0000","last_peered":"2024-04-16T13:04:52.143225+0000","last_clean":"2024-04-16T13:04:52.143225+0000","last_became_active":"2024-04-16T13:04:46.007709+0000","last_became_peered":"2024-04-16T13:04:46.007709+0000","last_unstale":"2024-04-16T13:04:52.143225+0000","last_undegraded":"2024-04-16T13:04:52.143225+0000","last_fullsized":"2024-04-16T13:04:52.143225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018093+0000","last_change":"2024-04-16T13:04:46.020412+0000","last_active":"2024-04-16T13:04:53.018093+0000","last_peered":"2024-04-16T13:04:53.018093+0000","last_clean":"2024-04-16T13:04:53.018093+0000","last_became_active":"2024-04-16T13:04:46.020176+0000","last_became_peered":"2024-04-16T13:04:46.020176+0000","last_unstale":"2024-04-16T13:04:53.018093+0000","last_undegraded":"2024-04-16T13:04:53.018093+0000","last_fullsized":"2024-04-16T13:04:53.018093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017641+0000","last_change":"2024-04-16T13:04:46.017218+0000","last_active":"2024-04-16T13:04:53.017641+0000","last_peered":"2024-04-16T13:04:53.017641+0000","last_clean":"2024-04-16T13:04:53.017641+0000","last_became_active":"2024-04-16T13:04:46.014646+0000","last_became_peered":"2024-04-16T13:04:46.014646+0000","last_unstale":"2024-04-16T13:04:53.017641+0000","last_undegraded":"2024-04-16T13:04:53.017641+0000","last_fullsized":"2024-04-16T13:04:53.017641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527498+0000","last_change":"2024-04-16T13:04:46.009985+0000","last_active":"2024-04-16T13:04:53.527498+0000","last_peered":"2024-04-16T13:04:53.527498+0000","last_clean":"2024-04-16T13:04:53.527498+0000","last_became_active":"2024-04-16T13:04:46.009696+0000","last_became_peered":"2024-04-16T13:04:46.009696+0000","last_unstale":"2024-04-16T13:04:53.527498+0000","last_undegraded":"2024-04-16T13:04:53.527498+0000","last_fullsized":"2024-04-16T13:04:53.527498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:40.104541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140079+0000","last_change":"2024-04-16T13:04:46.006877+0000","last_active":"2024-04-16T13:04:52.140079+0000","last_peered":"2024-04-16T13:04:52.140079+0000","last_clean":"2024-04-16T13:04:52.140079+0000","last_became_active":"2024-04-16T13:04:46.006436+0000","last_became_peered":"2024-04-16T13:04:46.006436+0000","last_unstale":"2024-04-16T13:04:52.140079+0000","last_undegraded":"2024-04-16T13:04:52.140079+0000","last_fullsized":"2024-04-16T13:04:52.140079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526019+0000","last_change":"2024-04-16T13:04:46.004191+0000","last_active":"2024-04-16T13:04:53.526019+0000","last_peered":"2024-04-16T13:04:53.526019+0000","last_clean":"2024-04-16T13:04:53.526019+0000","last_became_active":"2024-04-16T13:04:46.003868+0000","last_became_peered":"2024-04-16T13:04:46.003868+0000","last_unstale":"2024-04-16T13:04:53.526019+0000","last_undegraded":"2024-04-16T13:04:53.526019+0000","last_fullsized":"2024-04-16T13:04:53.526019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128991+0000","last_change":"2024-04-16T13:04:46.005552+0000","last_active":"2024-04-16T13:04:53.128991+0000","last_peered":"2024-04-16T13:04:53.128991+0000","last_clean":"2024-04-16T13:04:53.128991+0000","last_became_active":"2024-04-16T13:04:46.004596+0000","last_became_peered":"2024-04-16T13:04:46.004596+0000","last_unstale":"2024-04-16T13:04:53.128991+0000","last_undegraded":"2024-04-16T13:04:53.128991+0000","last_fullsized":"2024-04-16T13:04:53.128991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525853+0000","last_change":"2024-04-16T13:04:45.997612+0000","last_active":"2024-04-16T13:04:53.525853+0000","last_peered":"2024-04-16T13:04:53.525853+0000","last_clean":"2024-04-16T13:04:53.525853+0000","last_became_active":"2024-04-16T13:04:45.996762+0000","last_became_peered":"2024-04-16T13:04:45.996762+0000","last_unstale":"2024-04-16T13:04:53.525853+0000","last_undegraded":"2024-04-16T13:04:53.525853+0000","last_fullsized":"2024-04-16T13:04:53.525853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129465+0000","last_change":"2024-04-16T13:04:46.008999+0000","last_active":"2024-04-16T13:04:53.129465+0000","last_peered":"2024-04-16T13:04:53.129465+0000","last_clean":"2024-04-16T13:04:53.129465+0000","last_became_active":"2024-04-16T13:04:46.008352+0000","last_became_peered":"2024-04-16T13:04:46.008352+0000","last_unstale":"2024-04-16T13:04:53.129465+0000","last_undegraded":"2024-04-16T13:04:53.129465+0000","last_fullsized":"2024-04-16T13:04:53.129465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136867+0000","last_change":"2024-04-16T13:04:46.005440+0000","last_active":"2024-04-16T13:04:53.136867+0000","last_peered":"2024-04-16T13:04:53.136867+0000","last_clean":"2024-04-16T13:04:53.136867+0000","last_became_active":"2024-04-16T13:04:46.002984+0000","last_became_peered":"2024-04-16T13:04:46.002984+0000","last_unstale":"2024-04-16T13:04:53.136867+0000","last_undegraded":"2024-04-16T13:04:53.136867+0000","last_fullsized":"2024-04-16T13:04:53.136867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138984+0000","last_change":"2024-04-16T13:04:46.009580+0000","last_active":"2024-04-16T13:04:52.138984+0000","last_peered":"2024-04-16T13:04:52.138984+0000","last_clean":"2024-04-16T13:04:52.138984+0000","last_became_active":"2024-04-16T13:04:46.008940+0000","last_became_peered":"2024-04-16T13:04:46.008940+0000","last_unstale":"2024-04-16T13:04:52.138984+0000","last_undegraded":"2024-04-16T13:04:52.138984+0000","last_fullsized":"2024-04-16T13:04:52.138984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527357+0000","last_change":"2024-04-16T13:04:46.007107+0000","last_active":"2024-04-16T13:04:53.527357+0000","last_peered":"2024-04-16T13:04:53.527357+0000","last_clean":"2024-04-16T13:04:53.527357+0000","last_became_active":"2024-04-16T13:04:46.006881+0000","last_became_peered":"2024-04-16T13:04:46.006881+0000","last_unstale":"2024-04-16T13:04:53.527357+0000","last_undegraded":"2024-04-16T13:04:53.527357+0000","last_fullsized":"2024-04-16T13:04:53.527357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:05:15.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:05:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.780+0000 7f1086600640 1 Processor -- start 2024-04-16T13:05:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.781+0000 7f1086600640 1 -- start start 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f1086600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10800cf510 0x7f10800ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f1086600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10800b92d0 con 0x7f10800cf8f0 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f1086600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10800b95b0 con 0x7f10800b8980 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f1086600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f10800b9890 con 0x7f10800cf510 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f107f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10800cf510 0x7f10800ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f107f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f10800cf510 0x7f10800ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52512/0 (socket says 172.21.15.67:52512) 2024-04-16T13:05:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f107f400640 1 -- 172.21.15.67:0/691280550 learned_addr learned my addr 172.21.15.67:0/691280550 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:15.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f1077e00640 1 --1- 172.21.15.67:0/691280550 >> v1:172.21.15.67:6789/0 conn(0x7f10800cf8f0 0x7f10800d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38176/0 (socket says 172.21.15.67:38176) 2024-04-16T13:05:15.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f107f400640 1 -- 172.21.15.67:0/691280550 >> v1:172.21.15.82:6789/0 conn(0x7f10800b8980 legacy=0x7f10800d3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:15.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.782+0000 7f107f400640 1 -- 172.21.15.67:0/691280550 >> v1:172.21.15.67:6789/0 conn(0x7f10800cf8f0 legacy=0x7f10800d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.783+0000 7f107f400640 1 -- 172.21.15.67:0/691280550 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10800b9b70 con 0x7f10800cf510 2024-04-16T13:05:15.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.783+0000 7f107ea00640 1 -- 172.21.15.67:0/691280550 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256647220 0 0) 0x7f10800b92d0 con 0x7f10800cf8f0 2024-04-16T13:05:15.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.784+0000 7f107f400640 1 --2- 172.21.15.67:0/691280550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10800ba410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e7ac241010e0a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.784+0000 7f107ea00640 1 -- 172.21.15.67:0/691280550 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070035020 con 0x7f10800cf510 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.784+0000 7f107ea00640 1 -- 172.21.15.67:0/691280550 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1070031870 con 0x7f10800cf510 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.784+0000 7f107ea00640 1 -- 172.21.15.67:0/691280550 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070031c40 con 0x7f10800cf510 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 -- 172.21.15.67:0/691280550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 msgr2=0x7f10800ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 --2- 172.21.15.67:0/691280550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10800ba410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107002b910 comp rx=0 tx=0).stop 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 -- 172.21.15.67:0/691280550 shutdown_connections 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 --2- 172.21.15.67:0/691280550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10800ba410 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 -- 172.21.15.67:0/691280550 >> 172.21.15.67:0/691280550 conn(0x7f1080067b50 msgr2=0x7f1080067f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 -- 172.21.15.67:0/691280550 shutdown_connections 2024-04-16T13:05:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.785+0000 7f1086600640 1 -- 172.21.15.67:0/691280550 wait complete. 2024-04-16T13:05:15.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.786+0000 7f1086600640 1 Processor -- start 2024-04-16T13:05:15.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 -- start start 2024-04-16T13:05:15.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10800b8980 0x7f10800cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10800cf8f0 0x7f10801e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f108015edb0 con 0x7f10800cf510 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f108015ec30 con 0x7f10800b8980 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.787+0000 7f1086600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f10800b8d60 con 0x7f10800cf8f0 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52522/0 (socket says 172.21.15.67:52522) 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 -- 172.21.15.67:0/951536725 learned_addr learned my addr 172.21.15.67:0/951536725 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f107f400640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10800b8980 0x7f10800cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f107fe00640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10800cf8f0 0x7f10801e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 -- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10800cf8f0 msgr2=0x7f10801e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10800cf8f0 0x7f10801e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 -- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10800b8980 msgr2=0x7f10800cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:15.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10800b8980 0x7f10800cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:15.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.788+0000 7f1077e00640 1 -- 172.21.15.67:0/951536725 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10801e8aa0 con 0x7f10800cf510 2024-04-16T13:05:15.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1077e00640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f106800c430 tx=0x7f106800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680074e0 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10680047e0 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068004bd0 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10801e8d50 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.789+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10801f60e0 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.790+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10801f5c30 con 0x7f10800cf510 2024-04-16T13:05:15.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.791+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1068011070 con 0x7f10800cf510 2024-04-16T13:05:15.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.792+0000 7f1077400640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 0x7f105c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:15.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.792+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f106808bb70 con 0x7f10800cf510 2024-04-16T13:05:15.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.793+0000 7f107f400640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 0x7f105c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:15.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.794+0000 7f107f400640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 0x7f105c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1070036000 tx=0x7f107003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:15.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.799+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1068059c60 con 0x7f10800cf510 2024-04-16T13:05:15.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:15.995+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10800b6760 con 0x7f105c06c8f0 2024-04-16T13:05:16.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.018+0000 7f1077400640 1 -- 172.21.15.67:0/951536725 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f10800b6760 con 0x7f105c06c8f0 2024-04-16T13:05:16.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:16.026 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:05:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 msgr2=0x7f105c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 0x7f105c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1070036000 tx=0x7f107003c040 comp rx=0 tx=0).stop 2024-04-16T13:05:16.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 msgr2=0x7f10801e8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f106800c430 tx=0x7f106800c8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 shutdown_connections 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f105c06c8f0 0x7f105c06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f10800cf8f0 0x7f10801e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10800cf510 0x7f10801e8020 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 --2- 172.21.15.67:0/951536725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10800b8980 0x7f10800cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 >> 172.21.15.67:0/951536725 conn(0x7f1080067b50 msgr2=0x7f108015d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 shutdown_connections 2024-04-16T13:05:16.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.025+0000 7f1086600640 1 -- 172.21.15.67:0/951536725 wait complete. 2024-04-16T13:05:16.043 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-16T13:05:14.499998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3383296,"data_stored":2049160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005546"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.138090+0000","last_change":"2024-04-16T13:04:45.017212+0000","last_active":"2024-04-16T13:04:53.138090+0000","last_peered":"2024-04-16T13:04:53.138090+0000","last_clean":"2024-04-16T13:04:53.138090+0000","last_became_active":"2024-04-16T13:04:45.016908+0000","last_became_peered":"2024-04-16T13:04:45.016908+0000","last_unstale":"2024-04-16T13:04:53.138090+0000","last_undegraded":"2024-04-16T13:04:53.138090+0000","last_fullsized":"2024-04-16T13:04:53.138090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:53:15.736911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141192+0000","last_change":"2024-04-16T13:04:46.029051+0000","last_active":"2024-04-16T13:04:52.141192+0000","last_peered":"2024-04-16T13:04:52.141192+0000","last_clean":"2024-04-16T13:04:52.141192+0000","last_became_active":"2024-04-16T13:04:46.028414+0000","last_became_peered":"2024-04-16T13:04:46.028414+0000","last_unstale":"2024-04-16T13:04:52.141192+0000","last_undegraded":"2024-04-16T13:04:52.141192+0000","last_fullsized":"2024-04-16T13:04:52.141192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140594+0000","last_change":"2024-04-16T13:04:50.716406+0000","last_active":"2024-04-16T13:04:52.140594+0000","last_peered":"2024-04-16T13:04:52.140594+0000","last_clean":"2024-04-16T13:04:52.140594+0000","last_became_active":"2024-04-16T13:04:50.715298+0000","last_became_peered":"2024-04-16T13:04:50.715298+0000","last_unstale":"2024-04-16T13:04:52.140594+0000","last_undegraded":"2024-04-16T13:04:52.140594+0000","last_fullsized":"2024-04-16T13:04:52.140594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:35.233459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141394+0000","last_change":"2024-04-16T13:04:45.011371+0000","last_active":"2024-04-16T13:04:52.141394+0000","last_peered":"2024-04-16T13:04:52.141394+0000","last_clean":"2024-04-16T13:04:52.141394+0000","last_became_active":"2024-04-16T13:04:45.010921+0000","last_became_peered":"2024-04-16T13:04:45.010921+0000","last_unstale":"2024-04-16T13:04:52.141394+0000","last_undegraded":"2024-04-16T13:04:52.141394+0000","last_fullsized":"2024-04-16T13:04:52.141394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137685+0000","last_change":"2024-04-16T13:04:46.010566+0000","last_active":"2024-04-16T13:04:53.137685+0000","last_peered":"2024-04-16T13:04:53.137685+0000","last_clean":"2024-04-16T13:04:53.137685+0000","last_became_active":"2024-04-16T13:04:46.010271+0000","last_became_peered":"2024-04-16T13:04:46.010271+0000","last_unstale":"2024-04-16T13:04:53.137685+0000","last_undegraded":"2024-04-16T13:04:53.137685+0000","last_fullsized":"2024-04-16T13:04:53.137685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141893+0000","last_change":"2024-04-16T13:04:50.172684+0000","last_active":"2024-04-16T13:04:52.141893+0000","last_peered":"2024-04-16T13:04:52.141893+0000","last_clean":"2024-04-16T13:04:52.141893+0000","last_became_active":"2024-04-16T13:04:50.171569+0000","last_became_peered":"2024-04-16T13:04:50.171569+0000","last_unstale":"2024-04-16T13:04:52.141893+0000","last_undegraded":"2024-04-16T13:04:52.141893+0000","last_fullsized":"2024-04-16T13:04:52.141893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525149+0000","last_change":"2024-04-16T13:04:45.024578+0000","last_active":"2024-04-16T13:04:53.525149+0000","last_peered":"2024-04-16T13:04:53.525149+0000","last_clean":"2024-04-16T13:04:53.525149+0000","last_became_active":"2024-04-16T13:04:45.024333+0000","last_became_peered":"2024-04-16T13:04:45.024333+0000","last_unstale":"2024-04-16T13:04:53.525149+0000","last_undegraded":"2024-04-16T13:04:53.525149+0000","last_fullsized":"2024-04-16T13:04:53.525149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129517+0000","last_change":"2024-04-16T13:04:46.009310+0000","last_active":"2024-04-16T13:04:53.129517+0000","last_peered":"2024-04-16T13:04:53.129517+0000","last_clean":"2024-04-16T13:04:53.129517+0000","last_became_active":"2024-04-16T13:04:46.008657+0000","last_became_peered":"2024-04-16T13:04:46.008657+0000","last_unstale":"2024-04-16T13:04:53.129517+0000","last_undegraded":"2024-04-16T13:04:53.129517+0000","last_fullsized":"2024-04-16T13:04:53.129517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143101+0000","last_change":"2024-04-16T13:04:50.166861+0000","last_active":"2024-04-16T13:04:52.143101+0000","last_peered":"2024-04-16T13:04:52.143101+0000","last_clean":"2024-04-16T13:04:52.143101+0000","last_became_active":"2024-04-16T13:04:50.166201+0000","last_became_peered":"2024-04-16T13:04:50.166201+0000","last_unstale":"2024-04-16T13:04:52.143101+0000","last_undegraded":"2024-04-16T13:04:52.143101+0000","last_fullsized":"2024-04-16T13:04:52.143101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526586+0000","last_change":"2024-04-16T13:04:45.022779+0000","last_active":"2024-04-16T13:04:53.526586+0000","last_peered":"2024-04-16T13:04:53.526586+0000","last_clean":"2024-04-16T13:04:53.526586+0000","last_became_active":"2024-04-16T13:04:45.022445+0000","last_became_peered":"2024-04-16T13:04:45.022445+0000","last_unstale":"2024-04-16T13:04:53.526586+0000","last_undegraded":"2024-04-16T13:04:53.526586+0000","last_fullsized":"2024-04-16T13:04:53.526586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:35.238732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129942+0000","last_change":"2024-04-16T13:04:46.008470+0000","last_active":"2024-04-16T13:04:53.129942+0000","last_peered":"2024-04-16T13:04:53.129942+0000","last_clean":"2024-04-16T13:04:53.129942+0000","last_became_active":"2024-04-16T13:04:46.007901+0000","last_became_peered":"2024-04-16T13:04:46.007901+0000","last_unstale":"2024-04-16T13:04:53.129942+0000","last_undegraded":"2024-04-16T13:04:53.129942+0000","last_fullsized":"2024-04-16T13:04:53.129942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142378+0000","last_change":"2024-04-16T13:04:50.163286+0000","last_active":"2024-04-16T13:04:52.142378+0000","last_peered":"2024-04-16T13:04:52.142378+0000","last_clean":"2024-04-16T13:04:52.142378+0000","last_became_active":"2024-04-16T13:04:50.161658+0000","last_became_peered":"2024-04-16T13:04:50.161658+0000","last_unstale":"2024-04-16T13:04:52.142378+0000","last_undegraded":"2024-04-16T13:04:52.142378+0000","last_fullsized":"2024-04-16T13:04:52.142378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015548+0000","last_change":"2024-04-16T13:04:46.014646+0000","last_active":"2024-04-16T13:04:53.015548+0000","last_peered":"2024-04-16T13:04:53.015548+0000","last_clean":"2024-04-16T13:04:53.015548+0000","last_became_active":"2024-04-16T13:04:46.014332+0000","last_became_peered":"2024-04-16T13:04:46.014332+0000","last_unstale":"2024-04-16T13:04:53.015548+0000","last_undegraded":"2024-04-16T13:04:53.015548+0000","last_fullsized":"2024-04-16T13:04:53.015548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525140+0000","last_change":"2024-04-16T13:04:45.018345+0000","last_active":"2024-04-16T13:04:53.525140+0000","last_peered":"2024-04-16T13:04:53.525140+0000","last_clean":"2024-04-16T13:04:53.525140+0000","last_became_active":"2024-04-16T13:04:45.018023+0000","last_became_peered":"2024-04-16T13:04:45.018023+0000","last_unstale":"2024-04-16T13:04:53.525140+0000","last_undegraded":"2024-04-16T13:04:53.525140+0000","last_fullsized":"2024-04-16T13:04:53.525140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144101+0000","last_change":"2024-04-16T13:04:50.166377+0000","last_active":"2024-04-16T13:04:52.144101+0000","last_peered":"2024-04-16T13:04:52.144101+0000","last_clean":"2024-04-16T13:04:52.144101+0000","last_became_active":"2024-04-16T13:04:50.165706+0000","last_became_peered":"2024-04-16T13:04:50.165706+0000","last_unstale":"2024-04-16T13:04:52.144101+0000","last_undegraded":"2024-04-16T13:04:52.144101+0000","last_fullsized":"2024-04-16T13:04:52.144101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140626+0000","last_change":"2024-04-16T13:04:46.004518+0000","last_active":"2024-04-16T13:04:52.140626+0000","last_peered":"2024-04-16T13:04:52.140626+0000","last_clean":"2024-04-16T13:04:52.140626+0000","last_became_active":"2024-04-16T13:04:46.004307+0000","last_became_peered":"2024-04-16T13:04:46.004307+0000","last_unstale":"2024-04-16T13:04:52.140626+0000","last_undegraded":"2024-04-16T13:04:52.140626+0000","last_fullsized":"2024-04-16T13:04:52.140626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137806+0000","last_change":"2024-04-16T13:04:44.994353+0000","last_active":"2024-04-16T13:04:52.137806+0000","last_peered":"2024-04-16T13:04:52.137806+0000","last_clean":"2024-04-16T13:04:52.137806+0000","last_became_active":"2024-04-16T13:04:44.993983+0000","last_became_peered":"2024-04-16T13:04:44.993983+0000","last_unstale":"2024-04-16T13:04:52.137806+0000","last_undegraded":"2024-04-16T13:04:52.137806+0000","last_fullsized":"2024-04-16T13:04:52.137806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144015+0000","last_change":"2024-04-16T13:04:50.172131+0000","last_active":"2024-04-16T13:04:52.144015+0000","last_peered":"2024-04-16T13:04:52.144015+0000","last_clean":"2024-04-16T13:04:52.144015+0000","last_became_active":"2024-04-16T13:04:50.171610+0000","last_became_peered":"2024-04-16T13:04:50.171610+0000","last_unstale":"2024-04-16T13:04:52.144015+0000","last_undegraded":"2024-04-16T13:04:52.144015+0000","last_fullsized":"2024-04-16T13:04:52.144015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140915+0000","last_change":"2024-04-16T13:04:46.006324+0000","last_active":"2024-04-16T13:04:52.140915+0000","last_peered":"2024-04-16T13:04:52.140915+0000","last_clean":"2024-04-16T13:04:52.140915+0000","last_became_active":"2024-04-16T13:04:46.005807+0000","last_became_peered":"2024-04-16T13:04:46.005807+0000","last_unstale":"2024-04-16T13:04:52.140915+0000","last_undegraded":"2024-04-16T13:04:52.140915+0000","last_fullsized":"2024-04-16T13:04:52.140915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137099+0000","last_change":"2024-04-16T13:04:45.000438+0000","last_active":"2024-04-16T13:04:52.137099+0000","last_peered":"2024-04-16T13:04:52.137099+0000","last_clean":"2024-04-16T13:04:52.137099+0000","last_became_active":"2024-04-16T13:04:45.000089+0000","last_became_peered":"2024-04-16T13:04:45.000089+0000","last_unstale":"2024-04-16T13:04:52.137099+0000","last_undegraded":"2024-04-16T13:04:52.137099+0000","last_fullsized":"2024-04-16T13:04:52.137099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139470+0000","last_change":"2024-04-16T13:04:50.711220+0000","last_active":"2024-04-16T13:04:52.139470+0000","last_peered":"2024-04-16T13:04:52.139470+0000","last_clean":"2024-04-16T13:04:52.139470+0000","last_became_active":"2024-04-16T13:04:50.709851+0000","last_became_peered":"2024-04-16T13:04:50.709851+0000","last_unstale":"2024-04-16T13:04:52.139470+0000","last_undegraded":"2024-04-16T13:04:52.139470+0000","last_fullsized":"2024-04-16T13:04:52.139470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142413+0000","last_change":"2024-04-16T13:04:46.003322+0000","last_active":"2024-04-16T13:04:52.142413+0000","last_peered":"2024-04-16T13:04:52.142413+0000","last_clean":"2024-04-16T13:04:52.142413+0000","last_became_active":"2024-04-16T13:04:46.003054+0000","last_became_peered":"2024-04-16T13:04:46.003054+0000","last_unstale":"2024-04-16T13:04:52.142413+0000","last_undegraded":"2024-04-16T13:04:52.142413+0000","last_fullsized":"2024-04-16T13:04:52.142413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:20.324354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525718+0000","last_change":"2024-04-16T13:04:45.017508+0000","last_active":"2024-04-16T13:04:53.525718+0000","last_peered":"2024-04-16T13:04:53.525718+0000","last_clean":"2024-04-16T13:04:53.525718+0000","last_became_active":"2024-04-16T13:04:45.017191+0000","last_became_peered":"2024-04-16T13:04:45.017191+0000","last_unstale":"2024-04-16T13:04:53.525718+0000","last_undegraded":"2024-04-16T13:04:53.525718+0000","last_fullsized":"2024-04-16T13:04:53.525718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143665+0000","last_change":"2024-04-16T13:04:50.172094+0000","last_active":"2024-04-16T13:04:52.143665+0000","last_peered":"2024-04-16T13:04:52.143665+0000","last_clean":"2024-04-16T13:04:52.143665+0000","last_became_active":"2024-04-16T13:04:50.171583+0000","last_became_peered":"2024-04-16T13:04:50.171583+0000","last_unstale":"2024-04-16T13:04:52.143665+0000","last_undegraded":"2024-04-16T13:04:52.143665+0000","last_fullsized":"2024-04-16T13:04:52.143665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137578+0000","last_change":"2024-04-16T13:04:46.006452+0000","last_active":"2024-04-16T13:04:53.137578+0000","last_peered":"2024-04-16T13:04:53.137578+0000","last_clean":"2024-04-16T13:04:53.137578+0000","last_became_active":"2024-04-16T13:04:46.006110+0000","last_became_peered":"2024-04-16T13:04:46.006110+0000","last_unstale":"2024-04-16T13:04:53.137578+0000","last_undegraded":"2024-04-16T13:04:53.137578+0000","last_fullsized":"2024-04-16T13:04:53.137578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016559+0000","last_change":"2024-04-16T13:04:45.017007+0000","last_active":"2024-04-16T13:04:53.016559+0000","last_peered":"2024-04-16T13:04:53.016559+0000","last_clean":"2024-04-16T13:04:53.016559+0000","last_became_active":"2024-04-16T13:04:45.016628+0000","last_became_peered":"2024-04-16T13:04:45.016628+0000","last_unstale":"2024-04-16T13:04:53.016559+0000","last_undegraded":"2024-04-16T13:04:53.016559+0000","last_fullsized":"2024-04-16T13:04:53.016559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141982+0000","last_change":"2024-04-16T13:04:50.714894+0000","last_active":"2024-04-16T13:04:52.141982+0000","last_peered":"2024-04-16T13:04:52.141982+0000","last_clean":"2024-04-16T13:04:52.141982+0000","last_became_active":"2024-04-16T13:04:50.707478+0000","last_became_peered":"2024-04-16T13:04:50.707478+0000","last_unstale":"2024-04-16T13:04:52.141982+0000","last_undegraded":"2024-04-16T13:04:52.141982+0000","last_fullsized":"2024-04-16T13:04:52.141982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141377+0000","last_change":"2024-04-16T13:04:45.998408+0000","last_active":"2024-04-16T13:04:52.141377+0000","last_peered":"2024-04-16T13:04:52.141377+0000","last_clean":"2024-04-16T13:04:52.141377+0000","last_became_active":"2024-04-16T13:04:45.998086+0000","last_became_peered":"2024-04-16T13:04:45.998086+0000","last_unstale":"2024-04-16T13:04:52.141377+0000","last_undegraded":"2024-04-16T13:04:52.141377+0000","last_fullsized":"2024-04-16T13:04:52.141377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139111+0000","last_change":"2024-04-16T13:04:45.006718+0000","last_active":"2024-04-16T13:04:52.139111+0000","last_peered":"2024-04-16T13:04:52.139111+0000","last_clean":"2024-04-16T13:04:52.139111+0000","last_became_active":"2024-04-16T13:04:45.006418+0000","last_became_peered":"2024-04-16T13:04:45.006418+0000","last_unstale":"2024-04-16T13:04:52.139111+0000","last_undegraded":"2024-04-16T13:04:52.139111+0000","last_fullsized":"2024-04-16T13:04:52.139111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140164+0000","last_change":"2024-04-16T13:04:50.699284+0000","last_active":"2024-04-16T13:04:52.140164+0000","last_peered":"2024-04-16T13:04:52.140164+0000","last_clean":"2024-04-16T13:04:52.140164+0000","last_became_active":"2024-04-16T13:04:50.696999+0000","last_became_peered":"2024-04-16T13:04:50.696999+0000","last_unstale":"2024-04-16T13:04:52.140164+0000","last_undegraded":"2024-04-16T13:04:52.140164+0000","last_fullsized":"2024-04-16T13:04:52.140164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:47:43.788831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138077+0000","last_change":"2024-04-16T13:04:45.996654+0000","last_active":"2024-04-16T13:04:52.138077+0000","last_peered":"2024-04-16T13:04:52.138077+0000","last_clean":"2024-04-16T13:04:52.138077+0000","last_became_active":"2024-04-16T13:04:45.996251+0000","last_became_peered":"2024-04-16T13:04:45.996251+0000","last_unstale":"2024-04-16T13:04:52.138077+0000","last_undegraded":"2024-04-16T13:04:52.138077+0000","last_fullsized":"2024-04-16T13:04:52.138077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527291+0000","last_change":"2024-04-16T13:04:45.018375+0000","last_active":"2024-04-16T13:04:53.527291+0000","last_peered":"2024-04-16T13:04:53.527291+0000","last_clean":"2024-04-16T13:04:53.527291+0000","last_became_active":"2024-04-16T13:04:45.018125+0000","last_became_peered":"2024-04-16T13:04:45.018125+0000","last_unstale":"2024-04-16T13:04:53.527291+0000","last_undegraded":"2024-04-16T13:04:53.527291+0000","last_fullsized":"2024-04-16T13:04:53.527291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:38.002313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137111+0000","last_change":"2024-04-16T13:04:50.698690+0000","last_active":"2024-04-16T13:04:53.137111+0000","last_peered":"2024-04-16T13:04:53.137111+0000","last_clean":"2024-04-16T13:04:53.137111+0000","last_became_active":"2024-04-16T13:04:50.697358+0000","last_became_peered":"2024-04-16T13:04:50.697358+0000","last_unstale":"2024-04-16T13:04:53.137111+0000","last_undegraded":"2024-04-16T13:04:53.137111+0000","last_fullsized":"2024-04-16T13:04:53.137111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130111+0000","last_change":"2024-04-16T13:04:46.007829+0000","last_active":"2024-04-16T13:04:53.130111+0000","last_peered":"2024-04-16T13:04:53.130111+0000","last_clean":"2024-04-16T13:04:53.130111+0000","last_became_active":"2024-04-16T13:04:46.007537+0000","last_became_peered":"2024-04-16T13:04:46.007537+0000","last_unstale":"2024-04-16T13:04:53.130111+0000","last_undegraded":"2024-04-16T13:04:53.130111+0000","last_fullsized":"2024-04-16T13:04:53.130111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138200+0000","last_change":"2024-04-16T13:04:45.008507+0000","last_active":"2024-04-16T13:04:52.138200+0000","last_peered":"2024-04-16T13:04:52.138200+0000","last_clean":"2024-04-16T13:04:52.138200+0000","last_became_active":"2024-04-16T13:04:45.008217+0000","last_became_peered":"2024-04-16T13:04:45.008217+0000","last_unstale":"2024-04-16T13:04:52.138200+0000","last_undegraded":"2024-04-16T13:04:52.138200+0000","last_fullsized":"2024-04-16T13:04:52.138200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:41.755554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137403+0000","last_change":"2024-04-16T13:04:50.167171+0000","last_active":"2024-04-16T13:04:52.137403+0000","last_peered":"2024-04-16T13:04:52.137403+0000","last_clean":"2024-04-16T13:04:52.137403+0000","last_became_active":"2024-04-16T13:04:50.164681+0000","last_became_peered":"2024-04-16T13:04:50.164681+0000","last_unstale":"2024-04-16T13:04:52.137403+0000","last_undegraded":"2024-04-16T13:04:52.137403+0000","last_fullsized":"2024-04-16T13:04:52.137403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143872+0000","last_change":"2024-04-16T13:04:46.021438+0000","last_active":"2024-04-16T13:04:52.143872+0000","last_peered":"2024-04-16T13:04:52.143872+0000","last_clean":"2024-04-16T13:04:52.143872+0000","last_became_active":"2024-04-16T13:04:46.021184+0000","last_became_peered":"2024-04-16T13:04:46.021184+0000","last_unstale":"2024-04-16T13:04:52.143872+0000","last_undegraded":"2024-04-16T13:04:52.143872+0000","last_fullsized":"2024-04-16T13:04:52.143872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:49.055670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127965+0000","last_change":"2024-04-16T13:04:45.014922+0000","last_active":"2024-04-16T13:04:53.127965+0000","last_peered":"2024-04-16T13:04:53.127965+0000","last_clean":"2024-04-16T13:04:53.127965+0000","last_became_active":"2024-04-16T13:04:45.014037+0000","last_became_peered":"2024-04-16T13:04:45.014037+0000","last_unstale":"2024-04-16T13:04:53.127965+0000","last_undegraded":"2024-04-16T13:04:53.127965+0000","last_fullsized":"2024-04-16T13:04:53.127965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138224+0000","last_change":"2024-04-16T13:04:50.172451+0000","last_active":"2024-04-16T13:04:52.138224+0000","last_peered":"2024-04-16T13:04:52.138224+0000","last_clean":"2024-04-16T13:04:52.138224+0000","last_became_active":"2024-04-16T13:04:50.171709+0000","last_became_peered":"2024-04-16T13:04:50.171709+0000","last_unstale":"2024-04-16T13:04:52.138224+0000","last_undegraded":"2024-04-16T13:04:52.138224+0000","last_fullsized":"2024-04-16T13:04:52.138224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136931+0000","last_change":"2024-04-16T13:04:45.990241+0000","last_active":"2024-04-16T13:04:52.136931+0000","last_peered":"2024-04-16T13:04:52.136931+0000","last_clean":"2024-04-16T13:04:52.136931+0000","last_became_active":"2024-04-16T13:04:45.989713+0000","last_became_peered":"2024-04-16T13:04:45.989713+0000","last_unstale":"2024-04-16T13:04:52.136931+0000","last_undegraded":"2024-04-16T13:04:52.136931+0000","last_fullsized":"2024-04-16T13:04:52.136931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017464+0000","last_change":"2024-04-16T13:04:44.999454+0000","last_active":"2024-04-16T13:04:53.017464+0000","last_peered":"2024-04-16T13:04:53.017464+0000","last_clean":"2024-04-16T13:04:53.017464+0000","last_became_active":"2024-04-16T13:04:44.999166+0000","last_became_peered":"2024-04-16T13:04:44.999166+0000","last_unstale":"2024-04-16T13:04:53.017464+0000","last_undegraded":"2024-04-16T13:04:53.017464+0000","last_fullsized":"2024-04-16T13:04:53.017464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.139649+0000","last_change":"2024-04-16T13:04:50.166374+0000","last_active":"2024-04-16T13:04:52.139649+0000","last_peered":"2024-04-16T13:04:52.139649+0000","last_clean":"2024-04-16T13:04:52.139649+0000","last_became_active":"2024-04-16T13:04:50.166029+0000","last_became_peered":"2024-04-16T13:04:50.166029+0000","last_unstale":"2024-04-16T13:04:52.139649+0000","last_undegraded":"2024-04-16T13:04:52.139649+0000","last_fullsized":"2024-04-16T13:04:52.139649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136502+0000","last_change":"2024-04-16T13:04:46.013116+0000","last_active":"2024-04-16T13:04:53.136502+0000","last_peered":"2024-04-16T13:04:53.136502+0000","last_clean":"2024-04-16T13:04:53.136502+0000","last_became_active":"2024-04-16T13:04:46.012724+0000","last_became_peered":"2024-04-16T13:04:46.012724+0000","last_unstale":"2024-04-16T13:04:53.136502+0000","last_undegraded":"2024-04-16T13:04:53.136502+0000","last_fullsized":"2024-04-16T13:04:53.136502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525117+0000","last_change":"2024-04-16T13:04:45.022061+0000","last_active":"2024-04-16T13:04:53.525117+0000","last_peered":"2024-04-16T13:04:53.525117+0000","last_clean":"2024-04-16T13:04:53.525117+0000","last_became_active":"2024-04-16T13:04:45.021784+0000","last_became_peered":"2024-04-16T13:04:45.021784+0000","last_unstale":"2024-04-16T13:04:53.525117+0000","last_undegraded":"2024-04-16T13:04:53.525117+0000","last_fullsized":"2024-04-16T13:04:53.525117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137504+0000","last_change":"2024-04-16T13:04:50.698726+0000","last_active":"2024-04-16T13:04:53.137504+0000","last_peered":"2024-04-16T13:04:53.137504+0000","last_clean":"2024-04-16T13:04:53.137504+0000","last_became_active":"2024-04-16T13:04:50.697335+0000","last_became_peered":"2024-04-16T13:04:50.697335+0000","last_unstale":"2024-04-16T13:04:53.137504+0000","last_undegraded":"2024-04-16T13:04:53.137504+0000","last_fullsized":"2024-04-16T13:04:53.137504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:21:49.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140431+0000","last_change":"2024-04-16T13:04:46.007441+0000","last_active":"2024-04-16T13:04:52.140431+0000","last_peered":"2024-04-16T13:04:52.140431+0000","last_clean":"2024-04-16T13:04:52.140431+0000","last_became_active":"2024-04-16T13:04:46.006232+0000","last_became_peered":"2024-04-16T13:04:46.006232+0000","last_unstale":"2024-04-16T13:04:52.140431+0000","last_undegraded":"2024-04-16T13:04:52.140431+0000","last_fullsized":"2024-04-16T13:04:52.140431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129402+0000","last_change":"2024-04-16T13:04:45.014153+0000","last_active":"2024-04-16T13:04:53.129402+0000","last_peered":"2024-04-16T13:04:53.129402+0000","last_clean":"2024-04-16T13:04:53.129402+0000","last_became_active":"2024-04-16T13:04:45.012884+0000","last_became_peered":"2024-04-16T13:04:45.012884+0000","last_unstale":"2024-04-16T13:04:53.129402+0000","last_undegraded":"2024-04-16T13:04:53.129402+0000","last_fullsized":"2024-04-16T13:04:53.129402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525920+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:04:53.525920+0000","last_peered":"2024-04-16T13:04:53.525920+0000","last_clean":"2024-04-16T13:04:53.525920+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:04:53.525920+0000","last_undegraded":"2024-04-16T13:04:53.525920+0000","last_fullsized":"2024-04-16T13:04:53.525920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017152+0000","last_change":"2024-04-16T13:04:50.706193+0000","last_active":"2024-04-16T13:04:53.017152+0000","last_peered":"2024-04-16T13:04:53.017152+0000","last_clean":"2024-04-16T13:04:53.017152+0000","last_became_active":"2024-04-16T13:04:50.705129+0000","last_became_peered":"2024-04-16T13:04:50.705129+0000","last_unstale":"2024-04-16T13:04:53.017152+0000","last_undegraded":"2024-04-16T13:04:53.017152+0000","last_fullsized":"2024-04-16T13:04:53.017152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:15:02.576299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526940+0000","last_change":"2024-04-16T13:04:46.010068+0000","last_active":"2024-04-16T13:04:53.526940+0000","last_peered":"2024-04-16T13:04:53.526940+0000","last_clean":"2024-04-16T13:04:53.526940+0000","last_became_active":"2024-04-16T13:04:46.009661+0000","last_became_peered":"2024-04-16T13:04:46.009661+0000","last_unstale":"2024-04-16T13:04:53.526940+0000","last_undegraded":"2024-04-16T13:04:53.526940+0000","last_fullsized":"2024-04-16T13:04:53.526940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:26:26.632765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018774+0000","last_change":"2024-04-16T13:04:45.009675+0000","last_active":"2024-04-16T13:04:53.018774+0000","last_peered":"2024-04-16T13:04:53.018774+0000","last_clean":"2024-04-16T13:04:53.018774+0000","last_became_active":"2024-04-16T13:04:45.009208+0000","last_became_peered":"2024-04-16T13:04:45.009208+0000","last_unstale":"2024-04-16T13:04:53.018774+0000","last_undegraded":"2024-04-16T13:04:53.018774+0000","last_fullsized":"2024-04-16T13:04:53.018774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015724+0000","last_change":"2024-04-16T13:04:50.700561+0000","last_active":"2024-04-16T13:04:53.015724+0000","last_peered":"2024-04-16T13:04:53.015724+0000","last_clean":"2024-04-16T13:04:53.015724+0000","last_became_active":"2024-04-16T13:04:50.697511+0000","last_became_peered":"2024-04-16T13:04:50.697511+0000","last_unstale":"2024-04-16T13:04:53.015724+0000","last_undegraded":"2024-04-16T13:04:53.015724+0000","last_fullsized":"2024-04-16T13:04:53.015724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:54.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129832+0000","last_change":"2024-04-16T13:04:46.008012+0000","last_active":"2024-04-16T13:04:53.129832+0000","last_peered":"2024-04-16T13:04:53.129832+0000","last_clean":"2024-04-16T13:04:53.129832+0000","last_became_active":"2024-04-16T13:04:46.007687+0000","last_became_peered":"2024-04-16T13:04:46.007687+0000","last_unstale":"2024-04-16T13:04:53.129832+0000","last_undegraded":"2024-04-16T13:04:53.129832+0000","last_fullsized":"2024-04-16T13:04:53.129832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138728+0000","last_change":"2024-04-16T13:04:45.003115+0000","last_active":"2024-04-16T13:04:52.138728+0000","last_peered":"2024-04-16T13:04:52.138728+0000","last_clean":"2024-04-16T13:04:52.138728+0000","last_became_active":"2024-04-16T13:04:45.002827+0000","last_became_peered":"2024-04-16T13:04:45.002827+0000","last_unstale":"2024-04-16T13:04:52.138728+0000","last_undegraded":"2024-04-16T13:04:52.138728+0000","last_fullsized":"2024-04-16T13:04:52.138728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:39.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137007+0000","last_change":"2024-04-16T13:04:50.170429+0000","last_active":"2024-04-16T13:04:53.137007+0000","last_peered":"2024-04-16T13:04:53.137007+0000","last_clean":"2024-04-16T13:04:53.137007+0000","last_became_active":"2024-04-16T13:04:50.168276+0000","last_became_peered":"2024-04-16T13:04:50.168276+0000","last_unstale":"2024-04-16T13:04:53.137007+0000","last_undegraded":"2024-04-16T13:04:53.137007+0000","last_fullsized":"2024-04-16T13:04:53.137007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:18.283559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527648+0000","last_change":"2024-04-16T13:04:45.996001+0000","last_active":"2024-04-16T13:04:53.527648+0000","last_peered":"2024-04-16T13:04:53.527648+0000","last_clean":"2024-04-16T13:04:53.527648+0000","last_became_active":"2024-04-16T13:04:45.994462+0000","last_became_peered":"2024-04-16T13:04:45.994462+0000","last_unstale":"2024-04-16T13:04:53.527648+0000","last_undegraded":"2024-04-16T13:04:53.527648+0000","last_fullsized":"2024-04-16T13:04:53.527648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:45:14.137296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017648+0000","last_change":"2024-04-16T13:04:45.001424+0000","last_active":"2024-04-16T13:04:53.017648+0000","last_peered":"2024-04-16T13:04:53.017648+0000","last_clean":"2024-04-16T13:04:53.017648+0000","last_became_active":"2024-04-16T13:04:45.001151+0000","last_became_peered":"2024-04-16T13:04:45.001151+0000","last_unstale":"2024-04-16T13:04:53.017648+0000","last_undegraded":"2024-04-16T13:04:53.017648+0000","last_fullsized":"2024-04-16T13:04:53.017648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128506+0000","last_change":"2024-04-16T13:04:50.711246+0000","last_active":"2024-04-16T13:04:53.128506+0000","last_peered":"2024-04-16T13:04:53.128506+0000","last_clean":"2024-04-16T13:04:53.128506+0000","last_became_active":"2024-04-16T13:04:50.704394+0000","last_became_peered":"2024-04-16T13:04:50.704394+0000","last_unstale":"2024-04-16T13:04:53.128506+0000","last_undegraded":"2024-04-16T13:04:53.128506+0000","last_fullsized":"2024-04-16T13:04:53.128506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:43:15.746451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526983+0000","last_change":"2024-04-16T13:04:45.985184+0000","last_active":"2024-04-16T13:04:53.526983+0000","last_peered":"2024-04-16T13:04:53.526983+0000","last_clean":"2024-04-16T13:04:53.526983+0000","last_became_active":"2024-04-16T13:04:45.984518+0000","last_became_peered":"2024-04-16T13:04:45.984518+0000","last_unstale":"2024-04-16T13:04:53.526983+0000","last_undegraded":"2024-04-16T13:04:53.526983+0000","last_fullsized":"2024-04-16T13:04:53.526983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:50.796920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.144199+0000","last_change":"2024-04-16T13:04:45.009363+0000","last_active":"2024-04-16T13:04:52.144199+0000","last_peered":"2024-04-16T13:04:52.144199+0000","last_clean":"2024-04-16T13:04:52.144199+0000","last_became_active":"2024-04-16T13:04:45.008983+0000","last_became_peered":"2024-04-16T13:04:45.008983+0000","last_unstale":"2024-04-16T13:04:52.144199+0000","last_undegraded":"2024-04-16T13:04:52.144199+0000","last_fullsized":"2024-04-16T13:04:52.144199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:08:10.185005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141720+0000","last_change":"2024-04-16T13:04:50.166542+0000","last_active":"2024-04-16T13:04:52.141720+0000","last_peered":"2024-04-16T13:04:52.141720+0000","last_clean":"2024-04-16T13:04:52.141720+0000","last_became_active":"2024-04-16T13:04:50.166094+0000","last_became_peered":"2024-04-16T13:04:50.166094+0000","last_unstale":"2024-04-16T13:04:52.141720+0000","last_undegraded":"2024-04-16T13:04:52.141720+0000","last_fullsized":"2024-04-16T13:04:52.141720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:02:03.750621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526209+0000","last_change":"2024-04-16T13:04:45.985012+0000","last_active":"2024-04-16T13:04:53.526209+0000","last_peered":"2024-04-16T13:04:53.526209+0000","last_clean":"2024-04-16T13:04:53.526209+0000","last_became_active":"2024-04-16T13:04:45.984021+0000","last_became_peered":"2024-04-16T13:04:45.984021+0000","last_unstale":"2024-04-16T13:04:53.526209+0000","last_undegraded":"2024-04-16T13:04:53.526209+0000","last_fullsized":"2024-04-16T13:04:53.526209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017519+0000","last_change":"2024-04-16T13:04:44.997650+0000","last_active":"2024-04-16T13:04:53.017519+0000","last_peered":"2024-04-16T13:04:53.017519+0000","last_clean":"2024-04-16T13:04:53.017519+0000","last_became_active":"2024-04-16T13:04:44.997334+0000","last_became_peered":"2024-04-16T13:04:44.997334+0000","last_unstale":"2024-04-16T13:04:53.017519+0000","last_undegraded":"2024-04-16T13:04:53.017519+0000","last_fullsized":"2024-04-16T13:04:53.017519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:08:33.247260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137461+0000","last_change":"2024-04-16T13:04:50.161820+0000","last_active":"2024-04-16T13:04:53.137461+0000","last_peered":"2024-04-16T13:04:53.137461+0000","last_clean":"2024-04-16T13:04:53.137461+0000","last_became_active":"2024-04-16T13:04:50.161334+0000","last_became_peered":"2024-04-16T13:04:50.161334+0000","last_unstale":"2024-04-16T13:04:53.137461+0000","last_undegraded":"2024-04-16T13:04:53.137461+0000","last_fullsized":"2024-04-16T13:04:53.137461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:41:13.567495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015516+0000","last_change":"2024-04-16T13:04:46.002411+0000","last_active":"2024-04-16T13:04:53.015516+0000","last_peered":"2024-04-16T13:04:53.015516+0000","last_clean":"2024-04-16T13:04:53.015516+0000","last_became_active":"2024-04-16T13:04:46.002107+0000","last_became_peered":"2024-04-16T13:04:46.002107+0000","last_unstale":"2024-04-16T13:04:53.015516+0000","last_undegraded":"2024-04-16T13:04:53.015516+0000","last_fullsized":"2024-04-16T13:04:53.015516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.014730+0000","last_change":"2024-04-16T13:04:45.013545+0000","last_active":"2024-04-16T13:04:53.014730+0000","last_peered":"2024-04-16T13:04:53.014730+0000","last_clean":"2024-04-16T13:04:53.014730+0000","last_became_active":"2024-04-16T13:04:45.013202+0000","last_became_peered":"2024-04-16T13:04:45.013202+0000","last_unstale":"2024-04-16T13:04:53.014730+0000","last_undegraded":"2024-04-16T13:04:53.014730+0000","last_fullsized":"2024-04-16T13:04:53.014730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141020+0000","last_change":"2024-04-16T13:04:50.708122+0000","last_active":"2024-04-16T13:04:52.141020+0000","last_peered":"2024-04-16T13:04:52.141020+0000","last_clean":"2024-04-16T13:04:52.141020+0000","last_became_active":"2024-04-16T13:04:50.706711+0000","last_became_peered":"2024-04-16T13:04:50.706711+0000","last_unstale":"2024-04-16T13:04:52.141020+0000","last_undegraded":"2024-04-16T13:04:52.141020+0000","last_fullsized":"2024-04-16T13:04:52.141020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:34.429700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526079+0000","last_change":"2024-04-16T13:04:45.988616+0000","last_active":"2024-04-16T13:04:53.526079+0000","last_peered":"2024-04-16T13:04:53.526079+0000","last_clean":"2024-04-16T13:04:53.526079+0000","last_became_active":"2024-04-16T13:04:45.986360+0000","last_became_peered":"2024-04-16T13:04:45.986360+0000","last_unstale":"2024-04-16T13:04:53.526079+0000","last_undegraded":"2024-04-16T13:04:53.526079+0000","last_fullsized":"2024-04-16T13:04:53.526079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127989+0000","last_change":"2024-04-16T13:04:45.014011+0000","last_active":"2024-04-16T13:04:53.127989+0000","last_peered":"2024-04-16T13:04:53.127989+0000","last_clean":"2024-04-16T13:04:53.127989+0000","last_became_active":"2024-04-16T13:04:45.013245+0000","last_became_peered":"2024-04-16T13:04:45.013245+0000","last_unstale":"2024-04-16T13:04:53.127989+0000","last_undegraded":"2024-04-16T13:04:53.127989+0000","last_fullsized":"2024-04-16T13:04:53.127989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141019+0000","last_change":"2024-04-16T13:04:50.699221+0000","last_active":"2024-04-16T13:04:52.141019+0000","last_peered":"2024-04-16T13:04:52.141019+0000","last_clean":"2024-04-16T13:04:52.141019+0000","last_became_active":"2024-04-16T13:04:50.697803+0000","last_became_peered":"2024-04-16T13:04:50.697803+0000","last_unstale":"2024-04-16T13:04:52.141019+0000","last_undegraded":"2024-04-16T13:04:52.141019+0000","last_fullsized":"2024-04-16T13:04:52.141019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:55.380620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136601+0000","last_change":"2024-04-16T13:04:46.012519+0000","last_active":"2024-04-16T13:04:53.136601+0000","last_peered":"2024-04-16T13:04:53.136601+0000","last_clean":"2024-04-16T13:04:53.136601+0000","last_became_active":"2024-04-16T13:04:46.001053+0000","last_became_peered":"2024-04-16T13:04:46.001053+0000","last_unstale":"2024-04-16T13:04:53.136601+0000","last_undegraded":"2024-04-16T13:04:53.136601+0000","last_fullsized":"2024-04-16T13:04:53.136601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.135925+0000","last_change":"2024-04-16T13:04:45.008591+0000","last_active":"2024-04-16T13:04:53.135925+0000","last_peered":"2024-04-16T13:04:53.135925+0000","last_clean":"2024-04-16T13:04:53.135925+0000","last_became_active":"2024-04-16T13:04:45.008078+0000","last_became_peered":"2024-04-16T13:04:45.008078+0000","last_unstale":"2024-04-16T13:04:53.135925+0000","last_undegraded":"2024-04-16T13:04:53.135925+0000","last_fullsized":"2024-04-16T13:04:53.135925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130019+0000","last_change":"2024-04-16T13:04:50.705924+0000","last_active":"2024-04-16T13:04:53.130019+0000","last_peered":"2024-04-16T13:04:53.130019+0000","last_clean":"2024-04-16T13:04:53.130019+0000","last_became_active":"2024-04-16T13:04:50.704821+0000","last_became_peered":"2024-04-16T13:04:50.704821+0000","last_unstale":"2024-04-16T13:04:53.130019+0000","last_undegraded":"2024-04-16T13:04:53.130019+0000","last_fullsized":"2024-04-16T13:04:53.130019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:35:11.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526614+0000","last_change":"2024-04-16T13:04:45.998493+0000","last_active":"2024-04-16T13:04:53.526614+0000","last_peered":"2024-04-16T13:04:53.526614+0000","last_clean":"2024-04-16T13:04:53.526614+0000","last_became_active":"2024-04-16T13:04:45.998193+0000","last_became_peered":"2024-04-16T13:04:45.998193+0000","last_unstale":"2024-04-16T13:04:53.526614+0000","last_undegraded":"2024-04-16T13:04:53.526614+0000","last_fullsized":"2024-04-16T13:04:53.526614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:05:05.120063+0000","last_change":"2024-04-16T13:04:45.015482+0000","last_active":"2024-04-16T13:05:05.120063+0000","last_peered":"2024-04-16T13:05:05.120063+0000","last_clean":"2024-04-16T13:05:05.120063+0000","last_became_active":"2024-04-16T13:04:45.015101+0000","last_became_peered":"2024-04-16T13:04:45.015101+0000","last_unstale":"2024-04-16T13:05:05.120063+0000","last_undegraded":"2024-04-16T13:05:05.120063+0000","last_fullsized":"2024-04-16T13:05:05.120063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.137698+0000","last_change":"2024-04-16T13:04:50.167914+0000","last_active":"2024-04-16T13:04:52.137698+0000","last_peered":"2024-04-16T13:04:52.137698+0000","last_clean":"2024-04-16T13:04:52.137698+0000","last_became_active":"2024-04-16T13:04:50.167516+0000","last_became_peered":"2024-04-16T13:04:50.167516+0000","last_unstale":"2024-04-16T13:04:52.137698+0000","last_undegraded":"2024-04-16T13:04:52.137698+0000","last_fullsized":"2024-04-16T13:04:52.137698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:58:45.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143485+0000","last_change":"2024-04-16T13:04:45.990047+0000","last_active":"2024-04-16T13:04:52.143485+0000","last_peered":"2024-04-16T13:04:52.143485+0000","last_clean":"2024-04-16T13:04:52.143485+0000","last_became_active":"2024-04-16T13:04:45.989544+0000","last_became_peered":"2024-04-16T13:04:45.989544+0000","last_unstale":"2024-04-16T13:04:52.143485+0000","last_undegraded":"2024-04-16T13:04:52.143485+0000","last_fullsized":"2024-04-16T13:04:52.143485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:41.080920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138591+0000","last_change":"2024-04-16T13:04:45.016272+0000","last_active":"2024-04-16T13:04:52.138591+0000","last_peered":"2024-04-16T13:04:52.138591+0000","last_clean":"2024-04-16T13:04:52.138591+0000","last_became_active":"2024-04-16T13:04:45.015942+0000","last_became_peered":"2024-04-16T13:04:45.015942+0000","last_unstale":"2024-04-16T13:04:52.138591+0000","last_undegraded":"2024-04-16T13:04:52.138591+0000","last_fullsized":"2024-04-16T13:04:52.138591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142942+0000","last_change":"2024-04-16T13:04:50.167454+0000","last_active":"2024-04-16T13:04:52.142942+0000","last_peered":"2024-04-16T13:04:52.142942+0000","last_clean":"2024-04-16T13:04:52.142942+0000","last_became_active":"2024-04-16T13:04:50.166243+0000","last_became_peered":"2024-04-16T13:04:50.166243+0000","last_unstale":"2024-04-16T13:04:52.142942+0000","last_undegraded":"2024-04-16T13:04:52.142942+0000","last_fullsized":"2024-04-16T13:04:52.142942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:44.250803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137930+0000","last_change":"2024-04-16T13:04:46.010441+0000","last_active":"2024-04-16T13:04:53.137930+0000","last_peered":"2024-04-16T13:04:53.137930+0000","last_clean":"2024-04-16T13:04:53.137930+0000","last_became_active":"2024-04-16T13:04:46.010071+0000","last_became_peered":"2024-04-16T13:04:46.010071+0000","last_unstale":"2024-04-16T13:04:53.137930+0000","last_undegraded":"2024-04-16T13:04:53.137930+0000","last_fullsized":"2024-04-16T13:04:53.137930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127981+0000","last_change":"2024-04-16T13:04:45.019809+0000","last_active":"2024-04-16T13:04:53.127981+0000","last_peered":"2024-04-16T13:04:53.127981+0000","last_clean":"2024-04-16T13:04:53.127981+0000","last_became_active":"2024-04-16T13:04:45.019299+0000","last_became_peered":"2024-04-16T13:04:45.019299+0000","last_unstale":"2024-04-16T13:04:53.127981+0000","last_undegraded":"2024-04-16T13:04:53.127981+0000","last_fullsized":"2024-04-16T13:04:53.127981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:27:48.040506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140403+0000","last_change":"2024-04-16T13:04:50.164233+0000","last_active":"2024-04-16T13:04:52.140403+0000","last_peered":"2024-04-16T13:04:52.140403+0000","last_clean":"2024-04-16T13:04:52.140403+0000","last_became_active":"2024-04-16T13:04:50.161088+0000","last_became_peered":"2024-04-16T13:04:50.161088+0000","last_unstale":"2024-04-16T13:04:52.140403+0000","last_undegraded":"2024-04-16T13:04:52.140403+0000","last_fullsized":"2024-04-16T13:04:52.140403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:52:19.008262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130074+0000","last_change":"2024-04-16T13:04:46.009061+0000","last_active":"2024-04-16T13:04:53.130074+0000","last_peered":"2024-04-16T13:04:53.130074+0000","last_clean":"2024-04-16T13:04:53.130074+0000","last_became_active":"2024-04-16T13:04:46.008721+0000","last_became_peered":"2024-04-16T13:04:46.008721+0000","last_unstale":"2024-04-16T13:04:53.130074+0000","last_undegraded":"2024-04-16T13:04:53.130074+0000","last_fullsized":"2024-04-16T13:04:53.130074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017766+0000","last_change":"2024-04-16T13:04:45.021156+0000","last_active":"2024-04-16T13:04:53.017766+0000","last_peered":"2024-04-16T13:04:53.017766+0000","last_clean":"2024-04-16T13:04:53.017766+0000","last_became_active":"2024-04-16T13:04:45.020854+0000","last_became_peered":"2024-04-16T13:04:45.020854+0000","last_unstale":"2024-04-16T13:04:53.017766+0000","last_undegraded":"2024-04-16T13:04:53.017766+0000","last_fullsized":"2024-04-16T13:04:53.017766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:40.065756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140351+0000","last_change":"2024-04-16T13:04:50.707455+0000","last_active":"2024-04-16T13:04:52.140351+0000","last_peered":"2024-04-16T13:04:52.140351+0000","last_clean":"2024-04-16T13:04:52.140351+0000","last_became_active":"2024-04-16T13:04:50.706437+0000","last_became_peered":"2024-04-16T13:04:50.706437+0000","last_unstale":"2024-04-16T13:04:52.140351+0000","last_undegraded":"2024-04-16T13:04:52.140351+0000","last_fullsized":"2024-04-16T13:04:52.140351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:07:07.045544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137384+0000","last_change":"2024-04-16T13:04:50.708826+0000","last_active":"2024-04-16T13:04:53.137384+0000","last_peered":"2024-04-16T13:04:53.137384+0000","last_clean":"2024-04-16T13:04:53.137384+0000","last_became_active":"2024-04-16T13:04:50.707859+0000","last_became_peered":"2024-04-16T13:04:50.707859+0000","last_unstale":"2024-04-16T13:04:53.137384+0000","last_undegraded":"2024-04-16T13:04:53.137384+0000","last_fullsized":"2024-04-16T13:04:53.137384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:41:19.620334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136926+0000","last_change":"2024-04-16T13:04:46.000392+0000","last_active":"2024-04-16T13:04:52.136926+0000","last_peered":"2024-04-16T13:04:52.136926+0000","last_clean":"2024-04-16T13:04:52.136926+0000","last_became_active":"2024-04-16T13:04:46.000078+0000","last_became_peered":"2024-04-16T13:04:46.000078+0000","last_unstale":"2024-04-16T13:04:52.136926+0000","last_undegraded":"2024-04-16T13:04:52.136926+0000","last_fullsized":"2024-04-16T13:04:52.136926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.127941+0000","last_change":"2024-04-16T13:04:45.006496+0000","last_active":"2024-04-16T13:04:53.127941+0000","last_peered":"2024-04-16T13:04:53.127941+0000","last_clean":"2024-04-16T13:04:53.127941+0000","last_became_active":"2024-04-16T13:04:45.006186+0000","last_became_peered":"2024-04-16T13:04:45.006186+0000","last_unstale":"2024-04-16T13:04:53.127941+0000","last_undegraded":"2024-04-16T13:04:53.127941+0000","last_fullsized":"2024-04-16T13:04:53.127941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017419+0000","last_change":"2024-04-16T13:04:50.176861+0000","last_active":"2024-04-16T13:04:53.017419+0000","last_peered":"2024-04-16T13:04:53.017419+0000","last_clean":"2024-04-16T13:04:53.017419+0000","last_became_active":"2024-04-16T13:04:50.176348+0000","last_became_peered":"2024-04-16T13:04:50.176348+0000","last_unstale":"2024-04-16T13:04:53.017419+0000","last_undegraded":"2024-04-16T13:04:53.017419+0000","last_fullsized":"2024-04-16T13:04:53.017419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:20.938451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140739+0000","last_change":"2024-04-16T13:04:46.000621+0000","last_active":"2024-04-16T13:04:52.140739+0000","last_peered":"2024-04-16T13:04:52.140739+0000","last_clean":"2024-04-16T13:04:52.140739+0000","last_became_active":"2024-04-16T13:04:46.000319+0000","last_became_peered":"2024-04-16T13:04:46.000319+0000","last_unstale":"2024-04-16T13:04:52.140739+0000","last_undegraded":"2024-04-16T13:04:52.140739+0000","last_fullsized":"2024-04-16T13:04:52.140739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141221+0000","last_change":"2024-04-16T13:04:45.006224+0000","last_active":"2024-04-16T13:04:52.141221+0000","last_peered":"2024-04-16T13:04:52.141221+0000","last_clean":"2024-04-16T13:04:52.141221+0000","last_became_active":"2024-04-16T13:04:45.005898+0000","last_became_peered":"2024-04-16T13:04:45.005898+0000","last_unstale":"2024-04-16T13:04:52.141221+0000","last_undegraded":"2024-04-16T13:04:52.141221+0000","last_fullsized":"2024-04-16T13:04:52.141221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:32:01.127449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015851+0000","last_change":"2024-04-16T13:04:45.019025+0000","last_active":"2024-04-16T13:04:53.015851+0000","last_peered":"2024-04-16T13:04:53.015851+0000","last_clean":"2024-04-16T13:04:53.015851+0000","last_became_active":"2024-04-16T13:04:45.015700+0000","last_became_peered":"2024-04-16T13:04:45.015700+0000","last_unstale":"2024-04-16T13:04:53.015851+0000","last_undegraded":"2024-04-16T13:04:53.015851+0000","last_fullsized":"2024-04-16T13:04:53.015851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:08.626519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137290+0000","last_change":"2024-04-16T13:04:46.018489+0000","last_active":"2024-04-16T13:04:53.137290+0000","last_peered":"2024-04-16T13:04:53.137290+0000","last_clean":"2024-04-16T13:04:53.137290+0000","last_became_active":"2024-04-16T13:04:46.018109+0000","last_became_peered":"2024-04-16T13:04:46.018109+0000","last_unstale":"2024-04-16T13:04:53.137290+0000","last_undegraded":"2024-04-16T13:04:53.137290+0000","last_fullsized":"2024-04-16T13:04:53.137290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018321+0000","last_change":"2024-04-16T13:04:50.172707+0000","last_active":"2024-04-16T13:04:53.018321+0000","last_peered":"2024-04-16T13:04:53.018321+0000","last_clean":"2024-04-16T13:04:53.018321+0000","last_became_active":"2024-04-16T13:04:50.172280+0000","last_became_peered":"2024-04-16T13:04:50.172280+0000","last_unstale":"2024-04-16T13:04:53.018321+0000","last_undegraded":"2024-04-16T13:04:53.018321+0000","last_fullsized":"2024-04-16T13:04:53.018321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:04.522503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140744+0000","last_change":"2024-04-16T13:04:45.005110+0000","last_active":"2024-04-16T13:04:52.140744+0000","last_peered":"2024-04-16T13:04:52.140744+0000","last_clean":"2024-04-16T13:04:52.140744+0000","last_became_active":"2024-04-16T13:04:45.004820+0000","last_became_peered":"2024-04-16T13:04:45.004820+0000","last_unstale":"2024-04-16T13:04:52.140744+0000","last_undegraded":"2024-04-16T13:04:52.140744+0000","last_fullsized":"2024-04-16T13:04:52.140744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:43.939639+0000","last_clean_scrub_stamp":"2024-04-16T13:04:43.939639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:59.646899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.142646+0000","last_change":"2024-04-16T13:04:45.992254+0000","last_active":"2024-04-16T13:04:52.142646+0000","last_peered":"2024-04-16T13:04:52.142646+0000","last_clean":"2024-04-16T13:04:52.142646+0000","last_became_active":"2024-04-16T13:04:45.991789+0000","last_became_peered":"2024-04-16T13:04:45.991789+0000","last_unstale":"2024-04-16T13:04:52.142646+0000","last_undegraded":"2024-04-16T13:04:52.142646+0000","last_fullsized":"2024-04-16T13:04:52.142646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:00:40.238739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141125+0000","last_change":"2024-04-16T13:04:50.166825+0000","last_active":"2024-04-16T13:04:52.141125+0000","last_peered":"2024-04-16T13:04:52.141125+0000","last_clean":"2024-04-16T13:04:52.141125+0000","last_became_active":"2024-04-16T13:04:50.163810+0000","last_became_peered":"2024-04-16T13:04:50.163810+0000","last_unstale":"2024-04-16T13:04:52.141125+0000","last_undegraded":"2024-04-16T13:04:52.141125+0000","last_fullsized":"2024-04-16T13:04:52.141125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:49.101065+0000","last_clean_scrub_stamp":"2024-04-16T13:04:49.101065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:27.336747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.015243+0000","last_change":"2024-04-16T13:04:46.003053+0000","last_active":"2024-04-16T13:04:53.015243+0000","last_peered":"2024-04-16T13:04:53.015243+0000","last_clean":"2024-04-16T13:04:53.015243+0000","last_became_active":"2024-04-16T13:04:46.002349+0000","last_became_peered":"2024-04-16T13:04:46.002349+0000","last_unstale":"2024-04-16T13:04:53.015243+0000","last_undegraded":"2024-04-16T13:04:53.015243+0000","last_fullsized":"2024-04-16T13:04:53.015243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017790+0000","last_change":"2024-04-16T13:04:46.012253+0000","last_active":"2024-04-16T13:04:53.017790+0000","last_peered":"2024-04-16T13:04:53.017790+0000","last_clean":"2024-04-16T13:04:53.017790+0000","last_became_active":"2024-04-16T13:04:46.011827+0000","last_became_peered":"2024-04-16T13:04:46.011827+0000","last_unstale":"2024-04-16T13:04:53.017790+0000","last_undegraded":"2024-04-16T13:04:53.017790+0000","last_fullsized":"2024-04-16T13:04:53.017790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129257+0000","last_change":"2024-04-16T13:04:46.005260+0000","last_active":"2024-04-16T13:04:53.129257+0000","last_peered":"2024-04-16T13:04:53.129257+0000","last_clean":"2024-04-16T13:04:53.129257+0000","last_became_active":"2024-04-16T13:04:46.004249+0000","last_became_peered":"2024-04-16T13:04:46.004249+0000","last_unstale":"2024-04-16T13:04:53.129257+0000","last_undegraded":"2024-04-16T13:04:53.129257+0000","last_fullsized":"2024-04-16T13:04:53.129257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:32:24.551574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.137145+0000","last_change":"2024-04-16T13:04:46.004033+0000","last_active":"2024-04-16T13:04:53.137145+0000","last_peered":"2024-04-16T13:04:53.137145+0000","last_clean":"2024-04-16T13:04:53.137145+0000","last_became_active":"2024-04-16T13:04:46.002797+0000","last_became_peered":"2024-04-16T13:04:46.002797+0000","last_unstale":"2024-04-16T13:04:53.137145+0000","last_undegraded":"2024-04-16T13:04:53.137145+0000","last_fullsized":"2024-04-16T13:04:53.137145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:09:33.289858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141301+0000","last_change":"2024-04-16T13:04:46.004426+0000","last_active":"2024-04-16T13:04:52.141301+0000","last_peered":"2024-04-16T13:04:52.141301+0000","last_clean":"2024-04-16T13:04:52.141301+0000","last_became_active":"2024-04-16T13:04:46.004142+0000","last_became_peered":"2024-04-16T13:04:46.004142+0000","last_unstale":"2024-04-16T13:04:52.141301+0000","last_undegraded":"2024-04-16T13:04:52.141301+0000","last_fullsized":"2024-04-16T13:04:52.141301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138556+0000","last_change":"2024-04-16T13:04:45.996051+0000","last_active":"2024-04-16T13:04:52.138556+0000","last_peered":"2024-04-16T13:04:52.138556+0000","last_clean":"2024-04-16T13:04:52.138556+0000","last_became_active":"2024-04-16T13:04:45.995786+0000","last_became_peered":"2024-04-16T13:04:45.995786+0000","last_unstale":"2024-04-16T13:04:52.138556+0000","last_undegraded":"2024-04-16T13:04:52.138556+0000","last_fullsized":"2024-04-16T13:04:52.138556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:37.058110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017733+0000","last_change":"2024-04-16T13:04:46.014233+0000","last_active":"2024-04-16T13:04:53.017733+0000","last_peered":"2024-04-16T13:04:53.017733+0000","last_clean":"2024-04-16T13:04:53.017733+0000","last_became_active":"2024-04-16T13:04:46.007756+0000","last_became_peered":"2024-04-16T13:04:46.007756+0000","last_unstale":"2024-04-16T13:04:53.017733+0000","last_undegraded":"2024-04-16T13:04:53.017733+0000","last_fullsized":"2024-04-16T13:04:53.017733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141176+0000","last_change":"2024-04-16T13:04:46.002910+0000","last_active":"2024-04-16T13:04:52.141176+0000","last_peered":"2024-04-16T13:04:52.141176+0000","last_clean":"2024-04-16T13:04:52.141176+0000","last_became_active":"2024-04-16T13:04:46.002453+0000","last_became_peered":"2024-04-16T13:04:46.002453+0000","last_unstale":"2024-04-16T13:04:52.141176+0000","last_undegraded":"2024-04-16T13:04:52.141176+0000","last_fullsized":"2024-04-16T13:04:52.141176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128952+0000","last_change":"2024-04-16T13:04:46.004049+0000","last_active":"2024-04-16T13:04:53.128952+0000","last_peered":"2024-04-16T13:04:53.128952+0000","last_clean":"2024-04-16T13:04:53.128952+0000","last_became_active":"2024-04-16T13:04:46.003706+0000","last_became_peered":"2024-04-16T13:04:46.003706+0000","last_unstale":"2024-04-16T13:04:53.128952+0000","last_undegraded":"2024-04-16T13:04:53.128952+0000","last_fullsized":"2024-04-16T13:04:53.128952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:22.394990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141077+0000","last_change":"2024-04-16T13:04:45.995750+0000","last_active":"2024-04-16T13:04:52.141077+0000","last_peered":"2024-04-16T13:04:52.141077+0000","last_clean":"2024-04-16T13:04:52.141077+0000","last_became_active":"2024-04-16T13:04:45.995236+0000","last_became_peered":"2024-04-16T13:04:45.995236+0000","last_unstale":"2024-04-16T13:04:52.141077+0000","last_undegraded":"2024-04-16T13:04:52.141077+0000","last_fullsized":"2024-04-16T13:04:52.141077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129172+0000","last_change":"2024-04-16T13:04:46.004985+0000","last_active":"2024-04-16T13:04:53.129172+0000","last_peered":"2024-04-16T13:04:53.129172+0000","last_clean":"2024-04-16T13:04:53.129172+0000","last_became_active":"2024-04-16T13:04:46.003800+0000","last_became_peered":"2024-04-16T13:04:46.003800+0000","last_unstale":"2024-04-16T13:04:53.129172+0000","last_undegraded":"2024-04-16T13:04:53.129172+0000","last_fullsized":"2024-04-16T13:04:53.129172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:40.007480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136544+0000","last_change":"2024-04-16T13:04:46.004265+0000","last_active":"2024-04-16T13:04:53.136544+0000","last_peered":"2024-04-16T13:04:53.136544+0000","last_clean":"2024-04-16T13:04:53.136544+0000","last_became_active":"2024-04-16T13:04:46.003115+0000","last_became_peered":"2024-04-16T13:04:46.003115+0000","last_unstale":"2024-04-16T13:04:53.136544+0000","last_undegraded":"2024-04-16T13:04:53.136544+0000","last_fullsized":"2024-04-16T13:04:53.136544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:52.579674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.016869+0000","last_change":"2024-04-16T13:04:46.018522+0000","last_active":"2024-04-16T13:04:53.016869+0000","last_peered":"2024-04-16T13:04:53.016869+0000","last_clean":"2024-04-16T13:04:53.016869+0000","last_became_active":"2024-04-16T13:04:46.008619+0000","last_became_peered":"2024-04-16T13:04:46.008619+0000","last_unstale":"2024-04-16T13:04:53.016869+0000","last_undegraded":"2024-04-16T13:04:53.016869+0000","last_fullsized":"2024-04-16T13:04:53.016869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:25:57.540451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527232+0000","last_change":"2024-04-16T13:04:45.996736+0000","last_active":"2024-04-16T13:04:53.527232+0000","last_peered":"2024-04-16T13:04:53.527232+0000","last_clean":"2024-04-16T13:04:53.527232+0000","last_became_active":"2024-04-16T13:04:45.996437+0000","last_became_peered":"2024-04-16T13:04:45.996437+0000","last_unstale":"2024-04-16T13:04:53.527232+0000","last_undegraded":"2024-04-16T13:04:53.527232+0000","last_fullsized":"2024-04-16T13:04:53.527232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:14:58.430036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.019040+0000","last_change":"2024-04-16T13:04:46.000008+0000","last_active":"2024-04-16T13:04:53.019040+0000","last_peered":"2024-04-16T13:04:53.019040+0000","last_clean":"2024-04-16T13:04:53.019040+0000","last_became_active":"2024-04-16T13:04:45.999290+0000","last_became_peered":"2024-04-16T13:04:45.999290+0000","last_unstale":"2024-04-16T13:04:53.019040+0000","last_undegraded":"2024-04-16T13:04:53.019040+0000","last_fullsized":"2024-04-16T13:04:53.019040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:39.017477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.130606+0000","last_change":"2024-04-16T13:04:46.010682+0000","last_active":"2024-04-16T13:04:53.130606+0000","last_peered":"2024-04-16T13:04:53.130606+0000","last_clean":"2024-04-16T13:04:53.130606+0000","last_became_active":"2024-04-16T13:04:46.008966+0000","last_became_peered":"2024-04-16T13:04:46.008966+0000","last_unstale":"2024-04-16T13:04:53.130606+0000","last_undegraded":"2024-04-16T13:04:53.130606+0000","last_fullsized":"2024-04-16T13:04:53.130606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128870+0000","last_change":"2024-04-16T13:04:46.003968+0000","last_active":"2024-04-16T13:04:53.128870+0000","last_peered":"2024-04-16T13:04:53.128870+0000","last_clean":"2024-04-16T13:04:53.128870+0000","last_became_active":"2024-04-16T13:04:46.003377+0000","last_became_peered":"2024-04-16T13:04:46.003377+0000","last_unstale":"2024-04-16T13:04:53.128870+0000","last_undegraded":"2024-04-16T13:04:53.128870+0000","last_fullsized":"2024-04-16T13:04:53.128870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:28:35.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.136997+0000","last_change":"2024-04-16T13:04:45.986929+0000","last_active":"2024-04-16T13:04:52.136997+0000","last_peered":"2024-04-16T13:04:52.136997+0000","last_clean":"2024-04-16T13:04:52.136997+0000","last_became_active":"2024-04-16T13:04:45.986136+0000","last_became_peered":"2024-04-16T13:04:45.986136+0000","last_unstale":"2024-04-16T13:04:52.136997+0000","last_undegraded":"2024-04-16T13:04:52.136997+0000","last_fullsized":"2024-04-16T13:04:52.136997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:37.248084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136540+0000","last_change":"2024-04-16T13:04:46.006745+0000","last_active":"2024-04-16T13:04:53.136540+0000","last_peered":"2024-04-16T13:04:53.136540+0000","last_clean":"2024-04-16T13:04:53.136540+0000","last_became_active":"2024-04-16T13:04:46.005822+0000","last_became_peered":"2024-04-16T13:04:46.005822+0000","last_unstale":"2024-04-16T13:04:53.136540+0000","last_undegraded":"2024-04-16T13:04:53.136540+0000","last_fullsized":"2024-04-16T13:04:53.136540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:36.399411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.141458+0000","last_change":"2024-04-16T13:04:46.019457+0000","last_active":"2024-04-16T13:04:52.141458+0000","last_peered":"2024-04-16T13:04:52.141458+0000","last_clean":"2024-04-16T13:04:52.141458+0000","last_became_active":"2024-04-16T13:04:46.017865+0000","last_became_peered":"2024-04-16T13:04:46.017865+0000","last_unstale":"2024-04-16T13:04:52.141458+0000","last_undegraded":"2024-04-16T13:04:52.141458+0000","last_fullsized":"2024-04-16T13:04:52.141458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:07.715521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.143225+0000","last_change":"2024-04-16T13:04:46.008099+0000","last_active":"2024-04-16T13:04:52.143225+0000","last_peered":"2024-04-16T13:04:52.143225+0000","last_clean":"2024-04-16T13:04:52.143225+0000","last_became_active":"2024-04-16T13:04:46.007709+0000","last_became_peered":"2024-04-16T13:04:46.007709+0000","last_unstale":"2024-04-16T13:04:52.143225+0000","last_undegraded":"2024-04-16T13:04:52.143225+0000","last_fullsized":"2024-04-16T13:04:52.143225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:58:42.770718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.018093+0000","last_change":"2024-04-16T13:04:46.020412+0000","last_active":"2024-04-16T13:04:53.018093+0000","last_peered":"2024-04-16T13:04:53.018093+0000","last_clean":"2024-04-16T13:04:53.018093+0000","last_became_active":"2024-04-16T13:04:46.020176+0000","last_became_peered":"2024-04-16T13:04:46.020176+0000","last_unstale":"2024-04-16T13:04:53.018093+0000","last_undegraded":"2024-04-16T13:04:53.018093+0000","last_fullsized":"2024-04-16T13:04:53.018093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.017641+0000","last_change":"2024-04-16T13:04:46.017218+0000","last_active":"2024-04-16T13:04:53.017641+0000","last_peered":"2024-04-16T13:04:53.017641+0000","last_clean":"2024-04-16T13:04:53.017641+0000","last_became_active":"2024-04-16T13:04:46.014646+0000","last_became_peered":"2024-04-16T13:04:46.014646+0000","last_unstale":"2024-04-16T13:04:53.017641+0000","last_undegraded":"2024-04-16T13:04:53.017641+0000","last_fullsized":"2024-04-16T13:04:53.017641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527498+0000","last_change":"2024-04-16T13:04:46.009985+0000","last_active":"2024-04-16T13:04:53.527498+0000","last_peered":"2024-04-16T13:04:53.527498+0000","last_clean":"2024-04-16T13:04:53.527498+0000","last_became_active":"2024-04-16T13:04:46.009696+0000","last_became_peered":"2024-04-16T13:04:46.009696+0000","last_unstale":"2024-04-16T13:04:53.527498+0000","last_undegraded":"2024-04-16T13:04:53.527498+0000","last_fullsized":"2024-04-16T13:04:53.527498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:39:40.104541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.140079+0000","last_change":"2024-04-16T13:04:46.006877+0000","last_active":"2024-04-16T13:04:52.140079+0000","last_peered":"2024-04-16T13:04:52.140079+0000","last_clean":"2024-04-16T13:04:52.140079+0000","last_became_active":"2024-04-16T13:04:46.006436+0000","last_became_peered":"2024-04-16T13:04:46.006436+0000","last_unstale":"2024-04-16T13:04:52.140079+0000","last_undegraded":"2024-04-16T13:04:52.140079+0000","last_fullsized":"2024-04-16T13:04:52.140079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:00.376241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.526019+0000","last_change":"2024-04-16T13:04:46.004191+0000","last_active":"2024-04-16T13:04:53.526019+0000","last_peered":"2024-04-16T13:04:53.526019+0000","last_clean":"2024-04-16T13:04:53.526019+0000","last_became_active":"2024-04-16T13:04:46.003868+0000","last_became_peered":"2024-04-16T13:04:46.003868+0000","last_unstale":"2024-04-16T13:04:53.526019+0000","last_undegraded":"2024-04-16T13:04:53.526019+0000","last_fullsized":"2024-04-16T13:04:53.526019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.128991+0000","last_change":"2024-04-16T13:04:46.005552+0000","last_active":"2024-04-16T13:04:53.128991+0000","last_peered":"2024-04-16T13:04:53.128991+0000","last_clean":"2024-04-16T13:04:53.128991+0000","last_became_active":"2024-04-16T13:04:46.004596+0000","last_became_peered":"2024-04-16T13:04:46.004596+0000","last_unstale":"2024-04-16T13:04:53.128991+0000","last_undegraded":"2024-04-16T13:04:53.128991+0000","last_fullsized":"2024-04-16T13:04:53.128991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:49.207926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.525853+0000","last_change":"2024-04-16T13:04:45.997612+0000","last_active":"2024-04-16T13:04:53.525853+0000","last_peered":"2024-04-16T13:04:53.525853+0000","last_clean":"2024-04-16T13:04:53.525853+0000","last_became_active":"2024-04-16T13:04:45.996762+0000","last_became_peered":"2024-04-16T13:04:45.996762+0000","last_unstale":"2024-04-16T13:04:53.525853+0000","last_undegraded":"2024-04-16T13:04:53.525853+0000","last_fullsized":"2024-04-16T13:04:53.525853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:20:49.988540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.129465+0000","last_change":"2024-04-16T13:04:46.008999+0000","last_active":"2024-04-16T13:04:53.129465+0000","last_peered":"2024-04-16T13:04:53.129465+0000","last_clean":"2024-04-16T13:04:53.129465+0000","last_became_active":"2024-04-16T13:04:46.008352+0000","last_became_peered":"2024-04-16T13:04:46.008352+0000","last_unstale":"2024-04-16T13:04:53.129465+0000","last_undegraded":"2024-04-16T13:04:53.129465+0000","last_fullsized":"2024-04-16T13:04:53.129465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:59.604359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.136867+0000","last_change":"2024-04-16T13:04:46.005440+0000","last_active":"2024-04-16T13:04:53.136867+0000","last_peered":"2024-04-16T13:04:53.136867+0000","last_clean":"2024-04-16T13:04:53.136867+0000","last_became_active":"2024-04-16T13:04:46.002984+0000","last_became_peered":"2024-04-16T13:04:46.002984+0000","last_unstale":"2024-04-16T13:04:53.136867+0000","last_undegraded":"2024-04-16T13:04:53.136867+0000","last_fullsized":"2024-04-16T13:04:53.136867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:57.620582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:52.138984+0000","last_change":"2024-04-16T13:04:46.009580+0000","last_active":"2024-04-16T13:04:52.138984+0000","last_peered":"2024-04-16T13:04:52.138984+0000","last_clean":"2024-04-16T13:04:52.138984+0000","last_became_active":"2024-04-16T13:04:46.008940+0000","last_became_peered":"2024-04-16T13:04:46.008940+0000","last_unstale":"2024-04-16T13:04:52.138984+0000","last_undegraded":"2024-04-16T13:04:52.138984+0000","last_fullsized":"2024-04-16T13:04:52.138984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:03:45.229052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-16T13:04:53.527357+0000","last_change":"2024-04-16T13:04:46.007107+0000","last_active":"2024-04-16T13:04:53.527357+0000","last_peered":"2024-04-16T13:04:53.527357+0000","last_clean":"2024-04-16T13:04:53.527357+0000","last_became_active":"2024-04-16T13:04:46.006881+0000","last_became_peered":"2024-04-16T13:04:46.006881+0000","last_unstale":"2024-04-16T13:04:53.527357+0000","last_undegraded":"2024-04-16T13:04:53.527357+0000","last_fullsized":"2024-04-16T13:04:53.527357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:44.954803+0000","last_clean_scrub_stamp":"2024-04-16T13:04:44.954803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:29:16.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":698343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":107483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":111235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:05:16.048 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T13:05:16.049 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T13:05:16.049 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-16T13:05:16.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-16T13:05:16.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.285+0000 7f5a0f200640 1 Processor -- start 2024-04-16T13:05:16.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.285+0000 7f5a0f200640 1 -- start start 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 0x7f5a100b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a1006ba20 0x7f5a1006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0f200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a101621a0 con 0x7f5a10161dc0 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5a100cd490 con 0x7f5a1006ba20 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5a100cd770 con 0x7f5a100b2370 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a1006ba20 0x7f5a1006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a1006ba20 0x7f5a1006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52534/0 (socket says 172.21.15.67:52534) 2024-04-16T13:05:16.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.286+0000 7f5a0e800640 1 -- 172.21.15.67:0/2429290416 learned_addr learned my addr 172.21.15.67:0/2429290416 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0d400640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 0x7f5a100b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0e800640 1 -- 172.21.15.67:0/2429290416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 msgr2=0x7f5a100b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0e800640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 0x7f5a100b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0e800640 1 -- 172.21.15.67:0/2429290416 >> v1:172.21.15.82:6789/0 conn(0x7f5a10161dc0 legacy=0x7f5a100ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0e800640 1 -- 172.21.15.67:0/2429290416 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100cda50 con 0x7f5a1006ba20 2024-04-16T13:05:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.287+0000 7f5a0d400640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 0x7f5a100b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:16.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.288+0000 7f5a0e800640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a1006ba20 0x7f5a1006bed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009870 tx=0x7f5a0002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c39576a205039e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.288+0000 7f5a0ca00640 1 -- 172.21.15.67:0/2429290416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00038070 con 0x7f5a1006ba20 2024-04-16T13:05:16.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.288+0000 7f5a0ca00640 1 -- 172.21.15.67:0/2429290416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00031740 con 0x7f5a1006ba20 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.288+0000 7f5a0ca00640 1 -- 172.21.15.67:0/2429290416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0002f050 con 0x7f5a1006ba20 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 -- 172.21.15.67:0/2429290416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a1006ba20 msgr2=0x7f5a1006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a1006ba20 0x7f5a1006bed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009870 tx=0x7f5a0002b7e0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 -- 172.21.15.67:0/2429290416 shutdown_connections 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a1006ba20 0x7f5a1006bed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2429290416 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a100b2370 0x7f5a100b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 -- 172.21.15.67:0/2429290416 >> 172.21.15.67:0/2429290416 conn(0x7f5a1009aa70 msgr2=0x7f5a100b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 -- 172.21.15.67:0/2429290416 shutdown_connections 2024-04-16T13:05:16.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.289+0000 7f5a0f200640 1 -- 172.21.15.67:0/2429290416 wait complete. 2024-04-16T13:05:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.291+0000 7f5a0f200640 1 Processor -- start 2024-04-16T13:05:16.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.291+0000 7f5a0f200640 1 -- start start 2024-04-16T13:05:16.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006ba20 0x7f5a1009b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 0x7f5a100c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100cf1e0 con 0x7f5a100b2370 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a100cf060 con 0x7f5a10161dc0 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5a100cb920 con 0x7f5a1006ba20 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52542/0 (socket says 172.21.15.67:52542) 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0d400640 1 -- 172.21.15.67:0/2523997145 learned_addr learned my addr 172.21.15.67:0/2523997145 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.292+0000 7f5a0de00640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006ba20 0x7f5a1009b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0e800640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 0x7f5a100c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 -- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006ba20 msgr2=0x7f5a1009b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006ba20 0x7f5a1009b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 -- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 msgr2=0x7f5a100c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 0x7f5a100c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 -- 172.21.15.67:0/2523997145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a100c75e0 con 0x7f5a100b2370 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0e800640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 0x7f5a100c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0d400640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c7f0 tx=0x7f59f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8015070 con 0x7f5a100b2370 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8007a30 con 0x7f5a100b2370 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8007e00 con 0x7f5a100b2370 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1009d380 con 0x7f5a100b2370 2024-04-16T13:05:16.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.293+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1009d940 con 0x7f5a100b2370 2024-04-16T13:05:16.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.295+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a10075bd0 con 0x7f5a100b2370 2024-04-16T13:05:16.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.296+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59f8018070 con 0x7f5a100b2370 2024-04-16T13:05:16.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.296+0000 7f5a06000640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.297+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f59f808be70 con 0x7f5a100b2370 2024-04-16T13:05:16.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.297+0000 7f5a0de00640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.298+0000 7f5a0de00640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 0x7f59ec06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009f20 tx=0x7f5a080094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.305+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59f8059f50 con 0x7f5a100b2370 2024-04-16T13:05:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.543+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a100b7250 con 0x7f5a100b2370 2024-04-16T13:05:16.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.544+0000 7f5a06000640 1 -- 172.21.15.67:0/2523997145 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f59f8059850 con 0x7f5a100b2370 2024-04-16T13:05:16.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:16.545 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T13:05:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 msgr2=0x7f59ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 0x7f59ec06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009f20 tx=0x7f5a080094d0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 msgr2=0x7f5a100c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c7f0 tx=0x7f59f800cbf0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 shutdown_connections 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f59ec06c8f0 0x7f59ec06edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a10161dc0 0x7f5a100c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a100b2370 0x7f5a100c6880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 --2- 172.21.15.67:0/2523997145 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5a1006ba20 0x7f5a1009b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 >> 172.21.15.67:0/2523997145 conn(0x7f5a1009aa70 msgr2=0x7f5a100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 shutdown_connections 2024-04-16T13:05:16.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.547+0000 7f5a0f200640 1 -- 172.21.15.67:0/2523997145 wait complete. 2024-04-16T13:05:16.564 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-16T13:05:16.564 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:16.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.760+0000 7f7cef200640 1 Processor -- start 2024-04-16T13:05:16.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.760+0000 7f7cef200640 1 -- start start 2024-04-16T13:05:16.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.761+0000 7f7cef200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cf006d360 0x7f7cf006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.761+0000 7f7cef200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00d0000 con 0x7f7cf00d27b0 2024-04-16T13:05:16.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7cef200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00d02e0 con 0x7f7cf015eaa0 2024-04-16T13:05:16.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7cef200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf006dd00 con 0x7f7cf006d360 2024-04-16T13:05:16.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7cee800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7cf00d27b0 0x7f7cf00d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38182/0 (socket says 172.21.15.67:38182) 2024-04-16T13:05:16.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7cee800640 1 -- 172.21.15.67:0/1302270641 learned_addr learned my addr 172.21.15.67:0/1302270641 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:16.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7ced400640 1 --2- 172.21.15.67:0/1302270641 >> v2:172.21.15.82:3300/0 conn(0x7f7cf006d360 0x7f7cf006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519418226 0 0) 0x7f7cf00d0000 con 0x7f7cf00d27b0 2024-04-16T13:05:16.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.762+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd4003520 con 0x7f7cf00d27b0 2024-04-16T13:05:16.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036593053 0 0) 0x7f7cd4003520 con 0x7f7cf00d27b0 2024-04-16T13:05:16.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 >> v2:172.21.15.82:3300/0 conn(0x7f7cf006d360 msgr2=0x7f7cf006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:16.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 --2- 172.21.15.67:0/1302270641 >> v2:172.21.15.82:3300/0 conn(0x7f7cf006d360 0x7f7cf006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 >> v1:172.21.15.82:6789/0 conn(0x7f7cf015eaa0 legacy=0x7f7cf00d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf00d05c0 con 0x7f7cf00d27b0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f7ce80019f0 con 0x7f7cf00d27b0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 >> v1:172.21.15.67:6789/0 conn(0x7f7cf00d27b0 legacy=0x7f7cf00d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd40039b0 0x7f7cd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd4004800 0x7f7cd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 0x7f7cd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd400c130 con 0x7f7cd40051c0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd400c2e0 con 0x7f7cd40039b0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd400c4e0 con 0x7f7cd4004800 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7cee800640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 0x7f7cd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.763+0000 7f7cede00640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd40039b0 0x7f7cd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7ced400640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd4004800 0x7f7cd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7cee800640 1 -- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd4004800 msgr2=0x7f7cd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7cee800640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd4004800 0x7f7cd4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7cee800640 1 -- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd40039b0 msgr2=0x7f7cd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7cee800640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd40039b0 0x7f7cd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.764+0000 7f7cee800640 1 -- 172.21.15.67:0/1302270641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4003520 con 0x7f7cd40051c0 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.765+0000 7f7cee800640 1 -- 172.21.15.67:0/1302270641 reap_dead start 2024-04-16T13:05:16.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.765+0000 7f7cee800640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 0x7f7cd400b9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800a840 tx=0x7f7cd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0e558ce5ef459c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.765+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800a460 con 0x7f7cd40051c0 2024-04-16T13:05:16.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8034650 con 0x7f7cd40051c0 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7ceca00640 1 -- 172.21.15.67:0/1302270641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8034a40 con 0x7f7cd40051c0 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 -- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 msgr2=0x7f7cd400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 0x7f7cd400b9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800a840 tx=0x7f7cd4005830 comp rx=0 tx=0).stop 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 -- 172.21.15.67:0/1302270641 shutdown_connections 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 --2- 172.21.15.67:0/1302270641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cd40051c0 0x7f7cd400b9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 -- 172.21.15.67:0/1302270641 >> 172.21.15.67:0/1302270641 conn(0x7f7cf008c000 msgr2=0x7f7cf00d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 -- 172.21.15.67:0/1302270641 shutdown_connections 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.766+0000 7f7cef200640 1 -- 172.21.15.67:0/1302270641 wait complete. 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.768+0000 7f7cef200640 1 Processor -- start 2024-04-16T13:05:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.768+0000 7f7cef200640 1 -- start start 2024-04-16T13:05:16.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd40051c0 0x7f7cf0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 0x7f7cf01f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf015ee80 con 0x7f7cf015ac70 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00d0c10 con 0x7f7cf01f4600 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7cef200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf006ceb0 con 0x7f7cd40051c0 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7ced400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7ced400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52562/0 (socket says 172.21.15.67:52562) 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.769+0000 7f7ced400640 1 -- 172.21.15.67:0/1502085220 learned_addr learned my addr 172.21.15.67:0/1502085220 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7cee800640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 0x7f7cf01f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7cede00640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd40051c0 0x7f7cf0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 -- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd40051c0 msgr2=0x7f7cf0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd40051c0 0x7f7cf0151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 -- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 msgr2=0x7f7cf01f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 0x7f7cf01f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 -- 172.21.15.67:0/1502085220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf01602e0 con 0x7f7cf015ac70 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7cee800640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 0x7f7cf01f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ced400640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc010890 tx=0x7f7cdc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00f040 con 0x7f7cf015ac70 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cdc00eb00 con 0x7f7cf015ac70 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc01c400 con 0x7f7cf015ac70 2024-04-16T13:05:16.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.770+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf01605c0 con 0x7f7cf015ac70 2024-04-16T13:05:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.771+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0160b80 con 0x7f7cf015ac70 2024-04-16T13:05:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.772+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf0075bd0 con 0x7f7cf015ac70 2024-04-16T13:05:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.773+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cdc01c5a0 con 0x7f7cf015ac70 2024-04-16T13:05:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.774+0000 7f7ce6000640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 0x7f7cd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.774+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7cdc08c340 con 0x7f7cf015ac70 2024-04-16T13:05:16.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.775+0000 7f7cede00640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 0x7f7cd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:16.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.776+0000 7f7cede00640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 0x7f7cd006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0007fd0 tx=0x7f7ce0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.779+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cdc018030 con 0x7f7cf015ac70 2024-04-16T13:05:16.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.976+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cf00b5c50 con 0x7f7cf015ac70 2024-04-16T13:05:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.979+0000 7f7ce6000640 1 -- 172.21.15.67:0/1502085220 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f7cdc05a4c0 con 0x7f7cf015ac70 2024-04-16T13:05:16.981 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:16.981 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.981+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 msgr2=0x7f7cd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 0x7f7cd006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0007fd0 tx=0x7f7ce0009040 comp rx=0 tx=0).stop 2024-04-16T13:05:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 msgr2=0x7f7cf00ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc010890 tx=0x7f7cdc010d50 comp rx=0 tx=0).stop 2024-04-16T13:05:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 shutdown_connections 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7cd006c920 0x7f7cd006ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cf01f4600 0x7f7cf01f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7cf015ac70 0x7f7cf00ce1f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 --2- 172.21.15.67:0/1502085220 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7cd40051c0 0x7f7cf0151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 >> 172.21.15.67:0/1502085220 conn(0x7f7cf008c000 msgr2=0x7f7cf00d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 shutdown_connections 2024-04-16T13:05:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:16.982+0000 7f7cef200640 1 -- 172.21.15.67:0/1502085220 wait complete. 2024-04-16T13:05:17.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:17.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:17.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.215+0000 7f6675000640 1 Processor -- start 2024-04-16T13:05:17.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.216+0000 7f6675000640 1 -- start start 2024-04-16T13:05:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.217+0000 7f6675000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6670160180 0x7f667015d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.217+0000 7f6675000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6670156ff0 con 0x7f667015d0a0 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.217+0000 7f6675000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6670160920 con 0x7f66700d04b0 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.217+0000 7f6675000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6670160c00 con 0x7f6670160180 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.217+0000 7f6667e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6670160180 0x7f667015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f6667e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6670160180 0x7f667015d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52568/0 (socket says 172.21.15.67:52568) 2024-04-16T13:05:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f6667e00640 1 -- 172.21.15.67:0/521245647 learned_addr learned my addr 172.21.15.67:0/521245647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f6667e00640 1 -- 172.21.15.67:0/521245647 >> v1:172.21.15.82:6789/0 conn(0x7f66700d04b0 legacy=0x7f667006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f6667e00640 1 -- 172.21.15.67:0/521245647 >> v1:172.21.15.67:6789/0 conn(0x7f667015d0a0 legacy=0x7f66700ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f6667e00640 1 -- 172.21.15.67:0/521245647 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6670160ee0 con 0x7f6670160180 2024-04-16T13:05:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.218+0000 7f666ea00640 1 -- 172.21.15.67:0/521245647 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184689182 0 0) 0x7f6670156ff0 con 0x7f667015d0a0 2024-04-16T13:05:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.219+0000 7f6667e00640 1 --2- 172.21.15.67:0/521245647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6670160180 0x7f667015d480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f665802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355921fa8827bbee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.219+0000 7f666ea00640 1 -- 172.21.15.67:0/521245647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658034070 con 0x7f6670160180 2024-04-16T13:05:17.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f666ea00640 1 -- 172.21.15.67:0/521245647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658030860 con 0x7f6670160180 2024-04-16T13:05:17.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f666ea00640 1 -- 172.21.15.67:0/521245647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658030c30 con 0x7f6670160180 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 -- 172.21.15.67:0/521245647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6670160180 msgr2=0x7f667015d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 --2- 172.21.15.67:0/521245647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6670160180 0x7f667015d480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f665802b9a0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 -- 172.21.15.67:0/521245647 shutdown_connections 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 --2- 172.21.15.67:0/521245647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6670160180 0x7f667015d480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 -- 172.21.15.67:0/521245647 >> 172.21.15.67:0/521245647 conn(0x7f667006bc00 msgr2=0x7f667006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 -- 172.21.15.67:0/521245647 shutdown_connections 2024-04-16T13:05:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.220+0000 7f6675000640 1 -- 172.21.15.67:0/521245647 wait complete. 2024-04-16T13:05:17.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.222+0000 7f6675000640 1 Processor -- start 2024-04-16T13:05:17.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.222+0000 7f6675000640 1 -- start start 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66700d04b0 0x7f66700affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 0x7f66700cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f667006ec60 con 0x7f667015d0a0 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6670160600 con 0x7f66700d04b0 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6675000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f667015d9c0 con 0x7f6670160180 2024-04-16T13:05:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.223+0000 7f6667e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52584/0 (socket says 172.21.15.67:52584) 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 -- 172.21.15.67:0/475290470 learned_addr learned my addr 172.21.15.67:0/475290470 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f666f400640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66700d04b0 0x7f66700affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f666fe00640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 0x7f66700cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 -- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 msgr2=0x7f66700cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 0x7f66700cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 -- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66700d04b0 msgr2=0x7f66700affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66700d04b0 0x7f66700affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 -- 172.21.15.67:0/475290470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66700b1c60 con 0x7f667015d0a0 2024-04-16T13:05:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f666fe00640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 0x7f66700cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:17.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.224+0000 7f6667e00640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f66580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.225+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658034040 con 0x7f667015d0a0 2024-04-16T13:05:17.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.225+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658039d90 con 0x7f667015d0a0 2024-04-16T13:05:17.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.225+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658043610 con 0x7f667015d0a0 2024-04-16T13:05:17.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.225+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66700b0bc0 con 0x7f667015d0a0 2024-04-16T13:05:17.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.225+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66700b1180 con 0x7f667015d0a0 2024-04-16T13:05:17.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.226+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6670075bd0 con 0x7f667015d0a0 2024-04-16T13:05:17.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.228+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f665804a060 con 0x7f667015d0a0 2024-04-16T13:05:17.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.228+0000 7f6667400640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 0x7f664c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.229+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f66580ae060 con 0x7f667015d0a0 2024-04-16T13:05:17.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.229+0000 7f666f400640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 0x7f664c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.230+0000 7f666f400640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 0x7f664c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6660007fd0 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.233+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f665803e070 con 0x7f667015d0a0 2024-04-16T13:05:17.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.437+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66700ca680 con 0x7f667015d0a0 2024-04-16T13:05:17.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.438+0000 7f6667400640 1 -- 172.21.15.67:0/475290470 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f6658037360 con 0x7f667015d0a0 2024-04-16T13:05:17.439 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 msgr2=0x7f664c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 0x7f664c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6660007fd0 tx=0x7f6660009040 comp rx=0 tx=0).stop 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 msgr2=0x7f66701465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6658009870 tx=0x7f66580046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 shutdown_connections 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f664c06c8f0 0x7f664c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6670160180 0x7f66700cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f667015d0a0 0x7f66701465a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 --2- 172.21.15.67:0/475290470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66700d04b0 0x7f66700affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.440+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 >> 172.21.15.67:0/475290470 conn(0x7f667006bc00 msgr2=0x7f667006bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:17.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.441+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 shutdown_connections 2024-04-16T13:05:17.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.441+0000 7f6675000640 1 -- 172.21.15.67:0/475290470 wait complete. 2024-04-16T13:05:17.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:17.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.679+0000 7f356ac00640 1 Processor -- start 2024-04-16T13:05:17.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.679+0000 7f356ac00640 1 -- start start 2024-04-16T13:05:17.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356ac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35641672d0 0x7f35640c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356ac00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35640c5a90 0x7f356416cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356ac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35641641a0 con 0x7f3564166ef0 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356ac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f35640d2160 con 0x7f35641672d0 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356ac00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f35640c5f00 con 0x7f35640c5a90 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f3569800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3564166ef0 0x7f356406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38196/0 (socket says 172.21.15.67:38196) 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f3569800640 1 -- 172.21.15.67:0/4100292329 learned_addr learned my addr 172.21.15.67:0/4100292329 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f3568e00640 1 --2- 172.21.15.67:0/4100292329 >> v2:172.21.15.67:3300/0 conn(0x7f35641672d0 0x7f35640c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.681+0000 7f356a200640 1 --2- 172.21.15.67:0/4100292329 >> v2:172.21.15.82:3300/0 conn(0x7f35640c5a90 0x7f356416cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3563e00640 1 -- 172.21.15.67:0/4100292329 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404457533 0 0) 0x7f35641641a0 con 0x7f3564166ef0 2024-04-16T13:05:17.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3563e00640 1 -- 172.21.15.67:0/4100292329 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f354c003520 con 0x7f3564166ef0 2024-04-16T13:05:17.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3568e00640 1 -- 172.21.15.67:0/4100292329 >> v2:172.21.15.82:3300/0 conn(0x7f35640c5a90 msgr2=0x7f356416cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:17.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3568e00640 1 --2- 172.21.15.67:0/4100292329 >> v2:172.21.15.82:3300/0 conn(0x7f35640c5a90 0x7f356416cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3568e00640 1 -- 172.21.15.67:0/4100292329 >> v1:172.21.15.67:6789/0 conn(0x7f3564166ef0 legacy=0x7f356406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.682+0000 7f3568e00640 1 -- 172.21.15.67:0/4100292329 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3564167740 con 0x7f35641672d0 2024-04-16T13:05:17.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.683+0000 7f3568e00640 1 --2- 172.21.15.67:0/4100292329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641672d0 0x7f35640c5550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35500097a0 tx=0x7f355002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d269a8a0e3d9908 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.683+0000 7f3563e00640 1 -- 172.21.15.67:0/4100292329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550035020 con 0x7f35641672d0 2024-04-16T13:05:17.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.683+0000 7f3563e00640 1 -- 172.21.15.67:0/4100292329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550031830 con 0x7f35641672d0 2024-04-16T13:05:17.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.683+0000 7f3563e00640 1 -- 172.21.15.67:0/4100292329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550031c00 con 0x7f35641672d0 2024-04-16T13:05:17.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 -- 172.21.15.67:0/4100292329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641672d0 msgr2=0x7f35640c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 --2- 172.21.15.67:0/4100292329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641672d0 0x7f35640c5550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35500097a0 tx=0x7f355002b8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 -- 172.21.15.67:0/4100292329 shutdown_connections 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 --2- 172.21.15.67:0/4100292329 >> v2:172.21.15.82:3300/0 conn(0x7f35640c5a90 0x7f356416cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 --2- 172.21.15.67:0/4100292329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35641672d0 0x7f35640c5550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 -- 172.21.15.67:0/4100292329 >> 172.21.15.67:0/4100292329 conn(0x7f35640b4070 msgr2=0x7f35640b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 -- 172.21.15.67:0/4100292329 shutdown_connections 2024-04-16T13:05:17.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.684+0000 7f356ac00640 1 -- 172.21.15.67:0/4100292329 wait complete. 2024-04-16T13:05:17.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.686+0000 7f356ac00640 1 Processor -- start 2024-04-16T13:05:17.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.686+0000 7f356ac00640 1 -- start start 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35640c5a90 0x7f35640c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 0x7f35641f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35641636c0 con 0x7f3564166ef0 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f356406d240 con 0x7f35641672d0 2024-04-16T13:05:17.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f356ac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f35641639a0 con 0x7f35640c5a90 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f3568e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f3568e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52600/0 (socket says 172.21.15.67:52600) 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.687+0000 7f3568e00640 1 -- 172.21.15.67:0/2321541960 learned_addr learned my addr 172.21.15.67:0/2321541960 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 -- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35640c5a90 msgr2=0x7f35640c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3569800640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35640c5a90 0x7f35640c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f356a200640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 0x7f35641f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35640c5a90 0x7f35640c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 -- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 msgr2=0x7f35641f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 0x7f35641f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 -- 172.21.15.67:0/2321541960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356415cc70 con 0x7f3564166ef0 2024-04-16T13:05:17.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f356a200640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 0x7f35641f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3568e00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3550000c00 tx=0x7f35500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.688+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550040070 con 0x7f3564166ef0 2024-04-16T13:05:17.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.689+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355003a850 con 0x7f3564166ef0 2024-04-16T13:05:17.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.689+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550035040 con 0x7f3564166ef0 2024-04-16T13:05:17.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.689+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356415bbd0 con 0x7f3564166ef0 2024-04-16T13:05:17.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.689+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356415c190 con 0x7f3564166ef0 2024-04-16T13:05:17.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.690+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3564075bd0 con 0x7f3564166ef0 2024-04-16T13:05:17.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.691+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f355004b060 con 0x7f3564166ef0 2024-04-16T13:05:17.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.692+0000 7f3561600640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 0x7f354406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:17.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.692+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35500ad8e0 con 0x7f3564166ef0 2024-04-16T13:05:17.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.692+0000 7f3569800640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 0x7f354406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:17.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.693+0000 7f3569800640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 0x7f354406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35580016e0 tx=0x7f3558009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.698+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3550031800 con 0x7f3564166ef0 2024-04-16T13:05:17.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.892+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f35640b4db0 con 0x7f3564166ef0 2024-04-16T13:05:17.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.893+0000 7f3561600640 1 -- 172.21.15.67:0/2321541960 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f355007b9c0 con 0x7f3564166ef0 2024-04-16T13:05:17.895 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 msgr2=0x7f354406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 0x7f354406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35580016e0 tx=0x7f3558009040 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 msgr2=0x7f35640ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3550000c00 tx=0x7f35500046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 shutdown_connections 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f354406c8f0 0x7f354406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35641672d0 0x7f35641f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3564166ef0 0x7f35640ca510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 --2- 172.21.15.67:0/2321541960 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f35640c5a90 0x7f35640c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 >> 172.21.15.67:0/2321541960 conn(0x7f35640b4070 msgr2=0x7f35640d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 shutdown_connections 2024-04-16T13:05:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:17.896+0000 7f356ac00640 1 -- 172.21.15.67:0/2321541960 wait complete. 2024-04-16T13:05:17.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:18.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.137+0000 7f2d7b200640 1 Processor -- start 2024-04-16T13:05:18.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.138+0000 7f2d7b200640 1 -- start start 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.139+0000 7f2d7b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.139+0000 7f2d7b200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d7415d4d0 0x7f2d74072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.139+0000 7f2d7b200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7406dec0 con 0x7f2d74071de0 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.139+0000 7f2d7b200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2d74072780 con 0x7f2d7415d4d0 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.139+0000 7f2d7b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7406e7f0 con 0x7f2d740ce990 2024-04-16T13:05:18.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.140+0000 7f2d79e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.140+0000 7f2d79e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:51906/0 (socket says 172.21.15.67:51906) 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.140+0000 7f2d79e00640 1 -- 172.21.15.67:0/732421512 learned_addr learned my addr 172.21.15.67:0/732421512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.140+0000 7f2d7a800640 1 --2- 172.21.15.67:0/732421512 >> v2:172.21.15.82:3300/0 conn(0x7f2d7415d4d0 0x7f2d74072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.141+0000 7f2d79e00640 1 -- 172.21.15.67:0/732421512 >> v2:172.21.15.82:3300/0 conn(0x7f2d7415d4d0 msgr2=0x7f2d74072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.141+0000 7f2d79e00640 1 --2- 172.21.15.67:0/732421512 >> v2:172.21.15.82:3300/0 conn(0x7f2d7415d4d0 0x7f2d74072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.141+0000 7f2d79e00640 1 -- 172.21.15.67:0/732421512 >> v1:172.21.15.82:6789/0 conn(0x7f2d74071de0 legacy=0x7f2d7415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.141+0000 7f2d79e00640 1 -- 172.21.15.67:0/732421512 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7406e1a0 con 0x7f2d740ce990 2024-04-16T13:05:18.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.141+0000 7f2d78a00640 1 -- 172.21.15.67:0/732421512 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532419060 0 0) 0x7f2d7406dec0 con 0x7f2d74071de0 2024-04-16T13:05:18.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.142+0000 7f2d79e00640 1 --2- 172.21.15.67:0/732421512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009870 tx=0x7f2d6802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db96e3fb304b0aef server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.143+0000 7f2d78a00640 1 -- 172.21.15.67:0/732421512 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68035020 con 0x7f2d740ce990 2024-04-16T13:05:18.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.143+0000 7f2d78a00640 1 -- 172.21.15.67:0/732421512 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68031640 con 0x7f2d740ce990 2024-04-16T13:05:18.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.143+0000 7f2d78a00640 1 -- 172.21.15.67:0/732421512 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6802d040 con 0x7f2d740ce990 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 -- 172.21.15.67:0/732421512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 msgr2=0x7f2d7406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 --2- 172.21.15.67:0/732421512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009870 tx=0x7f2d6802b8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 -- 172.21.15.67:0/732421512 shutdown_connections 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 --2- 172.21.15.67:0/732421512 >> v2:172.21.15.82:3300/0 conn(0x7f2d7415d4d0 0x7f2d74072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 --2- 172.21.15.67:0/732421512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d740ce990 0x7f2d7406ec80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 -- 172.21.15.67:0/732421512 >> 172.21.15.67:0/732421512 conn(0x7f2d74067d90 msgr2=0x7f2d7406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 -- 172.21.15.67:0/732421512 shutdown_connections 2024-04-16T13:05:18.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.144+0000 7f2d7b200640 1 -- 172.21.15.67:0/732421512 wait complete. 2024-04-16T13:05:18.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.146+0000 7f2d7b200640 1 Processor -- start 2024-04-16T13:05:18.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.146+0000 7f2d7b200640 1 -- start start 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d740ce990 0x7f2d741520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d7415d4d0 0x7f2d741f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7415db10 con 0x7f2d74071de0 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d740ced70 con 0x7f2d740ce990 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d7b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7415ddc0 con 0x7f2d7415d4d0 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52616/0 (socket says 172.21.15.67:52616) 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 -- 172.21.15.67:0/50898503 learned_addr learned my addr 172.21.15.67:0/50898503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79400640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d740ce990 0x7f2d741520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 -- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d7415d4d0 msgr2=0x7f2d741f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d7415d4d0 0x7f2d741f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 -- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d740ce990 msgr2=0x7f2d741520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d740ce990 0x7f2d741520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.147+0000 7f2d79e00640 1 -- 172.21.15.67:0/50898503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d740c5f20 con 0x7f2d74071de0 2024-04-16T13:05:18.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d79e00640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68040070 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68039970 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68035040 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d740c6200 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.148+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d740c5890 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.150+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d74156780 con 0x7f2d74071de0 2024-04-16T13:05:18.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.150+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d6804b060 con 0x7f2d74071de0 2024-04-16T13:05:18.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.151+0000 7f2d6e000640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 0x7f2d5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.151+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d680ad750 con 0x7f2d74071de0 2024-04-16T13:05:18.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.152+0000 7f2d79400640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 0x7f2d5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.153+0000 7f2d79400640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 0x7f2d5806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b5710 tx=0x7f2d64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.156+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d74156780 con 0x7f2d74071de0 2024-04-16T13:05:18.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.359+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2d740c5a90 con 0x7f2d74071de0 2024-04-16T13:05:18.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.360+0000 7f2d6e000640 1 -- 172.21.15.67:0/50898503 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f2d6807b7a0 con 0x7f2d74071de0 2024-04-16T13:05:18.361 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 msgr2=0x7f2d5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 0x7f2d5806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b5710 tx=0x7f2d64009040 comp rx=0 tx=0).stop 2024-04-16T13:05:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 msgr2=0x7f2d740b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 shutdown_connections 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2d5806c8f0 0x7f2d5806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2d7415d4d0 0x7f2d741f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d740ce990 0x7f2d741520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 --2- 172.21.15.67:0/50898503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d74071de0 0x7f2d740b3530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 >> 172.21.15.67:0/50898503 conn(0x7f2d74067d90 msgr2=0x7f2d741569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 shutdown_connections 2024-04-16T13:05:18.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.363+0000 7f2d7b200640 1 -- 172.21.15.67:0/50898503 wait complete. 2024-04-16T13:05:18.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:18.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.607+0000 7f9f6f200640 1 Processor -- start 2024-04-16T13:05:18.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.608+0000 7f9f6f200640 1 -- start start 2024-04-16T13:05:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.609+0000 7f9f6f200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f680c6890 0x7f9f680cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.609+0000 7f9f6f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680b3700 0x7f9f680b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.609+0000 7f9f6f200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f680c6e70 con 0x7f9f6815c860 2024-04-16T13:05:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.609+0000 7f9f6f200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f9f680c7710 con 0x7f9f680c6890 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.609+0000 7f9f6f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9f680c7150 con 0x7f9f680b3700 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.610+0000 7f9f67400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f680c6890 0x7f9f680cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.610+0000 7f9f67400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f680c6890 0x7f9f680cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:44102/0 (socket says 172.21.15.67:44102) 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.610+0000 7f9f67400640 1 -- 172.21.15.67:0/2461080552 learned_addr learned my addr 172.21.15.67:0/2461080552 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.610+0000 7f9f6d200640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680b3700 0x7f9f680b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.611+0000 7f9f67400640 1 -- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680b3700 msgr2=0x7f9f680b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.611+0000 7f9f67400640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680b3700 0x7f9f680b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.611+0000 7f9f67400640 1 -- 172.21.15.67:0/2461080552 >> v1:172.21.15.82:6789/0 conn(0x7f9f6815c860 legacy=0x7f9f68160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.611+0000 7f9f67400640 1 -- 172.21.15.67:0/2461080552 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680c7430 con 0x7f9f680c6890 2024-04-16T13:05:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.612+0000 7f9f67400640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f680c6890 0x7f9f680cc9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009870 tx=0x7f9f5402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcad8fc85ac1f82f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f66a00640 1 -- 172.21.15.67:0/2461080552 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54034070 con 0x7f9f680c6890 2024-04-16T13:05:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f66a00640 1 -- 172.21.15.67:0/2461080552 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f54030840 con 0x7f9f680c6890 2024-04-16T13:05:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f66a00640 1 -- 172.21.15.67:0/2461080552 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54030c10 con 0x7f9f680c6890 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f6f200640 1 -- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f680c6890 msgr2=0x7f9f680cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f680c6890 0x7f9f680cc9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009870 tx=0x7f9f5402b980 comp rx=0 tx=0).stop 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f6f200640 1 -- 172.21.15.67:0/2461080552 shutdown_connections 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680b3700 0x7f9f680b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.613+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2461080552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f680c6890 0x7f9f680cc9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.614+0000 7f9f6f200640 1 -- 172.21.15.67:0/2461080552 >> 172.21.15.67:0/2461080552 conn(0x7f9f68067d90 msgr2=0x7f9f6806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.614+0000 7f9f6f200640 1 -- 172.21.15.67:0/2461080552 shutdown_connections 2024-04-16T13:05:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.614+0000 7f9f6f200640 1 -- 172.21.15.67:0/2461080552 wait complete. 2024-04-16T13:05:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.615+0000 7f9f6f200640 1 Processor -- start 2024-04-16T13:05:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.616+0000 7f9f6f200640 1 -- start start 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.616+0000 7f9f6f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 0x7f9f680cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6815c860 0x7f9f680ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9f681611f0 con 0x7f9f680b3700 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6815cc40 con 0x7f9f6815c860 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9f68161370 con 0x7f9f680c6890 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52622/0 (socket says 172.21.15.67:52622) 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 -- 172.21.15.67:0/2379004711 learned_addr learned my addr 172.21.15.67:0/2379004711 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67400640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 0x7f9f680cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f6d200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6815c860 0x7f9f680ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 -- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 msgr2=0x7f9f680cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 0x7f9f680cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 -- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6815c860 msgr2=0x7f9f680ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6815c860 0x7f9f680ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67e00640 1 -- 172.21.15.67:0/2379004711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f680ce990 con 0x7f9f680b3700 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.617+0000 7f9f67400640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 0x7f9f680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:18.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f67e00640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c760 tx=0x7f9f5800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58016020 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58006d50 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f680c8cf0 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58003bb0 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.618+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f680ce670 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.619+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f68068a70 con 0x7f9f680b3700 2024-04-16T13:05:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.621+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f5800a850 con 0x7f9f680b3700 2024-04-16T13:05:18.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.622+0000 7f9f5fe00640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:18.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.622+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9f5808bb50 con 0x7f9f680b3700 2024-04-16T13:05:18.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.623+0000 7f9f67400640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:18.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.624+0000 7f9f67400640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 0x7f9f4806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f54036000 tx=0x7f9f5403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.627+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f58020020 con 0x7f9f680b3700 2024-04-16T13:05:18.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.828+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9f680b49f0 con 0x7f9f680b3700 2024-04-16T13:05:18.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.830+0000 7f9f5fe00640 1 -- 172.21.15.67:0/2379004711 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f9f58019310 con 0x7f9f680b3700 2024-04-16T13:05:18.831 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 msgr2=0x7f9f4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 0x7f9f4806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f54036000 tx=0x7f9f5403b040 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 msgr2=0x7f9f680cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c760 tx=0x7f9f5800cc20 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 shutdown_connections 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f6815c860 0x7f9f680ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9f680c6890 0x7f9f680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 --2- 172.21.15.67:0/2379004711 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f680b3700 0x7f9f680cb140 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.832+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 >> 172.21.15.67:0/2379004711 conn(0x7f9f68067d90 msgr2=0x7f9f68072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:18.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.833+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 shutdown_connections 2024-04-16T13:05:18.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:18.833+0000 7f9f6f200640 1 -- 172.21.15.67:0/2379004711 wait complete. 2024-04-16T13:05:18.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:05:19.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.069+0000 7f8b9a000640 1 Processor -- start 2024-04-16T13:05:19.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.069+0000 7f8b9a000640 1 -- start start 2024-04-16T13:05:19.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b9a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b9415e560 0x7f8b9415f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b9a000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94162ae0 0x7f8b940c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b9a000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b94162300 con 0x7f8b9415e940 2024-04-16T13:05:19.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b9a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8b940c58e0 con 0x7f8b9415e560 2024-04-16T13:05:19.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b9a000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b940c5bc0 con 0x7f8b94162ae0 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b98c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b9415e560 0x7f8b9415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b98c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8b9415e560 0x7f8b9415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52624/0 (socket says 172.21.15.67:52624) 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.071+0000 7f8b98c00640 1 -- 172.21.15.67:0/3791374791 learned_addr learned my addr 172.21.15.67:0/3791374791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.072+0000 7f8b99600640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94162ae0 0x7f8b940c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.072+0000 7f8b98c00640 1 -- 172.21.15.67:0/3791374791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94162ae0 msgr2=0x7f8b940c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.072+0000 7f8b98c00640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94162ae0 0x7f8b940c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.072+0000 7f8b98c00640 1 -- 172.21.15.67:0/3791374791 >> v1:172.21.15.82:6789/0 conn(0x7f8b9415e940 legacy=0x7f8b940c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:19.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.072+0000 7f8b98c00640 1 -- 172.21.15.67:0/3791374791 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b940c5ea0 con 0x7f8b9415e560 2024-04-16T13:05:19.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.073+0000 7f8b98c00640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9415f840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009870 tx=0x7f8b8802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff9966896282bd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.073+0000 7f8b93400640 1 -- 172.21.15.67:0/3791374791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880317c0 con 0x7f8b9415e560 2024-04-16T13:05:19.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.073+0000 7f8b93400640 1 -- 172.21.15.67:0/3791374791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b88037070 con 0x7f8b9415e560 2024-04-16T13:05:19.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.073+0000 7f8b93400640 1 -- 172.21.15.67:0/3791374791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88031b80 con 0x7f8b9415e560 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.074+0000 7f8b9a000640 1 -- 172.21.15.67:0/3791374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 msgr2=0x7f8b9415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.074+0000 7f8b9a000640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9415f840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009870 tx=0x7f8b8802b860 comp rx=0 tx=0).stop 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 -- 172.21.15.67:0/3791374791 shutdown_connections 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b94162ae0 0x7f8b940c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 --2- 172.21.15.67:0/3791374791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9415f840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 -- 172.21.15.67:0/3791374791 >> 172.21.15.67:0/3791374791 conn(0x7f8b940b2070 msgr2=0x7f8b940b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 -- 172.21.15.67:0/3791374791 shutdown_connections 2024-04-16T13:05:19.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.075+0000 7f8b9a000640 1 -- 172.21.15.67:0/3791374791 wait complete. 2024-04-16T13:05:19.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.077+0000 7f8b9a000640 1 Processor -- start 2024-04-16T13:05:19.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.077+0000 7f8b9a000640 1 -- start start 2024-04-16T13:05:19.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 0x7f8b940c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94162ae0 0x7f8b94160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94163110 con 0x7f8b9415e560 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94162f90 con 0x7f8b94162ae0 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.078+0000 7f8b9a000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8b940c68f0 con 0x7f8b9415e940 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52636/0 (socket says 172.21.15.67:52636) 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 -- 172.21.15.67:0/2585620184 learned_addr learned my addr 172.21.15.67:0/2585620184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:19.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b99600640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94162ae0 0x7f8b94160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 -- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 msgr2=0x7f8b940c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b93e00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 0x7f8b940c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 0x7f8b940c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 -- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94162ae0 msgr2=0x7f8b94160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94162ae0 0x7f8b94160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b98c00640 1 -- 172.21.15.67:0/2585620184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9414f100 con 0x7f8b9415e560 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.079+0000 7f8b93e00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 0x7f8b940c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b98c00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009870 tx=0x7f8b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88032650 con 0x7f8b9415e560 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b880327f0 con 0x7f8b9415e560 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88032be0 con 0x7f8b9415e560 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9414f3e0 con 0x7f8b9415e560 2024-04-16T13:05:19.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.080+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9414f9a0 con 0x7f8b9415e560 2024-04-16T13:05:19.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.081+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b94075bd0 con 0x7f8b9415e560 2024-04-16T13:05:19.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.082+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b8804c060 con 0x7f8b9415e560 2024-04-16T13:05:19.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.083+0000 7f8b90c00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 0x7f8b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.083+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b880ad850 con 0x7f8b9415e560 2024-04-16T13:05:19.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.084+0000 7f8b93e00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 0x7f8b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.085+0000 7f8b93e00640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 0x7f8b7406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b941f7b80 tx=0x7f8b80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.087+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b88040070 con 0x7f8b9415e560 2024-04-16T13:05:19.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.332+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b940b3fc0 con 0x7f8b9415e560 2024-04-16T13:05:19.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.333+0000 7f8b90c00640 1 -- 172.21.15.67:0/2585620184 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f8b8807b930 con 0x7f8b9415e560 2024-04-16T13:05:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:19.335 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:05:19.335 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 msgr2=0x7f8b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 0x7f8b7406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b941f7b80 tx=0x7f8b80009040 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 msgr2=0x7f8b9406f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009870 tx=0x7f8b880046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 shutdown_connections 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8b7406c8f0 0x7f8b7406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b94162ae0 0x7f8b94160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8b9415e940 0x7f8b940c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 --2- 172.21.15.67:0/2585620184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9415e560 0x7f8b9406f8a0 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009870 tx=0x7f8b880046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.336+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 >> 172.21.15.67:0/2585620184 conn(0x7f8b940b2070 msgr2=0x7f8b940b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.337+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 shutdown_connections 2024-04-16T13:05:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.337+0000 7f8b9a000640 1 -- 172.21.15.67:0/2585620184 wait complete. 2024-04-16T13:05:19.358 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:19.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.577+0000 7fd223000640 1 Processor -- start 2024-04-16T13:05:19.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.577+0000 7fd223000640 1 -- start start 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c0d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd21c0d5220 0x7fd21c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd21c06d8a0 0x7fd21c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0d0c10 con 0x7fd21c0d5220 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0d0000 con 0x7fd21c06d8a0 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd223000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0d02e0 con 0x7fd21c15eaa0 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd221200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd21c0d5220 0x7fd21c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd221200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd21c0d5220 0x7fd21c06d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52644/0 (socket says 172.21.15.67:52644) 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.579+0000 7fd221200640 1 -- 172.21.15.67:0/788618911 learned_addr learned my addr 172.21.15.67:0/788618911 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:19.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd222600640 1 --2- 172.21.15.67:0/788618911 >> v2:172.21.15.82:3300/0 conn(0x7fd21c06d8a0 0x7fd21c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221c00640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c0d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221200640 1 -- 172.21.15.67:0/788618911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 msgr2=0x7fd21c0d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221200640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c0d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221200640 1 -- 172.21.15.67:0/788618911 >> v2:172.21.15.82:3300/0 conn(0x7fd21c06d8a0 msgr2=0x7fd21c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221200640 1 --2- 172.21.15.67:0/788618911 >> v2:172.21.15.82:3300/0 conn(0x7fd21c06d8a0 0x7fd21c0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221200640 1 -- 172.21.15.67:0/788618911 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0d05c0 con 0x7fd21c0d5220 2024-04-16T13:05:19.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.580+0000 7fd221c00640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c0d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:19.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.581+0000 7fd221200640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c06d360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0ba620 tx=0x7fd20802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc6b648a0b87baf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.581+0000 7fd21be00640 1 -- 172.21.15.67:0/788618911 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20802e070 con 0x7fd21c0d5220 2024-04-16T13:05:19.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.581+0000 7fd21be00640 1 -- 172.21.15.67:0/788618911 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208037070 con 0x7fd21c0d5220 2024-04-16T13:05:19.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd21be00640 1 -- 172.21.15.67:0/788618911 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208031a00 con 0x7fd21c0d5220 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 -- 172.21.15.67:0/788618911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 msgr2=0x7fd21c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c06d360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0ba620 tx=0x7fd20802b880 comp rx=0 tx=0).stop 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 -- 172.21.15.67:0/788618911 shutdown_connections 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 --2- 172.21.15.67:0/788618911 >> v2:172.21.15.82:3300/0 conn(0x7fd21c06d8a0 0x7fd21c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c06d360 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 --2- 172.21.15.67:0/788618911 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c0d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 -- 172.21.15.67:0/788618911 >> 172.21.15.67:0/788618911 conn(0x7fd21c08c000 msgr2=0x7fd21c0d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 -- 172.21.15.67:0/788618911 shutdown_connections 2024-04-16T13:05:19.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.582+0000 7fd223000640 1 -- 172.21.15.67:0/788618911 wait complete. 2024-04-16T13:05:19.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.584+0000 7fd223000640 1 Processor -- start 2024-04-16T13:05:19.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.584+0000 7fd223000640 1 -- start start 2024-04-16T13:05:19.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c06d8a0 0x7fd21c0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c06ceb0 con 0x7fd21c0d5220 2024-04-16T13:05:19.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15ee80 con 0x7fd21c06d8a0 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd223000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0d1500 con 0x7fd21c15eaa0 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.585+0000 7fd221200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52652/0 (socket says 172.21.15.67:52652) 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 -- 172.21.15.67:0/98814274 learned_addr learned my addr 172.21.15.67:0/98814274 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221c00640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c06d8a0 0x7fd21c0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd222600640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 -- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 msgr2=0x7fd21c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 -- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c06d8a0 msgr2=0x7fd21c0b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c06d8a0 0x7fd21c0b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 -- 172.21.15.67:0/98814274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0b7fa0 con 0x7fd21c0d5220 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd222600640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:19.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.586+0000 7fd221200640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.587+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208032880 con 0x7fd21c0d5220 2024-04-16T13:05:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.587+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208032a20 con 0x7fd21c0d5220 2024-04-16T13:05:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.587+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208032e10 con 0x7fd21c0d5220 2024-04-16T13:05:19.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.587+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c0b8280 con 0x7fd21c0d5220 2024-04-16T13:05:19.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.587+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c0b8840 con 0x7fd21c0d5220 2024-04-16T13:05:19.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.588+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c06e100 con 0x7fd21c0d5220 2024-04-16T13:05:19.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.589+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2080453f0 con 0x7fd21c0d5220 2024-04-16T13:05:19.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.590+0000 7fd219600640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.591+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd2080adf20 con 0x7fd21c0d5220 2024-04-16T13:05:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.591+0000 7fd221c00640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.592+0000 7fd221c00640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd21000a950 tx=0x7fd210008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:19.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.595+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd21c06e100 con 0x7fd21c0d5220 2024-04-16T13:05:19.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.799+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd21c075bd0 con 0x7fd21c0d5220 2024-04-16T13:05:19.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.802+0000 7fd219600640 1 -- 172.21.15.67:0/98814274 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7fd208040070 con 0x7fd21c0d5220 2024-04-16T13:05:19.803 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:19.804 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.804+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 msgr2=0x7fd1fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.804+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd21000a950 tx=0x7fd210008040 comp rx=0 tx=0).stop 2024-04-16T13:05:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.804+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 msgr2=0x7fd21c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.804+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd2080046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 shutdown_connections 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd1fc06c8f0 0x7fd1fc06edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd21c15eaa0 0x7fd21c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd21c0d5220 0x7fd21c153650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 --2- 172.21.15.67:0/98814274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd21c06d8a0 0x7fd21c0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 >> 172.21.15.67:0/98814274 conn(0x7fd21c08c000 msgr2=0x7fd21c0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 shutdown_connections 2024-04-16T13:05:19.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:19.805+0000 7fd223000640 1 -- 172.21.15.67:0/98814274 wait complete. 2024-04-16T13:05:19.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:19.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:20.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.051+0000 7f021d200640 1 Processor -- start 2024-04-16T13:05:20.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.051+0000 7f021d200640 1 -- start start 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.052+0000 7f021d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f021815c730 0x7f021815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.052+0000 7f021d200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f021806f9c0 con 0x7f02180d0200 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.052+0000 7f021d200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02180ad730 con 0x7f021815c350 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.052+0000 7f021d200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f02180ada10 con 0x7f021815c730 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0216a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f021815c730 0x7f021815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0217e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f02180d0200 0x7f02180d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38200/0 (socket says 172.21.15.67:38200) 2024-04-16T13:05:20.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0217e00640 1 -- 172.21.15.67:0/2470538935 learned_addr learned my addr 172.21.15.67:0/2470538935 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0216a00640 1 -- 172.21.15.67:0/2470538935 >> v1:172.21.15.82:6789/0 conn(0x7f021815c350 legacy=0x7f02180cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0216a00640 1 -- 172.21.15.67:0/2470538935 >> v1:172.21.15.67:6789/0 conn(0x7f02180d0200 legacy=0x7f02180d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.053+0000 7f0216a00640 1 -- 172.21.15.67:0/2470538935 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021815cc10 con 0x7f021815c730 2024-04-16T13:05:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.054+0000 7f0216a00640 1 --2- 172.21.15.67:0/2470538935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c730 0x7f021815d6f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02040097a0 tx=0x7f020402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6d6daa54c0b725 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f0216000640 1 -- 172.21.15.67:0/2470538935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204035020 con 0x7f021815c730 2024-04-16T13:05:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f0216000640 1 -- 172.21.15.67:0/2470538935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0204031830 con 0x7f021815c730 2024-04-16T13:05:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f0216000640 1 -- 172.21.15.67:0/2470538935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204031c00 con 0x7f021815c730 2024-04-16T13:05:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 -- 172.21.15.67:0/2470538935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c730 msgr2=0x7f021815d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 --2- 172.21.15.67:0/2470538935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c730 0x7f021815d6f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f02040097a0 tx=0x7f020402b8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 -- 172.21.15.67:0/2470538935 shutdown_connections 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 --2- 172.21.15.67:0/2470538935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c730 0x7f021815d6f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 -- 172.21.15.67:0/2470538935 >> 172.21.15.67:0/2470538935 conn(0x7f02180b21e0 msgr2=0x7f02180b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 -- 172.21.15.67:0/2470538935 shutdown_connections 2024-04-16T13:05:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.055+0000 7f021d200640 1 -- 172.21.15.67:0/2470538935 wait complete. 2024-04-16T13:05:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.057+0000 7f021d200640 1 Processor -- start 2024-04-16T13:05:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.057+0000 7f021d200640 1 -- start start 2024-04-16T13:05:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 0x7f02181492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 0x7f0218153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02180ad2e0 con 0x7f021815c350 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f021815d1d0 con 0x7f02180d0200 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f021d200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f02180ad460 con 0x7f021815c730 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.058+0000 7f0216a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52666/0 (socket says 172.21.15.67:52666) 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 -- 172.21.15.67:0/1378618842 learned_addr learned my addr 172.21.15.67:0/1378618842 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0217400640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 0x7f02181492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0217e00640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 0x7f0218153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 -- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 msgr2=0x7f0218153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 0x7f0218153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 -- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 msgr2=0x7f02181492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 0x7f02181492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0216a00640 1 -- 172.21.15.67:0/1378618842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0218073a90 con 0x7f021815c350 2024-04-16T13:05:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0217400640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 0x7f02181492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.059+0000 7f0217e00640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 0x7f0218153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f0216a00640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f020402bee0 tx=0x7f02040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204041070 con 0x7f021815c350 2024-04-16T13:05:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020403aa30 con 0x7f021815c350 2024-04-16T13:05:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204035040 con 0x7f021815c350 2024-04-16T13:05:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02180728a0 con 0x7f021815c350 2024-04-16T13:05:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.060+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0218156900 con 0x7f021815c350 2024-04-16T13:05:20.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.061+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218075bd0 con 0x7f021815c350 2024-04-16T13:05:20.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.062+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0204038020 con 0x7f021815c350 2024-04-16T13:05:20.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.063+0000 7f020f400640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 0x7f01f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.063+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02040adab0 con 0x7f021815c350 2024-04-16T13:05:20.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.064+0000 7f0217400640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 0x7f01f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.065+0000 7f0217400640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 0x7f01f806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0208003eb0 tx=0x7f0208009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.068+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f020407bb00 con 0x7f021815c350 2024-04-16T13:05:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.279+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f021806f2b0 con 0x7f021815c350 2024-04-16T13:05:20.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.280+0000 7f020f400640 1 -- 172.21.15.67:0/1378618842 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f020407b400 con 0x7f021815c350 2024-04-16T13:05:20.282 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:20.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 msgr2=0x7f01f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 0x7f01f806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0208003eb0 tx=0x7f0208009040 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 msgr2=0x7f02181563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f020402bee0 tx=0x7f02040046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 shutdown_connections 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01f806c8f0 0x7f01f806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f021815c730 0x7f0218153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f021815c350 0x7f02181563c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 --2- 172.21.15.67:0/1378618842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02180d0200 0x7f02181492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 >> 172.21.15.67:0/1378618842 conn(0x7f02180b21e0 msgr2=0x7f02180b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.283+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 shutdown_connections 2024-04-16T13:05:20.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.284+0000 7f021d200640 1 -- 172.21.15.67:0/1378618842 wait complete. 2024-04-16T13:05:20.304 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:20.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.531+0000 7f359b200640 1 Processor -- start 2024-04-16T13:05:20.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.531+0000 7f359b200640 1 -- start start 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.532+0000 7f359b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c0ce990 0x7f359c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.532+0000 7f359b200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f359c071de0 0x7f359c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.532+0000 7f359b200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f359c15cdc0 0x7f359c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359b200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f359c072780 con 0x7f359c15cdc0 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359b200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f359c06e7f0 con 0x7f359c071de0 2024-04-16T13:05:20.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f359c06dec0 con 0x7f359c0ce990 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f359c15cdc0 0x7f359c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f359c15cdc0 0x7f359c15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52672/0 (socket says 172.21.15.67:52672) 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f359a800640 1 -- 172.21.15.67:0/302733060 learned_addr learned my addr 172.21.15.67:0/302733060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f3599e00640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c0ce990 0x7f359c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.533+0000 7f3593e00640 1 --2- 172.21.15.67:0/302733060 >> v2:172.21.15.82:3300/0 conn(0x7f359c071de0 0x7f359c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.534+0000 7f359a800640 1 -- 172.21.15.67:0/302733060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c0ce990 msgr2=0x7f359c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:20.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.534+0000 7f359a800640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c0ce990 0x7f359c06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.534+0000 7f359a800640 1 -- 172.21.15.67:0/302733060 >> v2:172.21.15.82:3300/0 conn(0x7f359c071de0 msgr2=0x7f359c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:20.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.534+0000 7f359a800640 1 --2- 172.21.15.67:0/302733060 >> v2:172.21.15.82:3300/0 conn(0x7f359c071de0 0x7f359c072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.534+0000 7f359a800640 1 -- 172.21.15.67:0/302733060 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c06e1a0 con 0x7f359c15cdc0 2024-04-16T13:05:20.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.535+0000 7f359a800640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c15d250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f359c0b5850 tx=0x7f359402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ea6334e4879730 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.535+0000 7f3599400640 1 -- 172.21.15.67:0/302733060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359402c9e0 con 0x7f359c15cdc0 2024-04-16T13:05:20.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.535+0000 7f3599400640 1 -- 172.21.15.67:0/302733060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359402cb80 con 0x7f359c15cdc0 2024-04-16T13:05:20.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.535+0000 7f3599400640 1 -- 172.21.15.67:0/302733060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940343f0 con 0x7f359c15cdc0 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 -- 172.21.15.67:0/302733060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 msgr2=0x7f359c15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c15d250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f359c0b5850 tx=0x7f359402be40 comp rx=0 tx=0).stop 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 -- 172.21.15.67:0/302733060 shutdown_connections 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c15d250 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 --2- 172.21.15.67:0/302733060 >> v2:172.21.15.82:3300/0 conn(0x7f359c071de0 0x7f359c072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 --2- 172.21.15.67:0/302733060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c0ce990 0x7f359c06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 -- 172.21.15.67:0/302733060 >> 172.21.15.67:0/302733060 conn(0x7f359c067d90 msgr2=0x7f359c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 -- 172.21.15.67:0/302733060 shutdown_connections 2024-04-16T13:05:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.536+0000 7f359b200640 1 -- 172.21.15.67:0/302733060 wait complete. 2024-04-16T13:05:20.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.538+0000 7f359b200640 1 Processor -- start 2024-04-16T13:05:20.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.538+0000 7f359b200640 1 -- start start 2024-04-16T13:05:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c071de0 0x7f359c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0ce990 0x7f359c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f359c15db10 con 0x7f359c15cdc0 2024-04-16T13:05:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0ced70 con 0x7f359c0ce990 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f359c15d790 con 0x7f359c071de0 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52688/0 (socket says 172.21.15.67:52688) 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f359a800640 1 -- 172.21.15.67:0/1109744895 learned_addr learned my addr 172.21.15.67:0/1109744895 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f3593e00640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0ce990 0x7f359c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.539+0000 7f3599e00640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c071de0 0x7f359c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 -- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c071de0 msgr2=0x7f359c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c071de0 0x7f359c0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 -- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0ce990 msgr2=0x7f359c155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0ce990 0x7f359c155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 -- 172.21.15.67:0/1109744895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c0c5c10 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359a800640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3594009f40 tx=0x7f3594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594044020 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3594040690 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594009510 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c0c5ef0 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.540+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c0b3660 con 0x7f359c15cdc0 2024-04-16T13:05:20.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.542+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c15d570 con 0x7f359c15cdc0 2024-04-16T13:05:20.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.543+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3594047020 con 0x7f359c15cdc0 2024-04-16T13:05:20.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.543+0000 7f3592000640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:20.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.544+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35940ae6c0 con 0x7f359c15cdc0 2024-04-16T13:05:20.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.544+0000 7f3599e00640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:20.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.545+0000 7f3599e00640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 0x7f357806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:20.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.548+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f359c15d570 con 0x7f359c15cdc0 2024-04-16T13:05:20.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.751+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f359c075bd0 con 0x7f359c15cdc0 2024-04-16T13:05:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.752+0000 7f3592000640 1 -- 172.21.15.67:0/1109744895 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f359404e070 con 0x7f359c15cdc0 2024-04-16T13:05:20.753 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 msgr2=0x7f357806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 0x7f357806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f358c006fd0 tx=0x7f358c008040 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 msgr2=0x7f359c159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3594009f40 tx=0x7f3594004a40 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 shutdown_connections 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f357806c8f0 0x7f357806edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f359c15cdc0 0x7f359c159490 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359c0ce990 0x7f359c155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 --2- 172.21.15.67:0/1109744895 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f359c071de0 0x7f359c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.755+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 >> 172.21.15.67:0/1109744895 conn(0x7f359c067d90 msgr2=0x7f359c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.756+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 shutdown_connections 2024-04-16T13:05:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.756+0000 7f359b200640 1 -- 172.21.15.67:0/1109744895 wait complete. 2024-04-16T13:05:20.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.998+0000 7fc293200640 1 Processor -- start 2024-04-16T13:05:20.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:20.998+0000 7fc293200640 1 -- start start 2024-04-16T13:05:21.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c13e5d0 0x7fc28c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 0x7fc28c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc28c13ebb0 0x7fc28c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc28c15bc40 con 0x7fc28c13ebb0 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc28c15bf20 con 0x7fc28c0cff40 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.000+0000 7fc293200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c15c200 con 0x7fc28c13e5d0 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc28c13ebb0 0x7fc28c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc28c13ebb0 0x7fc28c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52702/0 (socket says 172.21.15.67:52702) 2024-04-16T13:05:21.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 -- 172.21.15.67:0/2437651700 learned_addr learned my addr 172.21.15.67:0/2437651700 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc291400640 1 --2- 172.21.15.67:0/2437651700 >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 0x7fc28c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc291e00640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c13e5d0 0x7fc28c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 -- 172.21.15.67:0/2437651700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c13e5d0 msgr2=0x7fc28c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c13e5d0 0x7fc28c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 -- 172.21.15.67:0/2437651700 >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 msgr2=0x7fc28c06ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 --2- 172.21.15.67:0/2437651700 >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 0x7fc28c06ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc292800640 1 -- 172.21.15.67:0/2437651700 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c15c4e0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.001+0000 7fc291400640 1 --2- 172.21.15.67:0/2437651700 >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 0x7fc28c06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.002+0000 7fc292800640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c06f470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc28c072f00 tx=0x7fc28802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00e0f4d35e828bf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.003+0000 7fc290a00640 1 -- 172.21.15.67:0/2437651700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28802ca70 con 0x7fc28c13ebb0 2024-04-16T13:05:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.003+0000 7fc290a00640 1 -- 172.21.15.67:0/2437651700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28802cc10 con 0x7fc28c13ebb0 2024-04-16T13:05:21.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.003+0000 7fc290a00640 1 -- 172.21.15.67:0/2437651700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880343f0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.003+0000 7fc293200640 1 -- 172.21.15.67:0/2437651700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 msgr2=0x7fc28c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.003+0000 7fc293200640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c06f470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc28c072f00 tx=0x7fc28802bed0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 -- 172.21.15.67:0/2437651700 shutdown_connections 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c06f470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 --2- 172.21.15.67:0/2437651700 >> v2:172.21.15.82:3300/0 conn(0x7fc28c0cff40 0x7fc28c06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 --2- 172.21.15.67:0/2437651700 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c13e5d0 0x7fc28c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 -- 172.21.15.67:0/2437651700 >> 172.21.15.67:0/2437651700 conn(0x7fc28c067d90 msgr2=0x7fc28c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 -- 172.21.15.67:0/2437651700 shutdown_connections 2024-04-16T13:05:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.004+0000 7fc293200640 1 -- 172.21.15.67:0/2437651700 wait complete. 2024-04-16T13:05:21.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.006+0000 7fc293200640 1 Processor -- start 2024-04-16T13:05:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.006+0000 7fc293200640 1 -- start start 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c0cff40 0x7fc28c142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c13e5d0 0x7fc28c143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0afea0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c0afd20 con 0x7fc28c13e5d0 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc293200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc28c071de0 con 0x7fc28c0cff40 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc292800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc292800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52706/0 (socket says 172.21.15.67:52706) 2024-04-16T13:05:21.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc292800640 1 -- 172.21.15.67:0/2971636745 learned_addr learned my addr 172.21.15.67:0/2971636745 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc291e00640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c0cff40 0x7fc28c142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.007+0000 7fc291400640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c13e5d0 0x7fc28c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 -- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c0cff40 msgr2=0x7fc28c142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c0cff40 0x7fc28c142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 -- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c13e5d0 msgr2=0x7fc28c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c13e5d0 0x7fc28c143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 -- 172.21.15.67:0/2971636745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1f58c0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc292800640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc288036040 tx=0x7fc288004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288043020 con 0x7fc28c13ebb0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28803e450 con 0x7fc28c13ebb0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288009510 con 0x7fc28c13ebb0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.008+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1f4d40 con 0x7fc28c13ebb0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.009+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1f5300 con 0x7fc28c13ebb0 2024-04-16T13:05:21.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.010+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c075bd0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.011+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc288046020 con 0x7fc28c13ebb0 2024-04-16T13:05:21.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.011+0000 7fc286000640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.012+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2880ae5e0 con 0x7fc28c13ebb0 2024-04-16T13:05:21.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.012+0000 7fc291e00640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.013+0000 7fc291e00640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 0x7fc27006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc280006fd0 tx=0x7fc280008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.017+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc28804d030 con 0x7fc28c13ebb0 2024-04-16T13:05:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.220+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc28c0aa640 con 0x7fc28c13ebb0 2024-04-16T13:05:21.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.221+0000 7fc286000640 1 -- 172.21.15.67:0/2971636745 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc28807c760 con 0x7fc28c13ebb0 2024-04-16T13:05:21.223 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 msgr2=0x7fc27006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 0x7fc27006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc280006fd0 tx=0x7fc280008040 comp rx=0 tx=0).stop 2024-04-16T13:05:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 msgr2=0x7fc28c1441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc288036040 tx=0x7fc288004a40 comp rx=0 tx=0).stop 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 shutdown_connections 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc27006c8f0 0x7fc27006edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc28c13ebb0 0x7fc28c1441d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c13e5d0 0x7fc28c143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 --2- 172.21.15.67:0/2971636745 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc28c0cff40 0x7fc28c142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 >> 172.21.15.67:0/2971636745 conn(0x7fc28c067d90 msgr2=0x7fc28c0b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 shutdown_connections 2024-04-16T13:05:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.224+0000 7fc293200640 1 -- 172.21.15.67:0/2971636745 wait complete. 2024-04-16T13:05:21.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:21.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.460+0000 7fe12dc00640 1 Processor -- start 2024-04-16T13:05:21.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.460+0000 7fe12dc00640 1 -- start start 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.461+0000 7fe12dc00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe12815e7e0 0x7fe1280d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.461+0000 7fe12dc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1280d2b10 con 0x7fe1280d17f0 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.461+0000 7fe12dc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1280d2df0 con 0x7fe1280d22c0 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.461+0000 7fe12dc00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe1280d30d0 con 0x7fe12815e7e0 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.462+0000 7fe12d200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe1280d17f0 0x7fe12806d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38210/0 (socket says 172.21.15.67:38210) 2024-04-16T13:05:21.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.462+0000 7fe12d200640 1 -- 172.21.15.67:0/1718512272 learned_addr learned my addr 172.21.15.67:0/1718512272 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.462+0000 7fe127e00640 1 --2- 172.21.15.67:0/1718512272 >> v2:172.21.15.82:3300/0 conn(0x7fe12815e7e0 0x7fe1280d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.462+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171321881 0 0) 0x7fe1280d2b10 con 0x7fe1280d17f0 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.462+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe10c003520 con 0x7fe1280d17f0 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4258949930 0 0) 0x7fe10c003520 con 0x7fe1280d17f0 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 >> v2:172.21.15.82:3300/0 conn(0x7fe12815e7e0 msgr2=0x7fe1280d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 --2- 172.21.15.67:0/1718512272 >> v2:172.21.15.82:3300/0 conn(0x7fe12815e7e0 0x7fe1280d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 >> v1:172.21.15.82:6789/0 conn(0x7fe1280d22c0 legacy=0x7fe1280d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280d33b0 con 0x7fe1280d17f0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fe120001670 con 0x7fe1280d17f0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 >> v1:172.21.15.67:6789/0 conn(0x7fe1280d17f0 legacy=0x7fe12806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 0x7fe10c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10c004800 0x7fe10c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0051c0 0x7fe10c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280d30d0 con 0x7fe10c0039b0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c00c060 con 0x7fe10c004800 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c00c260 con 0x7fe10c0051c0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe127e00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 0x7fe10c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe127400640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10c004800 0x7fe10c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.463+0000 7fe127e00640 1 -- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0051c0 msgr2=0x7fe10c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe12d200640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0051c0 0x7fe10c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe127e00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0051c0 0x7fe10c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe127e00640 1 -- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10c004800 msgr2=0x7fe10c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe127e00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe10c004800 0x7fe10c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe127e00640 1 -- 172.21.15.67:0/1718512272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c003520 con 0x7fe10c0039b0 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe12d200640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0051c0 0x7fe10c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:21.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.464+0000 7fe12d200640 1 -- 172.21.15.67:0/1718512272 reap_dead start 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.465+0000 7fe127e00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 0x7fe10c003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe110009ab0 tx=0x7fe10c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b061dd91115dec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.465+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110009680 con 0x7fe10c0039b0 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.465+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe110005990 con 0x7fe10c0039b0 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.465+0000 7fe126a00640 1 -- 172.21.15.67:0/1718512272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110005d80 con 0x7fe10c0039b0 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 -- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 msgr2=0x7fe10c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 0x7fe10c003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe110009ab0 tx=0x7fe10c005830 comp rx=0 tx=0).stop 2024-04-16T13:05:21.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 -- 172.21.15.67:0/1718512272 shutdown_connections 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 --2- 172.21.15.67:0/1718512272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe10c0039b0 0x7fe10c003dd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 -- 172.21.15.67:0/1718512272 >> 172.21.15.67:0/1718512272 conn(0x7fe12809da60 msgr2=0x7fe12808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 -- 172.21.15.67:0/1718512272 shutdown_connections 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.466+0000 7fe12dc00640 1 -- 172.21.15.67:0/1718512272 wait complete. 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.468+0000 7fe12dc00640 1 Processor -- start 2024-04-16T13:05:21.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.468+0000 7fe12dc00640 1 -- start start 2024-04-16T13:05:21.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0039b0 0x7fe1280b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12815f430 0x7fe12809f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280d28d0 con 0x7fe12815b8d0 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280d2750 con 0x7fe12815f430 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12dc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe12815ebc0 con 0x7fe10c0039b0 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe127400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe127400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52732/0 (socket says 172.21.15.67:52732) 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe127400640 1 -- 172.21.15.67:0/863726665 learned_addr learned my addr 172.21.15.67:0/863726665 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe127e00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0039b0 0x7fe1280b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.469+0000 7fe12d200640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12815f430 0x7fe12809f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 -- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0039b0 msgr2=0x7fe1280b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0039b0 0x7fe1280b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 -- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12815f430 msgr2=0x7fe12809f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12815f430 0x7fe12809f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 -- 172.21.15.67:0/863726665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280b7820 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe127400640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe11800e870 tx=0x7fe11800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118003b80 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe118018070 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1180050d0 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.470+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1280b7ad0 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.471+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1280b8090 con 0x7fe12815b8d0 2024-04-16T13:05:21.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.472+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe128075bd0 con 0x7fe12815b8d0 2024-04-16T13:05:21.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.473+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe118005270 con 0x7fe12815b8d0 2024-04-16T13:05:21.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.473+0000 7fe11fe00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 0x7fe10406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.474+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe11808bf20 con 0x7fe12815b8d0 2024-04-16T13:05:21.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.474+0000 7fe127e00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 0x7fe10406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.475+0000 7fe127e00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 0x7fe10406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe110035000 tx=0x7fe110030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.478+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe11801a310 con 0x7fe12815b8d0 2024-04-16T13:05:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.679+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe1280cd470 con 0x7fe12815b8d0 2024-04-16T13:05:21.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.680+0000 7fe11fe00640 1 -- 172.21.15.67:0/863726665 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fe118059f70 con 0x7fe12815b8d0 2024-04-16T13:05:21.682 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 msgr2=0x7fe10406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 0x7fe10406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe110035000 tx=0x7fe110030000 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 msgr2=0x7fe12815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe11800e870 tx=0x7fe11800ed30 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 shutdown_connections 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe10406c8f0 0x7fe10406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12815f430 0x7fe12809f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe12815b8d0 0x7fe12815eef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 --2- 172.21.15.67:0/863726665 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe10c0039b0 0x7fe1280b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 >> 172.21.15.67:0/863726665 conn(0x7fe12809da60 msgr2=0x7fe1280cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 shutdown_connections 2024-04-16T13:05:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.683+0000 7fe12dc00640 1 -- 172.21.15.67:0/863726665 wait complete. 2024-04-16T13:05:21.703 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:05:21.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.920+0000 7f26fdc00640 1 Processor -- start 2024-04-16T13:05:21.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.920+0000 7f26fdc00640 1 -- start start 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26f81600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fdc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f8160ad0 con 0x7f26f80ad880 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fdc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f8160db0 con 0x7f26f8160630 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fdc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26f8161090 con 0x7f26f815c6f0 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fd200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f26f80ad880 0x7f26f806e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35972/0 (socket says 172.21.15.67:35972) 2024-04-16T13:05:21.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.922+0000 7f26fd200640 1 -- 172.21.15.67:0/968308603 learned_addr learned my addr 172.21.15.67:0/968308603 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:21.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7e00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26f81600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231093468 0 0) 0x7f26f8160ad0 con 0x7f26f80ad880 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc003520 con 0x7f26f80ad880 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1037900701 0 0) 0x7f26dc003520 con 0x7f26f80ad880 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 msgr2=0x7f26f81600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26f81600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 >> v1:172.21.15.82:6789/0 conn(0x7f26f8160630 legacy=0x7f26f80ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f806dda0 con 0x7f26f80ad880 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f26f0001670 con 0x7f26f80ad880 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 >> v1:172.21.15.67:6789/0 conn(0x7f26f80ad880 legacy=0x7f26f806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26dc0039e0 0x7f26dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26dc004d40 0x7f26dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc00ba70 con 0x7f26dc0039e0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc00bc20 con 0x7f26dc004d40 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.923+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26dc00be20 con 0x7f26f815c6f0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26dc0039e0 0x7f26dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26ef400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26fd200640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26dc004d40 0x7f26dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 -- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 msgr2=0x7f26dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 -- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26dc004d40 msgr2=0x7f26dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26dc004d40 0x7f26dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26f7e00640 1 -- 172.21.15.67:0/968308603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc003520 con 0x7f26dc0039e0 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26fd200640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26dc004d40 0x7f26dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:21.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.924+0000 7f26ef400640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f815c6f0 0x7f26dc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:21.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26f7e00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26dc0039e0 0x7f26dc003e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009f90 tx=0x7f26dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb650d69c116a096 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8039070 con 0x7f26dc0039e0 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e802cbd0 con 0x7f26dc0039e0 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26f7400640 1 -- 172.21.15.67:0/968308603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8009c10 con 0x7f26dc0039e0 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26fdc00640 1 -- 172.21.15.67:0/968308603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26dc0039e0 msgr2=0x7f26dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26fdc00640 1 --2- 172.21.15.67:0/968308603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26dc0039e0 0x7f26dc003e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009f90 tx=0x7f26dc005830 comp rx=0 tx=0).stop 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.926+0000 7f26fd200640 1 -- 172.21.15.67:0/968308603 reap_dead start 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.927+0000 7f26fdc00640 1 -- 172.21.15.67:0/968308603 shutdown_connections 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.927+0000 7f26fdc00640 1 -- 172.21.15.67:0/968308603 >> 172.21.15.67:0/968308603 conn(0x7f26f80d0220 msgr2=0x7f26f80d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.927+0000 7f26fdc00640 1 -- 172.21.15.67:0/968308603 shutdown_connections 2024-04-16T13:05:21.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.927+0000 7f26fdc00640 1 -- 172.21.15.67:0/968308603 wait complete. 2024-04-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.928+0000 7f26fdc00640 1 Processor -- start 2024-04-16T13:05:21.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.929+0000 7f26fdc00640 1 -- start start 2024-04-16T13:05:21.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.929+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 0x7f26f81f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.929+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f8144810 0x7f26f81f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.929+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fdc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81600f0 con 0x7f26f81f4160 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fdc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f26f806e110 con 0x7f26f81546b0 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fdc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f26f8160270 con 0x7f26f8144810 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51246/0 (socket says 172.21.15.67:51246) 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 -- 172.21.15.67:0/2265755321 learned_addr learned my addr 172.21.15.67:0/2265755321 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26f7e00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 0x7f26f81f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26ef400640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f8144810 0x7f26f81f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 -- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f8144810 msgr2=0x7f26f81f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f8144810 0x7f26f81f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 -- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 msgr2=0x7f26f81f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 0x7f26f81f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.930+0000 7f26fd200640 1 -- 172.21.15.67:0/2265755321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f8145400 con 0x7f26f81f4160 2024-04-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26f7e00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 0x7f26f81f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:21.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26fd200640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26f80addf0 tx=0x7f26f000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0004cb0 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0004e50 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0007330 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f81f64b0 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.931+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81f6a70 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.932+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f81f6c70 con 0x7f26f81f4160 2024-04-16T13:05:21.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.933+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26f00074d0 con 0x7f26f81f4160 2024-04-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.934+0000 7f26f4c00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 0x7f26d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:21.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.934+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f26f008bc20 con 0x7f26f81f4160 2024-04-16T13:05:21.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.935+0000 7f26f7e00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 0x7f26d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:21.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.936+0000 7f26f7e00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 0x7f26d406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:21.938+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26f81f6c70 con 0x7f26f81f4160 2024-04-16T13:05:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.185+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26f8075bd0 con 0x7f26f81f4160 2024-04-16T13:05:22.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.186+0000 7f26f4c00640 1 -- 172.21.15.67:0/2265755321 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f26f0059d00 con 0x7f26f81f4160 2024-04-16T13:05:22.188 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:22.188 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:05:22.188 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:05:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 msgr2=0x7f26d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 0x7f26d406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e802e000 comp rx=0 tx=0).stop 2024-04-16T13:05:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 msgr2=0x7f26f815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26f80addf0 tx=0x7f26f000d900 comp rx=0 tx=0).stop 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 shutdown_connections 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26d406c8f0 0x7f26d406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f26f81f4160 0x7f26f815a940 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f26f8144810 0x7f26f81f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 --2- 172.21.15.67:0/2265755321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26f81546b0 0x7f26f81f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.189+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 >> 172.21.15.67:0/2265755321 conn(0x7f26f80d0220 msgr2=0x7f26f80ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.190+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 shutdown_connections 2024-04-16T13:05:22.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.190+0000 7f26fdc00640 1 -- 172.21.15.67:0/2265755321 wait complete. 2024-04-16T13:05:22.211 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:22.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.431+0000 7f4a63e00640 1 Processor -- start 2024-04-16T13:05:22.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.431+0000 7f4a63e00640 1 -- start start 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a63e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a640c6930 0x7f4a641601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a63e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a6415c800 0x7f4a640cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a63e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a64161110 con 0x7f4a6415c420 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a63e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4a64160870 con 0x7f4a640c6930 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a63e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f4a64160b50 con 0x7f4a6415c800 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a5a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a640c6930 0x7f4a641601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a5a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4a640c6930 0x7f4a641601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51256/0 (socket says 172.21.15.67:51256) 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a5a000640 1 -- 172.21.15.67:0/76530776 learned_addr learned my addr 172.21.15.67:0/76530776 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:22.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.433+0000 7f4a62a00640 1 --1- 172.21.15.67:0/76530776 >> v1:172.21.15.67:6789/0 conn(0x7f4a6415c420 0x7f4a640c6220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35974/0 (socket says 172.21.15.67:35974) 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a63400640 1 --2- 172.21.15.67:0/76530776 >> v2:172.21.15.82:3300/0 conn(0x7f4a6415c800 0x7f4a640cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a5a000640 1 -- 172.21.15.67:0/76530776 >> v2:172.21.15.82:3300/0 conn(0x7f4a6415c800 msgr2=0x7f4a640cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a5a000640 1 --2- 172.21.15.67:0/76530776 >> v2:172.21.15.82:3300/0 conn(0x7f4a6415c800 0x7f4a640cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a5a000640 1 -- 172.21.15.67:0/76530776 >> v1:172.21.15.67:6789/0 conn(0x7f4a6415c420 legacy=0x7f4a640c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a62000640 1 -- 172.21.15.67:0/76530776 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772541682 0 0) 0x7f4a64161110 con 0x7f4a6415c420 2024-04-16T13:05:22.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.434+0000 7f4a5a000640 1 -- 172.21.15.67:0/76530776 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a64160e30 con 0x7f4a640c6930 2024-04-16T13:05:22.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.435+0000 7f4a5a000640 1 --2- 172.21.15.67:0/76530776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a640c6930 0x7f4a641601e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a640af9e0 tx=0x7f4a4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541ca5b5f915657c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.435+0000 7f4a62000640 1 -- 172.21.15.67:0/76530776 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c035020 con 0x7f4a640c6930 2024-04-16T13:05:22.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.435+0000 7f4a62000640 1 -- 172.21.15.67:0/76530776 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c031870 con 0x7f4a640c6930 2024-04-16T13:05:22.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.435+0000 7f4a62000640 1 -- 172.21.15.67:0/76530776 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c031c40 con 0x7f4a640c6930 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 -- 172.21.15.67:0/76530776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a640c6930 msgr2=0x7f4a641601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 --2- 172.21.15.67:0/76530776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a640c6930 0x7f4a641601e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a640af9e0 tx=0x7f4a4c02b910 comp rx=0 tx=0).stop 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 -- 172.21.15.67:0/76530776 shutdown_connections 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 --2- 172.21.15.67:0/76530776 >> v2:172.21.15.82:3300/0 conn(0x7f4a6415c800 0x7f4a640cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 --2- 172.21.15.67:0/76530776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a640c6930 0x7f4a641601e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 -- 172.21.15.67:0/76530776 >> 172.21.15.67:0/76530776 conn(0x7f4a640b2070 msgr2=0x7f4a640b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 -- 172.21.15.67:0/76530776 shutdown_connections 2024-04-16T13:05:22.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.436+0000 7f4a63e00640 1 -- 172.21.15.67:0/76530776 wait complete. 2024-04-16T13:05:22.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.438+0000 7f4a63e00640 1 Processor -- start 2024-04-16T13:05:22.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.438+0000 7f4a63e00640 1 -- start start 2024-04-16T13:05:22.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a640c6930 0x7f4a6414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 0x7f4a640c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640c5280 con 0x7f4a6415c420 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640c5100 con 0x7f4a6415c800 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4a640c5400 con 0x7f4a640c6930 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a5a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51264/0 (socket says 172.21.15.67:51264) 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a5a000640 1 -- 172.21.15.67:0/1840110060 learned_addr learned my addr 172.21.15.67:0/1840110060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a63400640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 0x7f4a640c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a5a000640 1 -- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a640c6930 msgr2=0x7f4a6414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.439+0000 7f4a62a00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a640c6930 0x7f4a6414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5a000640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a640c6930 0x7f4a6414e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5a000640 1 -- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 msgr2=0x7f4a640c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5a000640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 0x7f4a640c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5a000640 1 -- 172.21.15.67:0/1840110060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a640c7560 con 0x7f4a6415c420 2024-04-16T13:05:22.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a63400640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 0x7f4a640c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5a000640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c00 tx=0x7f4a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c035040 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c030d00 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0456a0 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a640c7840 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.440+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a640c7e00 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.442+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a640c72f0 con 0x7f4a6415c420 2024-04-16T13:05:22.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.442+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a4c038020 con 0x7f4a6415c420 2024-04-16T13:05:22.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.444+0000 7f4a5b400640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 0x7f4a4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.444+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a4c0ae0b0 con 0x7f4a6415c420 2024-04-16T13:05:22.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.445+0000 7f4a62a00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 0x7f4a4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.445+0000 7f4a62a00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 0x7f4a4006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4a540012e0 tx=0x7f4a54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.448+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a4c07c230 con 0x7f4a6415c420 2024-04-16T13:05:22.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.654+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a6406f750 con 0x7f4a6415c420 2024-04-16T13:05:22.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.656+0000 7f4a5b400640 1 -- 172.21.15.67:0/1840110060 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18418 (secure 0 0 0) 0x7f4a4c07bb30 con 0x7f4a6415c420 2024-04-16T13:05:22.658 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:22.658 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:04:52.129695+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:22.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 msgr2=0x7f4a4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 0x7f4a4006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4a540012e0 tx=0x7f4a54009040 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 msgr2=0x7f4a640c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c00 tx=0x7f4a4c0046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 shutdown_connections 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4a4006c8f0 0x7f4a4006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a6415c800 0x7f4a640c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a6415c420 0x7f4a640c8e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 --2- 172.21.15.67:0/1840110060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4a640c6930 0x7f4a6414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.659+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 >> 172.21.15.67:0/1840110060 conn(0x7f4a640b2070 msgr2=0x7f4a640b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.660+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 shutdown_connections 2024-04-16T13:05:22.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.660+0000 7f4a63e00640 1 -- 172.21.15.67:0/1840110060 wait complete. 2024-04-16T13:05:22.680 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:05:22.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.899+0000 7f982cc00640 1 Processor -- start 2024-04-16T13:05:22.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.899+0000 7f982cc00640 1 -- start start 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f982cc00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9828155170 0x7f98280ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f982cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98280b4fd0 0x7f98280b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f982cc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982806dee0 con 0x7f98280726e0 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f982cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f982806e1c0 con 0x7f98280b4fd0 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f982cc00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f982806e4a0 con 0x7f9828155170 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f9825400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98280b4fd0 0x7f98280b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f9825400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f98280b4fd0 0x7f98280b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51270/0 (socket says 172.21.15.67:51270) 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f9825400640 1 -- 172.21.15.67:0/2228920648 learned_addr learned my addr 172.21.15.67:0/2228920648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.901+0000 7f9825e00640 1 --2- 172.21.15.67:0/2228920648 >> v2:172.21.15.82:3300/0 conn(0x7f9828155170 0x7f98280ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.902+0000 7f9825400640 1 -- 172.21.15.67:0/2228920648 >> v2:172.21.15.82:3300/0 conn(0x7f9828155170 msgr2=0x7f98280ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.902+0000 7f9825400640 1 --2- 172.21.15.67:0/2228920648 >> v2:172.21.15.82:3300/0 conn(0x7f9828155170 0x7f98280ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.902+0000 7f9825400640 1 -- 172.21.15.67:0/2228920648 >> v1:172.21.15.82:6789/0 conn(0x7f98280726e0 legacy=0x7f9828072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:22.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.902+0000 7f9825400640 1 -- 172.21.15.67:0/2228920648 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982806e780 con 0x7f98280b4fd0 2024-04-16T13:05:22.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.903+0000 7f9825400640 1 --2- 172.21.15.67:0/2228920648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f98280b5440 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9828070360 tx=0x7f981402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a04309a0a162d09 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.903+0000 7f9824a00640 1 -- 172.21.15.67:0/2228920648 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981403b070 con 0x7f98280b4fd0 2024-04-16T13:05:22.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f9824a00640 1 -- 172.21.15.67:0/2228920648 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981402ee00 con 0x7f98280b4fd0 2024-04-16T13:05:22.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f9824a00640 1 -- 172.21.15.67:0/2228920648 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814036660 con 0x7f98280b4fd0 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 -- 172.21.15.67:0/2228920648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 msgr2=0x7f98280b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 --2- 172.21.15.67:0/2228920648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f98280b5440 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9828070360 tx=0x7f981402e050 comp rx=0 tx=0).stop 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 -- 172.21.15.67:0/2228920648 shutdown_connections 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 --2- 172.21.15.67:0/2228920648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f98280b5440 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 --2- 172.21.15.67:0/2228920648 >> v2:172.21.15.82:3300/0 conn(0x7f9828155170 0x7f98280ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 -- 172.21.15.67:0/2228920648 >> 172.21.15.67:0/2228920648 conn(0x7f98280b2210 msgr2=0x7f98280b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 -- 172.21.15.67:0/2228920648 shutdown_connections 2024-04-16T13:05:22.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.904+0000 7f982cc00640 1 -- 172.21.15.67:0/2228920648 wait complete. 2024-04-16T13:05:22.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.906+0000 7f982cc00640 1 Processor -- start 2024-04-16T13:05:22.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.906+0000 7f982cc00640 1 -- start start 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98280726e0 0x7f982813cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9828155170 0x7f9828159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9828155550 con 0x7f98280b4fd0 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f982806dbd0 con 0x7f98280726e0 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f982cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f98281556d0 con 0x7f9828155170 2024-04-16T13:05:22.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f9825400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f9825400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51280/0 (socket says 172.21.15.67:51280) 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.907+0000 7f9825400640 1 -- 172.21.15.67:0/376745998 learned_addr learned my addr 172.21.15.67:0/376745998 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825e00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98280726e0 0x7f982813cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 -- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9828155170 msgr2=0x7f9828159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9828155170 0x7f9828159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 -- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98280726e0 msgr2=0x7f982813cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98280726e0 0x7f982813cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 -- 172.21.15.67:0/376745998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982813d250 con 0x7f98280b4fd0 2024-04-16T13:05:22.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.908+0000 7f9825400640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f981402e090 tx=0x7f9814004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.909+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981403b070 con 0x7f98280b4fd0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.909+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981403f550 con 0x7f98280b4fd0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.909+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982815de70 con 0x7f98280b4fd0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.909+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981403f920 con 0x7f98280b4fd0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.909+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982815e430 con 0x7f98280b4fd0 2024-04-16T13:05:22.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.910+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9828075bd0 con 0x7f98280b4fd0 2024-04-16T13:05:22.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.911+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f981403fac0 con 0x7f98280b4fd0 2024-04-16T13:05:22.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.912+0000 7f981e000640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 0x7f980806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:22.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.912+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f98140ade50 con 0x7f98280b4fd0 2024-04-16T13:05:22.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.913+0000 7f9825e00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 0x7f980806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:22.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.914+0000 7f9825e00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 0x7f980806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9818009e90 tx=0x7f981800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:22.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:22.917+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f982813d250 con 0x7f98280b4fd0 2024-04-16T13:05:23.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.163+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f982806f630 con 0x7f98280b4fd0 2024-04-16T13:05:23.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.164+0000 7f981e000640 1 -- 172.21.15.67:0/376745998 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f981407b980 con 0x7f98280b4fd0 2024-04-16T13:05:23.165 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:23.166 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:05:23.166 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:05:23.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 msgr2=0x7f980806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 0x7f980806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9818009e90 tx=0x7f981800b040 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 msgr2=0x7f982814bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f981402e090 tx=0x7f9814004730 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 shutdown_connections 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f980806c8f0 0x7f980806edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9828155170 0x7f9828159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f98280b4fd0 0x7f982814bf80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 --2- 172.21.15.67:0/376745998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98280726e0 0x7f982813cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 >> 172.21.15.67:0/376745998 conn(0x7f98280b2210 msgr2=0x7f98280ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 shutdown_connections 2024-04-16T13:05:23.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.167+0000 7f982cc00640 1 -- 172.21.15.67:0/376745998 wait complete. 2024-04-16T13:05:23.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-16T13:04:45.468405+0000', 'modified': '2024-04-16T13:05:07.747289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6835/427491398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6834', 'nonce': 427491398}, {'type': 'v1', 'addr': '172.21.15.67:6835', 'nonce': 427491398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-04-16T13:05:23.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-16T13:05:23.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-16T13:05:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.822+0000 7ff6aac00640 1 Processor -- start 2024-04-16T13:05:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.822+0000 7ff6aac00640 1 -- start start 2024-04-16T13:05:23.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6aac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6aac00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6aac00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a41641f0 con 0x7ff6a406f9d0 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6aac00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a40b3970 con 0x7ff6a406f040 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6aac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a41635e0 con 0x7ff6a4072050 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6a8e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6a8e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:43444/0 (socket says 172.21.15.67:43444) 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6a8e00640 1 -- 172.21.15.67:0/3151405643 learned_addr learned my addr 172.21.15.67:0/3151405643 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.824+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:45788/0 (socket says 172.21.15.67:45788) 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.825+0000 7ff6a9800640 1 -- 172.21.15.67:0/3151405643 >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 msgr2=0x7ff6a406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.825+0000 7ff6a9800640 1 --2- 172.21.15.67:0/3151405643 >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.825+0000 7ff6a9800640 1 -- 172.21.15.67:0/3151405643 >> v1:172.21.15.82:6789/0 conn(0x7ff6a406f9d0 legacy=0x7ff6a406e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.825+0000 7ff6a9800640 1 -- 172.21.15.67:0/3151405643 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a406ed50 con 0x7ff6a4072050 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.825+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/3151405643 >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.827+0000 7ff6a9800640 1 --2- 172.21.15.67:0/3151405643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097d0 tx=0x7ff69802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8265ef30dadf46d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.827+0000 7ff6a3e00640 1 -- 172.21.15.67:0/3151405643 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698035020 con 0x7ff6a4072050 2024-04-16T13:05:23.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.827+0000 7ff6a3e00640 1 -- 172.21.15.67:0/3151405643 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff698031810 con 0x7ff6a4072050 2024-04-16T13:05:23.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.827+0000 7ff6a3e00640 1 -- 172.21.15.67:0/3151405643 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698031be0 con 0x7ff6a4072050 2024-04-16T13:05:23.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 -- 172.21.15.67:0/3151405643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 msgr2=0x7ff6a40b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 --2- 172.21.15.67:0/3151405643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097d0 tx=0x7ff69802b8b0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 -- 172.21.15.67:0/3151405643 shutdown_connections 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 --2- 172.21.15.67:0/3151405643 >> v2:172.21.15.82:3300/0 conn(0x7ff6a406f040 0x7ff6a406e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 --2- 172.21.15.67:0/3151405643 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a40b3430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 -- 172.21.15.67:0/3151405643 >> 172.21.15.67:0/3151405643 conn(0x7ff6a4067d90 msgr2=0x7ff6a406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 -- 172.21.15.67:0/3151405643 shutdown_connections 2024-04-16T13:05:23.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.828+0000 7ff6aac00640 1 -- 172.21.15.67:0/3151405643 wait complete. 2024-04-16T13:05:23.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.830+0000 7ff6aac00640 1 Processor -- start 2024-04-16T13:05:23.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.830+0000 7ff6aac00640 1 -- start start 2024-04-16T13:05:23.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a406f040 0x7ff6a4151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4163e80 con 0x7ff6a406f9d0 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4163ba0 con 0x7ff6a406f040 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.831+0000 7ff6aac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a4072430 con 0x7ff6a4072050 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51288/0 (socket says 172.21.15.67:51288) 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 -- 172.21.15.67:0/2055192552 learned_addr learned my addr 172.21.15.67:0/2055192552 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a406f040 0x7ff6a4151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6aa200640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 -- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 msgr2=0x7ff6a415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a415cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 -- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a406f040 msgr2=0x7ff6a4151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a406f040 0x7ff6a4151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 -- 172.21.15.67:0/2055192552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a41516b0 con 0x7ff6a406f9d0 2024-04-16T13:05:23.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6aa200640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.832+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e9a0 tx=0x7ff69000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.833+0000 7ff6a1600640 1 -- 172.21.15.67:0/2055192552 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690017070 con 0x7ff6a406f9d0 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.833+0000 7ff6a1600640 1 -- 172.21.15.67:0/2055192552 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69000ca00 con 0x7ff6a406f9d0 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.833+0000 7ff6a1600640 1 -- 172.21.15.67:0/2055192552 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000cdb0 con 0x7ff6a406f9d0 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.833+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a415e950 con 0x7ff6a406f9d0 2024-04-16T13:05:23.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.833+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a415ef10 con 0x7ff6a406f9d0 2024-04-16T13:05:23.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.835+0000 7ff6a1600640 1 -- 172.21.15.67:0/2055192552 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff69001a070 con 0x7ff6a406f9d0 2024-04-16T13:05:23.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.836+0000 7ff6a1600640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 0x7ff68406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.836+0000 7ff6a1600640 1 -- 172.21.15.67:0/2055192552 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff69008bdb0 con 0x7ff6a406f9d0 2024-04-16T13:05:23.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.837+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 0x7ff68406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.837+0000 7ff6aefdf740 1 Processor -- start 2024-04-16T13:05:23.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.837+0000 7ff6aefdf740 1 -- start start 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7c70 0x55d18b080570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 0x55d18b07e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d18afe59c0 con 0x55d18b0a7890 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d18af8c560 con 0x55d18b080ab0 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d18afe1980 con 0x55d18b0a7c70 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51302/0 (socket says 172.21.15.67:51302) 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 -- 172.21.15.67:0/4104251111 learned_addr learned my addr 172.21.15.67:0/4104251111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 0x7ff68406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff698036000 tx=0x7ff69803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7c70 0x55d18b080570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6aa200640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 0x55d18b07e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 -- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7c70 msgr2=0x55d18b080570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7c70 0x55d18b080570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 -- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 msgr2=0x55d18b07e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.838+0000 7ff6a9800640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 0x55d18b07e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff6a9800640 1 -- 172.21.15.67:0/4104251111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d18acf82d0 con 0x55d18b0a7890 2024-04-16T13:05:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff6aa200640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 0x55d18b07e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff6a9800640 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6980098f0 tx=0x7ff698008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d3bbc9c65077c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff696000640 1 -- 172.21.15.67:0/4104251111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698035040 con 0x55d18b0a7890 2024-04-16T13:05:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff696000640 1 -- 172.21.15.67:0/4104251111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69803aa70 con 0x55d18b0a7890 2024-04-16T13:05:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.839+0000 7ff696000640 1 -- 172.21.15.67:0/4104251111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69803ae20 con 0x55d18b0a7890 2024-04-16T13:05:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 -- 172.21.15.67:0/4104251111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 msgr2=0x55d18b0c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff6980098f0 tx=0x7ff698008030 comp rx=0 tx=0).stop 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 -- 172.21.15.67:0/4104251111 shutdown_connections 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b080ab0 0x55d18b07e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7c70 0x55d18b080570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/4104251111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0c69d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 -- 172.21.15.67:0/4104251111 >> 172.21.15.67:0/4104251111 conn(0x55d18b07cb50 msgr2=0x55d18b0c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 -- 172.21.15.67:0/4104251111 shutdown_connections 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.840+0000 7ff6aefdf740 1 -- 172.21.15.67:0/4104251111 wait complete. 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.841+0000 7ff6aefdf740 1 -- start start 2024-04-16T13:05:23.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.841+0000 7ff6aefdf740 1 Processor -- start 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d18b07a980 con 0x55d18b0a7890 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d18af9f920 con 0x55d18b0a7c70 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d18b080f30 con 0x55d18b0c38d0 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6aefdf740 10 client.0 _ll_register_callbacks cb 0x55d18af9f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51304/0 (socket says 172.21.15.67:51304) 2024-04-16T13:05:23.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.842+0000 7ff6a9800640 1 -- 172.21.15.67:0/2561640221 learned_addr learned my addr 172.21.15.67:0/2561640221 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 -- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 msgr2=0x55d18b0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 -- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 msgr2=0x55d18b0a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 -- 172.21.15.67:0/2561640221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d18adc26b0 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6a9800640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097a0 tx=0x7ff69802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2116be6634ffd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff68aa00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698045bc0 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff698045d60 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.843+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69803aa70 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff698060050 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 10 client.4812 fetch_fsmap learned FSMap version 8 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d18b0d99f0 con 0x55d18b0a7890 2024-04-16T13:05:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69803aa70 con 0x55d18b0a7890 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ff698063020 con 0x55d18b0a7890 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 10 client.4812 fetch_fsmap finished waiting for FSMap version 8 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 10 client.4812 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 20 client.4812 populate_metadata read hostname 'smithi067' 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b0c28b0 0x55d18b0c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 4 client.4812 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.844+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 --> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d18af8bb70 con 0x55d18b0c28b0 2024-04-16T13:05:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.845+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b0c28b0 0x55d18b0c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.845+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b0c28b0 0x55d18b0c2cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944000c49ae729e9 server_cookie=1f7fd630058f1d7c in_seq=0 out_seq=0 2024-04-16T13:05:23.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.845+0000 7ff68aa00640 10 client.4812 ms_handle_connect on v2:172.21.15.67:6834/427491398 2024-04-16T13:05:23.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff68aa00640 1 -- 172.21.15.67:0/2561640221 <== mds.0 v2:172.21.15.67:6834/427491398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d18af8bb70 con 0x55d18b0c28b0 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff68aa00640 10 client.4812 handle_command_reply: tid=0 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 client.4812 shutdown 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 msgr2=0x55d18b0d8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097a0 tx=0x7ff69802e000 comp rx=0 tx=0).stop 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 shutdown_connections 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b0c28b0 0x55d18b0c2cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/2561640221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0d8ee0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 >> 172.21.15.67:0/2561640221 conn(0x55d18b080ab0 msgr2=0x55d18b07f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.846+0000 7ff68aa00640 0 client.4812 ms_handle_reset on v2:172.21.15.67:6834/427491398 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.847+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 shutdown_connections 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.847+0000 7ff6aefdf740 1 -- 172.21.15.67:0/2561640221 wait complete. 2024-04-16T13:05:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.847+0000 7ff6aefdf740 20 client.4812 trim_cache size 0 max 16384 2024-04-16T13:05:23.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.867+0000 7ff6aefdf740 1 Processor -- start 2024-04-16T13:05:23.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.867+0000 7ff6aefdf740 1 -- start start 2024-04-16T13:05:23.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7890 0x55d18b0d8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0c38d0 0x55d18b0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a42056f0 con 0x55d18b0a7c70 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4204a80 con 0x55d18b0c38d0 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a42050a0 con 0x55d18b0a7890 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51318/0 (socket says 172.21.15.67:51318) 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 -- 172.21.15.67:0/702930039 learned_addr learned my addr 172.21.15.67:0/702930039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6aa200640 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0c38d0 0x55d18b0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 -- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7890 msgr2=0x55d18b0d8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7890 0x55d18b0d8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 -- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0c38d0 msgr2=0x55d18b0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0c38d0 0x55d18b0c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.868+0000 7ff6a8e00640 1 -- 172.21.15.67:0/702930039 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d18b0c3db0 con 0x55d18b0a7c70 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.869+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff690055bf0 tx=0x7ff690060040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d0dccbc35e9e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.869+0000 7ff695600640 1 -- 172.21.15.67:0/702930039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690075020 con 0x55d18b0a7c70 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.869+0000 7ff695600640 1 -- 172.21.15.67:0/702930039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69005db40 con 0x55d18b0a7c70 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.869+0000 7ff695600640 1 -- 172.21.15.67:0/702930039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690021040 con 0x55d18b0a7c70 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 -- 172.21.15.67:0/702930039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 msgr2=0x55d18b0c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff690055bf0 tx=0x7ff690060040 comp rx=0 tx=0).stop 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 -- 172.21.15.67:0/702930039 shutdown_connections 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0c38d0 0x55d18b0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7c70 0x55d18b0c5660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/702930039 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0a7890 0x55d18b0d8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 -- 172.21.15.67:0/702930039 >> 172.21.15.67:0/702930039 conn(0x55d18b080ab0 msgr2=0x55d18b07ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 -- 172.21.15.67:0/702930039 shutdown_connections 2024-04-16T13:05:23.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.870+0000 7ff6aefdf740 1 -- 172.21.15.67:0/702930039 wait complete. 2024-04-16T13:05:23.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.871+0000 7ff6aefdf740 1 -- start start 2024-04-16T13:05:23.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.871+0000 7ff6aefdf740 1 Processor -- start 2024-04-16T13:05:23.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0a2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d18b0d5c90 con 0x55d18b0a7890 2024-04-16T13:05:23.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d18b07a980 con 0x55d18b0a7c70 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x55d18b0c9130 con 0x55d18b0c38d0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6aefdf740 10 client.0 _ll_register_callbacks cb 0x7ff69803bf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6a9800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51320/0 (socket says 172.21.15.67:51320) 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.872+0000 7ff6a9800640 1 -- 172.21.15.67:0/1811524757 learned_addr learned my addr 172.21.15.67:0/1811524757 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 -- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 msgr2=0x55d18b0a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 -- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 msgr2=0x55d18b0a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 -- 172.21.15.67:0/1811524757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d18b081910 con 0x55d18b0a7890 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6a9800640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff698000bf0 tx=0x7ff6980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f712ad1c79ff6f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff68aa00640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698069060 con 0x55d18b0a7890 2024-04-16T13:05:23.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff69803abc0 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.873+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69005db40 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff698049030 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 10 client.4818 fetch_fsmap learned FSMap version 8 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d18b0ea850 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69005db40 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ff698063040 con 0x55d18b0a7890 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 10 client.4818 fetch_fsmap finished waiting for FSMap version 8 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 10 client.4818 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 20 client.4818 populate_metadata read hostname 'smithi067' 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b07e340 0x55d18b07e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 4 client.4818 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 --> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] -- command(tid 0: {"prefix": "status"}) -- 0x55d18b07bf60 con 0x55d18b07e340 2024-04-16T13:05:23.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.874+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b07e340 0x55d18b07e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6a8e00640 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b07e340 0x55d18b07e720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f719518b6235352 server_cookie=3530f1c36bdda6df in_seq=0 out_seq=0 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff68aa00640 10 client.4818 ms_handle_connect on v2:172.21.15.67:6834/427491398 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff68aa00640 1 -- 172.21.15.67:0/1811524757 <== mds.0 v2:172.21.15.67:6834/427491398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d18b07bf60 con 0x55d18b07e340 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff68aa00640 10 client.4818 handle_command_reply: tid=0 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 client.4818 shutdown 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 msgr2=0x55d18b0a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff698000bf0 tx=0x7ff6980046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 shutdown_connections 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:6834/427491398,v1:172.21.15.67:6835/427491398] conn(0x55d18b07e340 0x55d18b07e720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x55d18b0c38d0 0x55d18b0a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d18b0a7c70 0x55d18b0a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 --2- 172.21.15.67:0/1811524757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d18b0a7890 0x55d18b0a5a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff68aa00640 0 client.4818 ms_handle_reset on v2:172.21.15.67:6834/427491398 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.875+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 >> 172.21.15.67:0/1811524757 conn(0x55d18b080ab0 msgr2=0x55d18b075e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 shutdown_connections 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aefdf740 1 -- 172.21.15.67:0/1811524757 wait complete. 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aefdf740 20 client.4818 trim_cache size 0 max 16384 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "dc50e499-96cc-43d1-bcde-ee8dfcd0732f", 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4282, 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-04-16T13:05:23.880 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 37.872781756999998, 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 8, 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 25, 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 25, 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 43.171246697999997 2024-04-16T13:05:23.881 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 msgr2=0x7ff68406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 0x7ff68406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff698036000 tx=0x7ff69803c040 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 msgr2=0x7ff6a414e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e9a0 tx=0x7ff69000ee60 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 shutdown_connections 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff68406c8f0 0x7ff68406edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6a4072050 0x7ff6a415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6a406f9d0 0x7ff6a414e3a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 --2- 172.21.15.67:0/2055192552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6a406f040 0x7ff6a4151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.876+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 >> 172.21.15.67:0/2055192552 conn(0x7ff6a4067d90 msgr2=0x7ff6a406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.877+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 shutdown_connections 2024-04-16T13:05:23.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:23.877+0000 7ff6aac00640 1 -- 172.21.15.67:0/2055192552 wait complete. 2024-04-16T13:05:23.895 INFO:teuthology.run_tasks:Running task sequential... 2024-04-16T13:05:23.904 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-16T13:05:23.904 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-16T13:05:23.904 INFO:teuthology.task.print:Enabling mgr modules 2024-04-16T13:05:23.905 INFO:teuthology.run_tasks:Running task kclient... 2024-04-16T13:05:23.928 INFO:tasks.kclient:Mounting kernel clients... 2024-04-16T13:05:23.928 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-16T13:05:23.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:23.928 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:05:23.985 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-16T13:05:23.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:23.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-16T13:05:24.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.084 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-16T13:05:24.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.232 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:05:24.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.282 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-16T13:05:24.360 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-04-16T13:05:24.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:05:24.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.364 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:05:24.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-16T13:05:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-04-16T13:05:24.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:05:24.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.527 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:05:24.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:24.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-16T13:05:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-04-16T13:05:24.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:05:24.679 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-16T13:05:24.679 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T13:05:24.679 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T13:05:24.679 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T13:05:24.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.912+0000 7f6e27200640 1 Processor -- start 2024-04-16T13:05:24.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.913+0000 7f6e27200640 1 -- start start 2024-04-16T13:05:24.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.914+0000 7f6e27200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e2815c800 0x7f6e281601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:24.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.914+0000 7f6e27200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e28161110 con 0x7f6e280c6930 2024-04-16T13:05:24.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.914+0000 7f6e27200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e28160870 con 0x7f6e2815c420 2024-04-16T13:05:24.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.914+0000 7f6e27200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f6e28160b50 con 0x7f6e2815c800 2024-04-16T13:05:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e2815c800 0x7f6e281601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e2815c800 0x7f6e281601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51330/0 (socket says 172.21.15.67:51330) 2024-04-16T13:05:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 -- 172.21.15.67:0/159802766 learned_addr learned my addr 172.21.15.67:0/159802766 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e1fe00640 1 --1- 172.21.15.67:0/159802766 >> v1:172.21.15.67:6789/0 conn(0x7f6e280c6930 0x7f6e280cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35990/0 (socket says 172.21.15.67:35990) 2024-04-16T13:05:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 -- 172.21.15.67:0/159802766 >> v1:172.21.15.82:6789/0 conn(0x7f6e2815c420 legacy=0x7f6e280c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:24.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 -- 172.21.15.67:0/159802766 >> v1:172.21.15.67:6789/0 conn(0x7f6e280c6930 legacy=0x7f6e280cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:24.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.915+0000 7f6e26800640 1 -- 172.21.15.67:0/159802766 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e28160e30 con 0x7f6e2815c800 2024-04-16T13:05:24.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.916+0000 7f6e26800640 1 --2- 172.21.15.67:0/159802766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e281601e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e50 tx=0x7f6e2002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47837e9d75ce81fb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:24.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.916+0000 7f6e25400640 1 -- 172.21.15.67:0/159802766 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2002ca70 con 0x7f6e2815c800 2024-04-16T13:05:24.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e25400640 1 -- 172.21.15.67:0/159802766 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2002cc10 con 0x7f6e2815c800 2024-04-16T13:05:24.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e25400640 1 -- 172.21.15.67:0/159802766 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200343f0 con 0x7f6e2815c800 2024-04-16T13:05:24.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 -- 172.21.15.67:0/159802766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 msgr2=0x7f6e281601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 --2- 172.21.15.67:0/159802766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e281601e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009e50 tx=0x7f6e2002bed0 comp rx=0 tx=0).stop 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 -- 172.21.15.67:0/159802766 shutdown_connections 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 --2- 172.21.15.67:0/159802766 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e281601e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 -- 172.21.15.67:0/159802766 >> 172.21.15.67:0/159802766 conn(0x7f6e280b2070 msgr2=0x7f6e280b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.917+0000 7f6e27200640 1 -- 172.21.15.67:0/159802766 shutdown_connections 2024-04-16T13:05:24.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.918+0000 7f6e27200640 1 -- 172.21.15.67:0/159802766 wait complete. 2024-04-16T13:05:24.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.920+0000 7f6e27200640 1 Processor -- start 2024-04-16T13:05:24.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.920+0000 7f6e27200640 1 -- start start 2024-04-16T13:05:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e280c6930 0x7f6e2815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 0x7f6e2814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280c5280 con 0x7f6e2815c800 2024-04-16T13:05:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280c5100 con 0x7f6e280c6930 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e27200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6e280c5400 con 0x7f6e2815c420 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e26800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.921+0000 7f6e26800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51340/0 (socket says 172.21.15.67:51340) 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 -- 172.21.15.67:0/2443532973 learned_addr learned my addr 172.21.15.67:0/2443532973 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e25e00640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e280c6930 0x7f6e2815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e1fe00640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 0x7f6e2814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 -- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 msgr2=0x7f6e2814e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 0x7f6e2814e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 -- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e280c6930 msgr2=0x7f6e2815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e280c6930 0x7f6e2815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 -- 172.21.15.67:0/2443532973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2815dc90 con 0x7f6e2815c800 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e1fe00640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 0x7f6e2814e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:24.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.922+0000 7f6e26800640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036040 tx=0x7f6e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.923+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20043020 con 0x7f6e2815c800 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.923+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2003e450 con 0x7f6e2815c800 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.923+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2003e860 con 0x7f6e2815c800 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.923+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e280c73b0 con 0x7f6e2815c800 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.923+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e280c7970 con 0x7f6e2815c800 2024-04-16T13:05:24.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.924+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28075bd0 con 0x7f6e2815c800 2024-04-16T13:05:24.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.925+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e20046020 con 0x7f6e2815c800 2024-04-16T13:05:24.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.926+0000 7f6e1e000640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 0x7f6e0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:24.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.926+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6e200ae7e0 con 0x7f6e2815c800 2024-04-16T13:05:24.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.926+0000 7f6e25e00640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 0x7f6e0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:24.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.927+0000 7f6e25e00640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 0x7f6e0406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e18004ea0 tx=0x7f6e18009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:24.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:24.930+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e2004d030 con 0x7f6e2815c800 2024-04-16T13:05:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.178+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6e280b3830 con 0x7f6e2815c800 2024-04-16T13:05:25.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.179+0000 7f6e1e000640 1 -- 172.21.15.67:0/2443532973 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6e2007c8c0 con 0x7f6e2815c800 2024-04-16T13:05:25.181 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T13:05:25.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 msgr2=0x7f6e0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:25.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 0x7f6e0406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e18004ea0 tx=0x7f6e18009040 comp rx=0 tx=0).stop 2024-04-16T13:05:25.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 msgr2=0x7f6e2815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036040 tx=0x7f6e20004a40 comp rx=0 tx=0).stop 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 shutdown_connections 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6e0406c8f0 0x7f6e0406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e2815c800 0x7f6e2815e890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6e2815c420 0x7f6e2814e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 --2- 172.21.15.67:0/2443532973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e280c6930 0x7f6e2815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 >> 172.21.15.67:0/2443532973 conn(0x7f6e280b2070 msgr2=0x7f6e280ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 shutdown_connections 2024-04-16T13:05:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25.182+0000 7f6e27200640 1 -- 172.21.15.67:0/2443532973 wait complete. 2024-04-16T13:05:25.201 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T13:05:25.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T13:05:25.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:25.202 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-16T13:05:25.256 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-16T13:05:25.257 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42495sec preferred_lft 42495sec 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-04-16T13:05:25.258 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:25.259 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-04-16T13:05:25.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T13:05:25.260 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:25.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:25.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:25.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:25.554 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T13:05:25.625 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-16T13:05:25.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:25.630 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-16T13:05:25.685 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-16T13:05:25.685 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T13:05:25.685 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T13:05:25.685 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T13:05:25.686 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T13:05:25.686 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:25.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:25.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:25.950 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:05:26.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:26.006 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-04-16T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T13:05:26.057 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:26.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:26.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:26.262 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T13:05:26.263 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:26.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:26.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:26.594 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:26.595 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:26.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-04-16T13:05:26.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T13:05:26.595 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:26.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:26.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:26.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:26.809 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T13:05:26.854 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T13:05:26.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:26.854 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T13:05:26.946 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T13:05:26.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:26.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T13:05:27.068 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T13:05:27.069 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:27.756 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T13:05:27.756 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T13:05:27.756 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:27.756 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:27.756 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-04-16T13:05:27.803 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=dc50e499-96cc-43d1-bcde-ee8dfcd0732f" will pass to kernel 2024-04-16T13:05:27.812 INFO:teuthology.orchestra.run.smithi067.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T13:05:27.812 INFO:teuthology.orchestra.run.smithi067.stdout: You just mounted a file system that supports labels which does not 2024-04-16T13:05:27.812 INFO:teuthology.orchestra.run.smithi067.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T13:05:27.812 INFO:teuthology.orchestra.run.smithi067.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T13:05:27.812 INFO:teuthology.orchestra.run.smithi067.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T13:05:27.817 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T13:05:27.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:27.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T13:05:27.916 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:28.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:28.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:28.036 INFO:teuthology.orchestra.run.smithi067.stdout:client4830 2024-04-16T13:05:28.036 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:28.036 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:28.090 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:28.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:28.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:28.214 INFO:teuthology.orchestra.run.smithi067.stdout:client4830 2024-04-16T13:05:28.214 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:28.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:28.334 INFO:teuthology.orchestra.run.smithi067.stdout:client4830 2024-04-16T13:05:28.335 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc50e499-96cc-43d1-bcde-ee8dfcd0732f.client4830/status') 2024-04-16T13:05:28.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:28.487 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4830 (3)192.168.0.1:0/928173084 2024-04-16T13:05:28.487 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-04-16T13:05:28.487 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-04-16T13:05:28.487 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-04-16T13:05:28.487 INFO:teuthology.orchestra.run.smithi067.stderr:68 bytes copied, 9.009e-05 s, 755 kB/s 2024-04-16T13:05:28.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:28.501 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-16T13:05:28.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T13:05:28.501 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T13:05:28.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T13:05:28.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.726+0000 7fe4b2800640 1 Processor -- start 2024-04-16T13:05:28.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.726+0000 7fe4b2800640 1 -- start start 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.727+0000 7fe4b2800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 0x7fe4ac1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.727+0000 7fe4b2800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4ac15c800 0x7fe4ac0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b2800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac161110 con 0x7fe4ac0c5100 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b2800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fe4ac160870 con 0x7fe4ac15c800 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b2800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac160b50 con 0x7fe4ac15c420 2024-04-16T13:05:28.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b0a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4ac15c800 0x7fe4ac0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b1e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4ac0c5100 0x7fe4ac06ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35998/0 (socket says 172.21.15.67:35998) 2024-04-16T13:05:28.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b1e00640 1 -- 172.21.15.67:0/11429575 learned_addr learned my addr 172.21.15.67:0/11429575 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b1400640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 0x7fe4ac1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b0a00640 1 -- 172.21.15.67:0/11429575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 msgr2=0x7fe4ac1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b0a00640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 0x7fe4ac1601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b0a00640 1 -- 172.21.15.67:0/11429575 >> v1:172.21.15.67:6789/0 conn(0x7fe4ac0c5100 legacy=0x7fe4ac06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4b0a00640 1 -- 172.21.15.67:0/11429575 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac160e30 con 0x7fe4ac15c800 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.729+0000 7fe4b1400640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 0x7fe4ac1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:28.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.728+0000 7fe4abe00640 1 -- 172.21.15.67:0/11429575 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278866444 0 0) 0x7fe4ac161110 con 0x7fe4ac0c5100 2024-04-16T13:05:28.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4b0a00640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c800 0x7fe4ac0c6220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7bfb83038d79f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:28.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4abe00640 1 -- 172.21.15.67:0/11429575 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498039070 con 0x7fe4ac15c800 2024-04-16T13:05:28.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4abe00640 1 -- 172.21.15.67:0/11429575 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4980316f0 con 0x7fe4ac15c800 2024-04-16T13:05:28.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4abe00640 1 -- 172.21.15.67:0/11429575 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498031ac0 con 0x7fe4ac15c800 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4b2800640 1 -- 172.21.15.67:0/11429575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c800 msgr2=0x7fe4ac0c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.730+0000 7fe4b2800640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c800 0x7fe4ac0c6220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802b790 comp rx=0 tx=0).stop 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 -- 172.21.15.67:0/11429575 shutdown_connections 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c800 0x7fe4ac0c6220 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 --2- 172.21.15.67:0/11429575 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c420 0x7fe4ac1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 -- 172.21.15.67:0/11429575 >> 172.21.15.67:0/11429575 conn(0x7fe4ac0b2070 msgr2=0x7fe4ac0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 -- 172.21.15.67:0/11429575 shutdown_connections 2024-04-16T13:05:28.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.731+0000 7fe4b2800640 1 -- 172.21.15.67:0/11429575 wait complete. 2024-04-16T13:05:28.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.732+0000 7fe4b2800640 1 Processor -- start 2024-04-16T13:05:28.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.733+0000 7fe4b2800640 1 -- start start 2024-04-16T13:05:28.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.733+0000 7fe4b2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 0x7fe4ac0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.733+0000 7fe4b2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.733+0000 7fe4b2800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c800 0x7fe4ac1f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.733+0000 7fe4b2800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac0cd100 con 0x7fe4ac15c420 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b2800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac0ccf80 con 0x7fe4ac0c5100 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b2800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac0cd280 con 0x7fe4ac15c800 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51356/0 (socket says 172.21.15.67:51356) 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 -- 172.21.15.67:0/406339673 learned_addr learned my addr 172.21.15.67:0/406339673 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b1400640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 0x7fe4ac0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 -- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c800 msgr2=0x7fe4ac1f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b1e00640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c800 0x7fe4ac1f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c800 0x7fe4ac1f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 -- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 msgr2=0x7fe4ac0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 0x7fe4ac0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b0a00640 1 -- 172.21.15.67:0/406339673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0c8bb0 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.734+0000 7fe4b1400640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 0x7fe4ac0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4b0a00640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe498037040 tx=0x7fe4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498039040 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498004230 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498003610 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac14fab0 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.735+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ac0ae320 con 0x7fe4ac15c420 2024-04-16T13:05:28.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.736+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ac075bd0 con 0x7fe4ac15c420 2024-04-16T13:05:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.737+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe49803c070 con 0x7fe4ac15c420 2024-04-16T13:05:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.738+0000 7fe4a9600640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 0x7fe48c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.738+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe4980adb10 con 0x7fe4ac15c420 2024-04-16T13:05:28.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.739+0000 7fe4b1400640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 0x7fe48c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:28.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.740+0000 7fe4b1400640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 0x7fe48c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0006fd0 tx=0x7fe4a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.743+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe498043020 con 0x7fe4ac15c420 2024-04-16T13:05:28.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.987+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe4ac0b3dc0 con 0x7fe4ac15c420 2024-04-16T13:05:28.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.988+0000 7fe4a9600640 1 -- 172.21.15.67:0/406339673 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fe49807baa0 con 0x7fe4ac15c420 2024-04-16T13:05:28.989 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T13:05:28.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 msgr2=0x7fe48c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 0x7fe48c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0006fd0 tx=0x7fe4a0008040 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 msgr2=0x7fe4ac14f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe498037040 tx=0x7fe4980046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 shutdown_connections 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe48c06c8f0 0x7fe48c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe4ac15c800 0x7fe4ac1f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4ac15c420 0x7fe4ac14f570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 --2- 172.21.15.67:0/406339673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ac0c5100 0x7fe4ac0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 >> 172.21.15.67:0/406339673 conn(0x7fe4ac0b2070 msgr2=0x7fe4ac0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.991+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 shutdown_connections 2024-04-16T13:05:28.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:28.992+0000 7fe4b2800640 1 -- 172.21.15.67:0/406339673 wait complete. 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T13:05:29.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T13:05:29.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-16T13:05:29.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.013 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-04-16T13:05:29.064 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:29.065 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 6e:2f:38:4e:5e:3f brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::845b:4eff:fe33:72fe/64 scope link 2024-04-16T13:05:29.066 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.067 INFO:teuthology.orchestra.run.smithi067.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T13:05:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 6e:2f:38:4e:5e:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T13:05:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::6c2f:38ff:fe4e:5e3f/64 scope link 2024-04-16T13:05:29.067 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.068 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T13:05:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-04-16T13:05:29.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.165 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-04-16T13:05:29.222 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-04-16T13:05:29.222 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T13:05:29.222 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T13:05:29.223 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T13:05:29.223 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T13:05:29.223 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:29.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:29.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:29.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.485 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:05:29.537 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T13:05:29.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.538 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-04-16T13:05:29.594 INFO:teuthology.orchestra.run.smithi067.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-16T13:05:29.595 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:29.595 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:29.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T13:05:29.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-16T13:05:29.595 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:29.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:29.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:29.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.901 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:29.902 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:b4:6a:12:5a:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T13:05:29.902 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T13:05:29.902 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.902 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::cb4:6aff:fe12:5a1e/64 scope link 2024-04-16T13:05:29.902 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:29.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:29.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-16T13:05:30.006 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:30.006 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:30.006 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:30.006 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:30.006 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0e:b4:6a:12:5a:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::cb4:6aff:fe12:5a1e/64 scope link 2024-04-16T13:05:30.007 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:30.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-16T13:05:30.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-16T13:05:30.012 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-16T13:05:30.012 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:30.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:30.355 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:30.355 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-04-16T13:05:30.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.1 up 2024-04-16T13:05:30.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T13:05:30.356 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-04-16T13:05:30.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:30.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:30.589 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-16T13:05:30.637 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-16T13:05:30.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:30.637 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-16T13:05:30.685 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T13:05:30.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:30.686 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T13:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T13:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T13:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:30.841 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T13:05:30.841 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T13:05:30.841 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:30.841 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:30.841 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-04-16T13:05:30.869 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=dc50e499-96cc-43d1-bcde-ee8dfcd0732f" will pass to kernel 2024-04-16T13:05:30.873 INFO:teuthology.orchestra.run.smithi067.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-16T13:05:30.873 INFO:teuthology.orchestra.run.smithi067.stdout: You just mounted a file system that supports labels which does not 2024-04-16T13:05:30.873 INFO:teuthology.orchestra.run.smithi067.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T13:05:30.873 INFO:teuthology.orchestra.run.smithi067.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T13:05:30.873 INFO:teuthology.orchestra.run.smithi067.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T13:05:30.878 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T13:05:30.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:30.878 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-16T13:05:30.974 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:31.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:31.104 INFO:teuthology.orchestra.run.smithi067.stdout:client4499 2024-04-16T13:05:31.105 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:31.105 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:31.161 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:31.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:31.285 INFO:teuthology.orchestra.run.smithi067.stdout:client4499 2024-04-16T13:05:31.285 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:31.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:31.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:31.410 INFO:teuthology.orchestra.run.smithi067.stdout:client4499 2024-04-16T13:05:31.410 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc50e499-96cc-43d1-bcde-ee8dfcd0732f.client4499/status') 2024-04-16T13:05:31.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4499 (3)172.21.15.67:0/2557590686 2024-04-16T13:05:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-04-16T13:05:31.564 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-04-16T13:05:31.564 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-04-16T13:05:31.564 INFO:teuthology.orchestra.run.smithi067.stderr:70 bytes copied, 7.1375e-05 s, 981 kB/s 2024-04-16T13:05:31.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:31.577 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-16T13:05:31.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T13:05:31.577 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T13:05:31.577 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T13:05:31.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.790+0000 7f147ca00640 1 Processor -- start 2024-04-16T13:05:31.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.790+0000 7f147ca00640 1 -- start start 2024-04-16T13:05:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f147ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f14780cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f147ca00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f147806f510 0x7f1478071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f147ca00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147815d120 con 0x7f1478072390 2024-04-16T13:05:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f147ca00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f147815d400 con 0x7f147806f510 2024-04-16T13:05:31.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f147ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f147815d6e0 con 0x7f147815fc00 2024-04-16T13:05:31.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f1476800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1478072390 0x7f147806deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55248/0 (socket says 172.21.15.67:55248) 2024-04-16T13:05:31.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.792+0000 7f1476800640 1 -- 172.21.15.67:0/1202205762 learned_addr learned my addr 172.21.15.67:0/1202205762 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:31.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1475400640 1 --2- 172.21.15.67:0/1202205762 >> v2:172.21.15.82:3300/0 conn(0x7f147806f510 0x7f1478071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1475e00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f14780cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589919401 0 0) 0x7f147815d120 con 0x7f1478072390 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f145c003520 con 0x7f1478072390 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948455477 0 0) 0x7f145c003520 con 0x7f1478072390 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 msgr2=0x7f14780cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f14780cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 >> v2:172.21.15.82:3300/0 conn(0x7f147806f510 msgr2=0x7f1478071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 --2- 172.21.15.67:0/1202205762 >> v2:172.21.15.82:3300/0 conn(0x7f147806f510 0x7f1478071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147815d9c0 con 0x7f1478072390 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f14700019f0 con 0x7f1478072390 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.793+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 >> v1:172.21.15.67:6789/0 conn(0x7f1478072390 legacy=0x7f147806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f145c0039b0 0x7f145c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f145c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f145c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f147815d400 con 0x7f145c004800 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f147815d6e0 con 0x7f145c0039b0 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f145c00b9c0 con 0x7f147815fc00 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475400640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f145c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475e00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f145c0039b0 0x7f145c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1476800640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f145c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475400640 1 -- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 msgr2=0x7f145c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475400640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f147815fc00 0x7f145c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475400640 1 -- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f145c0039b0 msgr2=0x7f145c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.794+0000 7f1475400640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f145c0039b0 0x7f145c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.795+0000 7f1475400640 1 -- 172.21.15.67:0/1202205762 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c003520 con 0x7f145c004800 2024-04-16T13:05:31.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.796+0000 7f1475400640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f145c004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1464009ac0 tx=0x7f145c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb22f0e0f96097c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.796+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464039070 con 0x7f145c004800 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.796+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146402c710 con 0x7f145c004800 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.796+0000 7f1474a00640 1 -- 172.21.15.67:0/1202205762 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464009690 con 0x7f145c004800 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 -- 172.21.15.67:0/1202205762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 msgr2=0x7f145c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 --2- 172.21.15.67:0/1202205762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f145c004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1464009ac0 tx=0x7f145c005830 comp rx=0 tx=0).stop 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f1476800640 1 -- 172.21.15.67:0/1202205762 reap_dead start 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 -- 172.21.15.67:0/1202205762 shutdown_connections 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 -- 172.21.15.67:0/1202205762 >> 172.21.15.67:0/1202205762 conn(0x7f1478067d90 msgr2=0x7f147806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 -- 172.21.15.67:0/1202205762 shutdown_connections 2024-04-16T13:05:31.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.797+0000 7f147ca00640 1 -- 172.21.15.67:0/1202205762 wait complete. 2024-04-16T13:05:31.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.799+0000 7f147ca00640 1 Processor -- start 2024-04-16T13:05:31.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.799+0000 7f147ca00640 1 -- start start 2024-04-16T13:05:31.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14780b53e0 0x7f147813cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 0x7f14780cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f147815ffe0 con 0x7f145c004800 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f147806f930 con 0x7f14780cc570 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.800+0000 7f147ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1478160160 con 0x7f14780b53e0 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59406/0 (socket says 172.21.15.67:59406) 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 -- 172.21.15.67:0/1303744841 learned_addr learned my addr 172.21.15.67:0/1303744841 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1476800640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 0x7f14780cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475400640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14780b53e0 0x7f147813cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 -- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14780b53e0 msgr2=0x7f147813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14780b53e0 0x7f147813cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 -- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 msgr2=0x7f14780cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 0x7f14780cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:31.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 -- 172.21.15.67:0/1303744841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14780b4340 con 0x7f145c004800 2024-04-16T13:05:31.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1476800640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 0x7f14780cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:31.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.801+0000 7f1475e00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1468011600 tx=0x7f1468011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:31.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.802+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146800f920 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.802+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146800fac0 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.802+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14780b4620 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.802+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146800fe70 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.802+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14780b4be0 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.803+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1478075bd0 con 0x7f145c004800 2024-04-16T13:05:31.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.804+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1468015460 con 0x7f145c004800 2024-04-16T13:05:31.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.805+0000 7f146e000640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 0x7f145806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:31.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.805+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f146808c840 con 0x7f145c004800 2024-04-16T13:05:31.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.806+0000 7f1475400640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 0x7f145806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:31.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.807+0000 7f1475400640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 0x7f145806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1464036000 tx=0x7f1464030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:31.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:31.810+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1468019030 con 0x7f145c004800 2024-04-16T13:05:32.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.055+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14780cddc0 con 0x7f145c004800 2024-04-16T13:05:32.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.055+0000 7f146e000640 1 -- 172.21.15.67:0/1303744841 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f146805a860 con 0x7f145c004800 2024-04-16T13:05:32.056 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T13:05:32.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 msgr2=0x7f145806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:32.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 0x7f145806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1464036000 tx=0x7f1464030000 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 msgr2=0x7f147813aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1468011600 tx=0x7f1468011ac0 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 shutdown_connections 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f145806c8f0 0x7f145806edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14780cc570 0x7f14780cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f14780b53e0 0x7f147813cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 --2- 172.21.15.67:0/1303744841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f145c004800 0x7f147813aff0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.058+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 >> 172.21.15.67:0/1303744841 conn(0x7f1478067d90 msgr2=0x7f14780c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.059+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 shutdown_connections 2024-04-16T13:05:32.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:32.059+0000 7f147ca00640 1 -- 172.21.15.67:0/1303744841 wait complete. 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T13:05:32.080 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T13:05:32.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:32.081 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:32.138 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42464sec preferred_lft 42464sec 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-04-16T13:05:32.139 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:32.140 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-04-16T13:05:32.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T13:05:32.141 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:32.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:32.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:32.694 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T13:05:32.768 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-16T13:05:32.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:32.772 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-04-16T13:05:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-04-16T13:05:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T13:05:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T13:05:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T13:05:32.827 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T13:05:32.828 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:32.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:33.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:33.643 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:05:33.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:33.694 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-04-16T13:05:33.747 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:33.747 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:33.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T13:05:33.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T13:05:33.747 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:33.947 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T13:05:33.947 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:33.947 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:33.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T13:05:33.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T13:05:33.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T13:05:33.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T13:05:33.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T13:05:33.948 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:34.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:34.277 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:34.278 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:34.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-04-16T13:05:34.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T13:05:34.278 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:34.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:34.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:34.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:34.496 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T13:05:34.541 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T13:05:34.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:34.542 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T13:05:34.637 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T13:05:34.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:34.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T13:05:34.769 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T13:05:34.769 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T13:05:34.769 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:35.477 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T13:05:35.477 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T13:05:35.477 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:35.478 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:35.478 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:35.516 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-04-16T13:05:35.517 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-04-16T13:05:35.517 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=dc50e499-96cc-43d1-bcde-ee8dfcd0732f" will pass to kernel 2024-04-16T13:05:35.521 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T13:05:35.521 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-04-16T13:05:35.521 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T13:05:35.521 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T13:05:35.521 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T13:05:35.526 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T13:05:35.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:35.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T13:05:35.619 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:35.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:35.741 INFO:teuthology.orchestra.run.smithi082.stdout:client4848 2024-04-16T13:05:35.742 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:05:35.742 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:35.796 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:35.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:35.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:35.915 INFO:teuthology.orchestra.run.smithi082.stdout:client4848 2024-04-16T13:05:35.915 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:36.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:36.033 INFO:teuthology.orchestra.run.smithi082.stdout:client4848 2024-04-16T13:05:36.033 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc50e499-96cc-43d1-bcde-ee8dfcd0732f.client4848/status') 2024-04-16T13:05:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:36.177 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4848 (3)172.21.15.82:0/3806438944 2024-04-16T13:05:36.177 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-04-16T13:05:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-04-16T13:05:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-04-16T13:05:36.177 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 7.3109e-05 s, 957 kB/s 2024-04-16T13:05:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:36.190 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-16T13:05:36.190 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T13:05:36.190 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T13:05:36.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-16T13:05:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.418+0000 7f7616400640 1 Processor -- start 2024-04-16T13:05:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.419+0000 7f7616400640 1 -- start start 2024-04-16T13:05:36.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.420+0000 7f7616400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f761015e560 0x7f761015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.420+0000 7f7616400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7610162ae0 0x7f76100c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7616400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7610162300 con 0x7f761015e940 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7616400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f76100c58e0 con 0x7f761015e560 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7616400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f76100c5bc0 con 0x7f7610162ae0 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f761015e560 0x7f761015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f760fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f761015e940 0x7f76100c5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55252/0 (socket says 172.21.15.67:55252) 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f760fe00640 1 -- 172.21.15.67:0/1838968597 learned_addr learned my addr 172.21.15.67:0/1838968597 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615a00640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7610162ae0 0x7f76100c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615000640 1 -- 172.21.15.67:0/1838968597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7610162ae0 msgr2=0x7f76100c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615000640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7610162ae0 0x7f76100c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615000640 1 -- 172.21.15.67:0/1838968597 >> v1:172.21.15.67:6789/0 conn(0x7f761015e940 legacy=0x7f76100c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.421+0000 7f7615000640 1 -- 172.21.15.67:0/1838968597 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76100c5ea0 con 0x7f761015e560 2024-04-16T13:05:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.423+0000 7f7615000640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761015e560 0x7f761015f840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76040097a0 tx=0x7f760402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5c64d06e4f39ef server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.423+0000 7f760f400640 1 -- 172.21.15.67:0/1838968597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604031780 con 0x7f761015e560 2024-04-16T13:05:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.423+0000 7f760f400640 1 -- 172.21.15.67:0/1838968597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604037070 con 0x7f761015e560 2024-04-16T13:05:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.423+0000 7f760f400640 1 -- 172.21.15.67:0/1838968597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604031b40 con 0x7f761015e560 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 -- 172.21.15.67:0/1838968597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761015e560 msgr2=0x7f761015f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761015e560 0x7f761015f840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76040097a0 tx=0x7f760402b820 comp rx=0 tx=0).stop 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 -- 172.21.15.67:0/1838968597 shutdown_connections 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7610162ae0 0x7f76100c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 --2- 172.21.15.67:0/1838968597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f761015e560 0x7f761015f840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 -- 172.21.15.67:0/1838968597 >> 172.21.15.67:0/1838968597 conn(0x7f76100b2070 msgr2=0x7f76100b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 -- 172.21.15.67:0/1838968597 shutdown_connections 2024-04-16T13:05:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.424+0000 7f7616400640 1 -- 172.21.15.67:0/1838968597 wait complete. 2024-04-16T13:05:36.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.426+0000 7f7616400640 1 Processor -- start 2024-04-16T13:05:36.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.426+0000 7f7616400640 1 -- start start 2024-04-16T13:05:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f761015e560 0x7f76100af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 0x7f76100b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7610163110 con 0x7f7610162ae0 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7610162f90 con 0x7f761015e940 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7616400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f76100c68f0 con 0x7f761015e560 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7615a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7615a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59426/0 (socket says 172.21.15.67:59426) 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7615a00640 1 -- 172.21.15.67:0/1474634057 learned_addr learned my addr 172.21.15.67:0/1474634057 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.427+0000 7f7615000640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f761015e560 0x7f76100af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f760fe00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 0x7f76100b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 -- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f761015e560 msgr2=0x7f76100af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f761015e560 0x7f76100af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 -- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 msgr2=0x7f76100b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 0x7f76100b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 -- 172.21.15.67:0/1474634057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761006fbc0 con 0x7f7610162ae0 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f760fe00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 0x7f76100b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7615a00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7608007e60 tx=0x7f760800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608014420 con 0x7f7610162ae0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7608019070 con 0x7f7610162ae0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608014820 con 0x7f7610162ae0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.428+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76101f7b50 con 0x7f7610162ae0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.429+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101f8110 con 0x7f7610162ae0 2024-04-16T13:05:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.430+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7610075bd0 con 0x7f7610162ae0 2024-04-16T13:05:36.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.431+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76080149c0 con 0x7f7610162ae0 2024-04-16T13:05:36.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.432+0000 7f760cc00640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 0x7f75f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:36.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.432+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f760808c740 con 0x7f7610162ae0 2024-04-16T13:05:36.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.433+0000 7f7615000640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 0x7f75f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:36.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.434+0000 7f7615000640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 0x7f75f006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7604036000 tx=0x7f760403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.437+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f760805a760 con 0x7f7610162ae0 2024-04-16T13:05:36.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.687+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f76101f82e0 con 0x7f7610162ae0 2024-04-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.688+0000 7f760cc00640 1 -- 172.21.15.67:0/1474634057 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f760805a060 con 0x7f7610162ae0 2024-04-16T13:05:36.690 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-16T13:05:36.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 msgr2=0x7f75f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 0x7f75f006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7604036000 tx=0x7f760403d040 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 msgr2=0x7f761014f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7608007e60 tx=0x7f760800e4b0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 shutdown_connections 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f75f006c8f0 0x7f75f006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7610162ae0 0x7f761014f320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f761015e940 0x7f76100b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 --2- 172.21.15.67:0/1474634057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f761015e560 0x7f76100af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 >> 172.21.15.67:0/1474634057 conn(0x7f76100b2070 msgr2=0x7f76100cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.691+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 shutdown_connections 2024-04-16T13:05:36.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:36.692+0000 7f7616400640 1 -- 172.21.15.67:0/1474634057 wait complete. 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T13:05:36.715 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-16T13:05:36.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:36.715 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-04-16T13:05:36.775 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42459sec preferred_lft 42459sec 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-04-16T13:05:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether da:1b:e4:77:2d:fb brd ff:ff:ff:ff:ff:ff 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::2084:4eff:fec4:b3fa/64 scope link 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether da:1b:e4:77:2d:fb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::d81b:e4ff:fe77:2dfb/64 scope link 2024-04-16T13:05:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:36.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:36.778 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T13:05:36.867 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-04-16T13:05:36.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:36.872 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-04-16T13:05:36.925 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-04-16T13:05:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T13:05:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T13:05:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T13:05:36.926 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T13:05:36.927 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:37.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:05:37.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:05:37.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:37.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:37.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:37.154 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:05:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T13:05:37.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:37.201 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-04-16T13:05:37.289 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-16T13:05:37.289 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:37.289 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:37.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T13:05:37.289 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-16T13:05:37.289 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:37.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:37.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:37.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T13:05:37.546 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:37.546 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 4a:02:21:46:a9:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::4802:21ff:fe46:a922/64 scope link 2024-04-16T13:05:37.547 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:37.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 4a:02:21:46:a9:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-16T13:05:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-16T13:05:37.623 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.623 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::4802:21ff:fe46:a922/64 scope link 2024-04-16T13:05:37.623 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-04-16T13:05:37.625 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-16T13:05:37.626 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:37.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-04-16T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2024-04-16T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2024-04-16T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-04-16T13:05:38.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:38.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:38.152 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-16T13:05:38.190 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-16T13:05:38.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T13:05:38.190 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-16T13:05:38.279 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T13:05:38.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:38.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T13:05:38.444 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T13:05:38.445 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T13:05:38.445 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T13:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T13:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:38.464 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:38.492 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-16T13:05:38.492 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-16T13:05:38.492 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-04-16T13:05:38.493 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.82:3300,172.21.15.82:3301" 2024-04-16T13:05:38.493 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T13:05:38.493 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790" 2024-04-16T13:05:38.493 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.82:6789,172.21.15.82:6790:/ 2024-04-16T13:05:38.493 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=dc50e499-96cc-43d1-bcde-ee8dfcd0732f" will pass to kernel 2024-04-16T13:05:38.495 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-16T13:05:38.495 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-04-16T13:05:38.495 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T13:05:38.495 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T13:05:38.495 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T13:05:38.499 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T13:05:38.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:38.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-16T13:05:38.575 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:38.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:38.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:client4860 2024-04-16T13:05:38.685 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:05:38.685 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:38.726 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:38.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:38.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:client4860 2024-04-16T13:05:38.885 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T13:05:38.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T13:05:38.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:38.998 INFO:teuthology.orchestra.run.smithi082.stdout:client4860 2024-04-16T13:05:38.999 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dc50e499-96cc-43d1-bcde-ee8dfcd0732f.client4860/status') 2024-04-16T13:05:39.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T13:05:39.139 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4860 (3)172.21.15.82:0/2746987977 2024-04-16T13:05:39.139 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-04-16T13:05:39.139 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-04-16T13:05:39.139 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-04-16T13:05:39.139 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 8.8082e-05 s, 795 kB/s 2024-04-16T13:05:39.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-16T13:05:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T13:05:39.151 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-16T13:05:39.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:39.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.400+0000 7fc957e00640 1 Processor -- start 2024-04-16T13:05:39.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.400+0000 7fc957e00640 1 -- start start 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc957e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9580ad5d0 0x7fc95806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc957e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc958160800 con 0x7fc9580ad170 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc957e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc958160ad0 con 0x7fc95815c6f0 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc957e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc958161090 con 0x7fc9580ad5d0 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc94e000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc9580ad170 0x7fc95806e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55268/0 (socket says 172.21.15.67:55268) 2024-04-16T13:05:39.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.402+0000 7fc94e000640 1 -- 172.21.15.67:0/1937513794 learned_addr learned my addr 172.21.15.67:0/1937513794 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:39.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc957400640 1 --2- 172.21.15.67:0/1937513794 >> v2:172.21.15.82:3300/0 conn(0x7fc9580ad5d0 0x7fc95806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165044689 0 0) 0x7fc958160800 con 0x7fc9580ad170 2024-04-16T13:05:39.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc93c003520 con 0x7fc9580ad170 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217867294 0 0) 0x7fc93c003520 con 0x7fc9580ad170 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 >> v2:172.21.15.82:3300/0 conn(0x7fc9580ad5d0 msgr2=0x7fc95806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 --2- 172.21.15.67:0/1937513794 >> v2:172.21.15.82:3300/0 conn(0x7fc9580ad5d0 0x7fc95806ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 >> v1:172.21.15.82:6789/0 conn(0x7fc95815c6f0 legacy=0x7fc9581600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc958160db0 con 0x7fc9580ad170 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fc940001670 con 0x7fc9580ad170 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 >> v1:172.21.15.67:6789/0 conn(0x7fc9580ad170 legacy=0x7fc95806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93c0039b0 0x7fc93c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.403+0000 7fc956000640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c004800 0x7fc93c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956000640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 0x7fc93c00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c010440 con 0x7fc93c0051c0 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c0105f0 con 0x7fc93c0039b0 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c0107f0 con 0x7fc93c004800 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 0x7fc93c00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 -- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c004800 msgr2=0x7fc93c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c004800 0x7fc93c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956a00640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93c0039b0 0x7fc93c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 -- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93c0039b0 msgr2=0x7fc93c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93c0039b0 0x7fc93c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc957400640 1 -- 172.21.15.67:0/1937513794 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c003520 con 0x7fc93c0051c0 2024-04-16T13:05:39.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.404+0000 7fc956a00640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc93c0039b0 0x7fc93c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.405+0000 7fc957400640 1 -- 172.21.15.67:0/1937513794 reap_dead start 2024-04-16T13:05:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.405+0000 7fc957400640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 0x7fc93c00fdd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc950009fc0 tx=0x7fc93c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d4d1a744d0b79e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950009c10 con 0x7fc93c0051c0 2024-04-16T13:05:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95002cca0 con 0x7fc93c0051c0 2024-04-16T13:05:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc956000640 1 -- 172.21.15.67:0/1937513794 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950003bd0 con 0x7fc93c0051c0 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 -- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 msgr2=0x7fc93c00fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 0x7fc93c00fdd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc950009fc0 tx=0x7fc93c005830 comp rx=0 tx=0).stop 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 -- 172.21.15.67:0/1937513794 shutdown_connections 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 --2- 172.21.15.67:0/1937513794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc93c0051c0 0x7fc93c00fdd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 -- 172.21.15.67:0/1937513794 >> 172.21.15.67:0/1937513794 conn(0x7fc9580d0220 msgr2=0x7fc9580d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.406+0000 7fc957e00640 1 -- 172.21.15.67:0/1937513794 shutdown_connections 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.407+0000 7fc957e00640 1 -- 172.21.15.67:0/1937513794 wait complete. 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.408+0000 7fc957e00640 1 Processor -- start 2024-04-16T13:05:39.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.408+0000 7fc957e00640 1 -- start start 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c0051c0 0x7fc958137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 0x7fc9580995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc9580ada60 con 0x7fc958154130 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc95806e110 con 0x7fc958072ba0 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.409+0000 7fc957e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc9580af200 con 0x7fc93c0051c0 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59438/0 (socket says 172.21.15.67:59438) 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 -- 172.21.15.67:0/2756196442 learned_addr learned my addr 172.21.15.67:0/2756196442 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc956a00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c0051c0 0x7fc958137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc957400640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 0x7fc9580995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 -- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c0051c0 msgr2=0x7fc958137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c0051c0 0x7fc958137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 -- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 msgr2=0x7fc9580995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 0x7fc9580995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 -- 172.21.15.67:0/2756196442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc958138190 con 0x7fc958154130 2024-04-16T13:05:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc957400640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 0x7fc9580995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.410+0000 7fc94e000640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c730 tx=0x7fc94000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.411+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940018070 con 0x7fc958154130 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.411+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9400072f0 con 0x7fc958154130 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.411+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9400047e0 con 0x7fc958154130 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.411+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc958156260 con 0x7fc958154130 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.411+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc958156820 con 0x7fc958154130 2024-04-16T13:05:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.412+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc958075bd0 con 0x7fc958154130 2024-04-16T13:05:39.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.413+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc940004b90 con 0x7fc958154130 2024-04-16T13:05:39.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.415+0000 7fc94f400640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 0x7fc93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.415+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc94008b6e0 con 0x7fc958154130 2024-04-16T13:05:39.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.415+0000 7fc956a00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 0x7fc93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.416+0000 7fc956a00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 0x7fc93406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc948000f60 tx=0x7fc948009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.419+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc940059670 con 0x7fc958154130 2024-04-16T13:05:39.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.626+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc95806fce0 con 0x7fc958154130 2024-04-16T13:05:39.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.628+0000 7fc94f400640 1 -- 172.21.15.67:0/2756196442 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7fc940058f70 con 0x7fc958154130 2024-04-16T13:05:39.631 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:39.631 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 msgr2=0x7fc93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 0x7fc93406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc948000f60 tx=0x7fc948009040 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 msgr2=0x7fc958072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c730 tx=0x7fc94000cbf0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 shutdown_connections 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc93406c8f0 0x7fc93406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc958072ba0 0x7fc9580995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc958154130 0x7fc958072660 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 --2- 172.21.15.67:0/2756196442 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc93c0051c0 0x7fc958137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.631+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 >> 172.21.15.67:0/2756196442 conn(0x7fc9580d0220 msgr2=0x7fc958154db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.632+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 shutdown_connections 2024-04-16T13:05:39.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.632+0000 7fc957e00640 1 -- 172.21.15.67:0/2756196442 wait complete. 2024-04-16T13:05:39.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:39.656 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.874+0000 7f7b45c00640 1 Processor -- start 2024-04-16T13:05:39.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.875+0000 7f7b45c00640 1 -- start start 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.876+0000 7f7b45c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b400b23f0 0x7f7b400cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.876+0000 7f7b45c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b400ce460 0x7f7b401654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.876+0000 7f7b45c00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b401494f0 con 0x7f7b40149110 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.876+0000 7f7b45c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7b400cebe0 con 0x7f7b400ce460 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.876+0000 7f7b45c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f7b40164730 con 0x7f7b400b23f0 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b400ce460 0x7f7b401654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b400ce460 0x7f7b401654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59440/0 (socket says 172.21.15.67:59440) 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 -- 172.21.15.67:0/2100824088 learned_addr learned my addr 172.21.15.67:0/2100824088 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:39.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3e000640 1 --2- 172.21.15.67:0/2100824088 >> v2:172.21.15.82:3300/0 conn(0x7f7b400b23f0 0x7f7b400cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 -- 172.21.15.67:0/2100824088 >> v2:172.21.15.82:3300/0 conn(0x7f7b400b23f0 msgr2=0x7f7b400cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 --2- 172.21.15.67:0/2100824088 >> v2:172.21.15.82:3300/0 conn(0x7f7b400b23f0 0x7f7b400cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 -- 172.21.15.67:0/2100824088 >> v1:172.21.15.82:6789/0 conn(0x7f7b40149110 legacy=0x7f7b400b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.877+0000 7f7b3f400640 1 -- 172.21.15.67:0/2100824088 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b40164a10 con 0x7f7b400ce460 2024-04-16T13:05:39.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.878+0000 7f7b3f400640 1 --2- 172.21.15.67:0/2100824088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b401654f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7b400b5d70 tx=0x7f7b3802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56db8a42f337a00f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.879+0000 7f7b3d600640 1 -- 172.21.15.67:0/2100824088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3802c9f0 con 0x7f7b400ce460 2024-04-16T13:05:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.879+0000 7f7b3d600640 1 -- 172.21.15.67:0/2100824088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3802cb90 con 0x7f7b400ce460 2024-04-16T13:05:39.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.879+0000 7f7b3d600640 1 -- 172.21.15.67:0/2100824088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b380343f0 con 0x7f7b400ce460 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.879+0000 7f7b45c00640 1 -- 172.21.15.67:0/2100824088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 msgr2=0x7f7b401654f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.879+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2100824088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b401654f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7b400b5d70 tx=0x7f7b3802be50 comp rx=0 tx=0).stop 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 -- 172.21.15.67:0/2100824088 shutdown_connections 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2100824088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b401654f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2100824088 >> v2:172.21.15.82:3300/0 conn(0x7f7b400b23f0 0x7f7b400cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 -- 172.21.15.67:0/2100824088 >> 172.21.15.67:0/2100824088 conn(0x7f7b40067d90 msgr2=0x7f7b4006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 -- 172.21.15.67:0/2100824088 shutdown_connections 2024-04-16T13:05:39.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.880+0000 7f7b45c00640 1 -- 172.21.15.67:0/2100824088 wait complete. 2024-04-16T13:05:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.881+0000 7f7b45c00640 1 Processor -- start 2024-04-16T13:05:39.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 -- start start 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 0x7f7b4013edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 0x7f7b400b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40165a30 con 0x7f7b400ce460 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b400ce870 con 0x7f7b40149110 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.882+0000 7f7b45c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7b40165bb0 con 0x7f7b400b23f0 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59456/0 (socket says 172.21.15.67:59456) 2024-04-16T13:05:39.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 -- 172.21.15.67:0/2957334508 learned_addr learned my addr 172.21.15.67:0/2957334508 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3f400640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 0x7f7b400b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3ea00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 0x7f7b4013edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 -- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 msgr2=0x7f7b4013edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 0x7f7b4013edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 -- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 msgr2=0x7f7b400b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 0x7f7b400b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3e000640 1 -- 172.21.15.67:0/2957334508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b40149b50 con 0x7f7b400ce460 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3f400640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 0x7f7b400b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.883+0000 7f7b3ea00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 0x7f7b4013edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b3e000640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800d800 tx=0x7f7b2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800b6c0 con 0x7f7b400ce460 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b28019070 con 0x7f7b400ce460 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800ba80 con 0x7f7b400ce460 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b40149e30 con 0x7f7b400ce460 2024-04-16T13:05:39.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.884+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4014a3f0 con 0x7f7b400ce460 2024-04-16T13:05:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.885+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b40068a70 con 0x7f7b400ce460 2024-04-16T13:05:39.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.886+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b2800bc20 con 0x7f7b400ce460 2024-04-16T13:05:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.887+0000 7f7b36a00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 0x7f7b1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:39.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.887+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7b2808c4e0 con 0x7f7b400ce460 2024-04-16T13:05:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.888+0000 7f7b3ea00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 0x7f7b1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:39.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.889+0000 7f7b3ea00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 0x7f7b1c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000a830 tx=0x7f7b30008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:39.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:39.892+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b2805a470 con 0x7f7b400ce460 2024-04-16T13:05:40.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.094+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b4014a5c0 con 0x7f7b400ce460 2024-04-16T13:05:40.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.094+0000 7f7b36a00640 1 -- 172.21.15.67:0/2957334508 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f7b28059d70 con 0x7f7b400ce460 2024-04-16T13:05:40.097 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:40.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 msgr2=0x7f7b1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 0x7f7b1c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000a830 tx=0x7f7b30008040 comp rx=0 tx=0).stop 2024-04-16T13:05:40.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 msgr2=0x7f7b400b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800d800 tx=0x7f7b2800dcc0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 shutdown_connections 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7b1c06c8f0 0x7f7b1c06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b40149110 0x7f7b400b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b400ce460 0x7f7b400b43b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 --2- 172.21.15.67:0/2957334508 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7b400b23f0 0x7f7b4013edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 >> 172.21.15.67:0/2957334508 conn(0x7f7b40067d90 msgr2=0x7f7b400b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 shutdown_connections 2024-04-16T13:05:40.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.097+0000 7f7b45c00640 1 -- 172.21.15.67:0/2957334508 wait complete. 2024-04-16T13:05:40.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:40.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.340+0000 7f2907200640 1 Processor -- start 2024-04-16T13:05:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.340+0000 7f2907200640 1 -- start start 2024-04-16T13:05:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f2907200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29000d48e0 0x7f29000d4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f2907200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f29000b7a80 0x7f29000b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f2907200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29000d34c0 con 0x7f290015ecc0 2024-04-16T13:05:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f2907200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f29000d5280 con 0x7f29000b7a80 2024-04-16T13:05:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f2907200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29000d37a0 con 0x7f29000d48e0 2024-04-16T13:05:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.342+0000 7f28ffe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f290015ecc0 0x7f29000d2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55278/0 (socket says 172.21.15.67:55278) 2024-04-16T13:05:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f28ffe00640 1 -- 172.21.15.67:0/1583714758 learned_addr learned my addr 172.21.15.67:0/1583714758 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f2905200640 1 --2- 172.21.15.67:0/1583714758 >> v2:172.21.15.67:3300/0 conn(0x7f29000b7a80 0x7f29000b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f28f7e00640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29000d48e0 0x7f29000d4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f28ff400640 1 -- 172.21.15.67:0/1583714758 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097991189 0 0) 0x7f29000d34c0 con 0x7f290015ecc0 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f2905200640 1 -- 172.21.15.67:0/1583714758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29000d48e0 msgr2=0x7f29000d4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f2905200640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29000d48e0 0x7f29000d4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f2905200640 1 -- 172.21.15.67:0/1583714758 >> v1:172.21.15.67:6789/0 conn(0x7f290015ecc0 legacy=0x7f29000d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.343+0000 7f2905200640 1 -- 172.21.15.67:0/1583714758 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29000d3a80 con 0x7f29000b7a80 2024-04-16T13:05:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.344+0000 7f2905200640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000b7a80 0x7f29000b7eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009d90 tx=0x7f28f802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d02cc7411707fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f28ff400640 1 -- 172.21.15.67:0/1583714758 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8039070 con 0x7f29000b7a80 2024-04-16T13:05:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f28ff400640 1 -- 172.21.15.67:0/1583714758 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f802cc50 con 0x7f29000b7a80 2024-04-16T13:05:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f28ff400640 1 -- 172.21.15.67:0/1583714758 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8034440 con 0x7f29000b7a80 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 -- 172.21.15.67:0/1583714758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000b7a80 msgr2=0x7f29000b7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000b7a80 0x7f29000b7eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009d90 tx=0x7f28f802bea0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 -- 172.21.15.67:0/1583714758 shutdown_connections 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000b7a80 0x7f29000b7eb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 --2- 172.21.15.67:0/1583714758 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29000d48e0 0x7f29000d4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 -- 172.21.15.67:0/1583714758 >> 172.21.15.67:0/1583714758 conn(0x7f2900067b80 msgr2=0x7f2900067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 -- 172.21.15.67:0/1583714758 shutdown_connections 2024-04-16T13:05:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.345+0000 7f2907200640 1 -- 172.21.15.67:0/1583714758 wait complete. 2024-04-16T13:05:40.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.347+0000 7f2907200640 1 Processor -- start 2024-04-16T13:05:40.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.347+0000 7f2907200640 1 -- start start 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 0x7f2900161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f290015ecc0 0x7f29001f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f29000d4560 con 0x7f29000d48e0 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29000d4040 con 0x7f29000b7a80 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.348+0000 7f2907200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f290015f0a0 con 0x7f290015ecc0 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59484/0 (socket says 172.21.15.67:59484) 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 -- 172.21.15.67:0/1587358636 learned_addr learned my addr 172.21.15.67:0/1587358636 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f2905200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f290015ecc0 0x7f29001f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28ffe00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 0x7f2900161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 -- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f290015ecc0 msgr2=0x7f29001f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f290015ecc0 0x7f29001f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 -- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 msgr2=0x7f2900161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 0x7f2900161cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28f7e00640 1 -- 172.21.15.67:0/1587358636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001579a0 con 0x7f29000d48e0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.349+0000 7f28ffe00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 0x7f2900161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f28f7e00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28e800d800 tx=0x7f28e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e800b6c0 con 0x7f29000d48e0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e8019070 con 0x7f29000d48e0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e800ba80 con 0x7f29000d48e0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29001573e0 con 0x7f29000d48e0 2024-04-16T13:05:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.350+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290015f4a0 con 0x7f29000d48e0 2024-04-16T13:05:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.352+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29000d08f0 con 0x7f29000d48e0 2024-04-16T13:05:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.353+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28e800bc20 con 0x7f29000d48e0 2024-04-16T13:05:40.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.353+0000 7f28fcc00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 0x7f28dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.354+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f28e808c400 con 0x7f29000d48e0 2024-04-16T13:05:40.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.354+0000 7f28ffe00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 0x7f28dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.355+0000 7f28ffe00640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 0x7f28dc06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f60 tx=0x7f28f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.358+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29000d08f0 con 0x7f29000d48e0 2024-04-16T13:05:40.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.569+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2900068a70 con 0x7f29000d48e0 2024-04-16T13:05:40.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.570+0000 7f28fcc00640 1 -- 172.21.15.67:0/1587358636 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f28e805a420 con 0x7f29000d48e0 2024-04-16T13:05:40.572 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:40.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 msgr2=0x7f28dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 0x7f28dc06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f60 tx=0x7f28f0009040 comp rx=0 tx=0).stop 2024-04-16T13:05:40.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 msgr2=0x7f290014be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28e800d800 tx=0x7f28e800dcc0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 shutdown_connections 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.573+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f28dc06c8f0 0x7f28dc06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f290015ecc0 0x7f29001f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29000d48e0 0x7f290014be40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 --2- 172.21.15.67:0/1587358636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29000b7a80 0x7f2900161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 >> 172.21.15.67:0/1587358636 conn(0x7f2900067b80 msgr2=0x7f2900159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:40.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 shutdown_connections 2024-04-16T13:05:40.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.574+0000 7f2907200640 1 -- 172.21.15.67:0/1587358636 wait complete. 2024-04-16T13:05:40.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:40.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.822+0000 7f0694a00640 1 Processor -- start 2024-04-16T13:05:40.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.822+0000 7f0694a00640 1 -- start start 2024-04-16T13:05:40.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.824+0000 7f0694a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0690070ae0 0x7f06900ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.824+0000 7f0694a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f06900b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.824+0000 7f0694a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06900b43f0 con 0x7f06900b0400 2024-04-16T13:05:40.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.824+0000 7f0694a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f06900b6770 con 0x7f0690070ae0 2024-04-16T13:05:40.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.824+0000 7f0694a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f06900b4690 con 0x7f06900b07e0 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.825+0000 7f0685e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0690070ae0 0x7f06900ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.825+0000 7f0685e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0690070ae0 0x7f06900ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:55030/0 (socket says 172.21.15.67:55030) 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.825+0000 7f0685e00640 1 -- 172.21.15.67:0/371670275 learned_addr learned my addr 172.21.15.67:0/371670275 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.825+0000 7f068f200640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f06900b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.825+0000 7f068e800640 1 --1- 172.21.15.67:0/371670275 >> v1:172.21.15.82:6789/0 conn(0x7f06900b0400 0x7f069006f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:48268/0 (socket says 172.21.15.67:48268) 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.826+0000 7f0685e00640 1 -- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 msgr2=0x7f06900b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.826+0000 7f0685e00640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f06900b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.826+0000 7f0685e00640 1 -- 172.21.15.67:0/371670275 >> v1:172.21.15.82:6789/0 conn(0x7f06900b0400 legacy=0x7f069006f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.826+0000 7f0685e00640 1 -- 172.21.15.67:0/371670275 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06900b4970 con 0x7f0690070ae0 2024-04-16T13:05:40.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.827+0000 7f0685e00640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f06900ae3d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06780098a0 tx=0x7f067802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=397df75d93ff17cc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.827+0000 7f068de00640 1 -- 172.21.15.67:0/371670275 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678034070 con 0x7f0690070ae0 2024-04-16T13:05:40.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.828+0000 7f068de00640 1 -- 172.21.15.67:0/371670275 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0678030840 con 0x7f0690070ae0 2024-04-16T13:05:40.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.828+0000 7f068de00640 1 -- 172.21.15.67:0/371670275 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678030c10 con 0x7f0690070ae0 2024-04-16T13:05:40.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.828+0000 7f0694a00640 1 -- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 msgr2=0x7f06900ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.828+0000 7f0694a00640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f06900ae3d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06780098a0 tx=0x7f067802b980 comp rx=0 tx=0).stop 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 -- 172.21.15.67:0/371670275 shutdown_connections 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f06900b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 --2- 172.21.15.67:0/371670275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f06900ae3d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 -- 172.21.15.67:0/371670275 >> 172.21.15.67:0/371670275 conn(0x7f06900732c0 msgr2=0x7f069009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 -- 172.21.15.67:0/371670275 shutdown_connections 2024-04-16T13:05:40.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.829+0000 7f0694a00640 1 -- 172.21.15.67:0/371670275 wait complete. 2024-04-16T13:05:40.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.831+0000 7f0694a00640 1 Processor -- start 2024-04-16T13:05:40.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.831+0000 7f0694a00640 1 -- start start 2024-04-16T13:05:40.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f069014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f069015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0690163f20 con 0x7f06900b0400 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0690163da0 con 0x7f0690070ae0 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0694a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f06901640a0 con 0x7f06900b07e0 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0685e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0685e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59492/0 (socket says 172.21.15.67:59492) 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f0685e00640 1 -- 172.21.15.67:0/2964560295 learned_addr learned my addr 172.21.15.67:0/2964560295 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.833+0000 7f068e800640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f069014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 -- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 msgr2=0x7f069015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f069015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 -- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 msgr2=0x7f069014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f069014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:40.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 -- 172.21.15.67:0/2964560295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069015d120 con 0x7f06900b0400 2024-04-16T13:05:40.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0685e00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678000c00 tx=0x7f0678004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678048070 con 0x7f06900b0400 2024-04-16T13:05:40.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0678030640 con 0x7f06900b0400 2024-04-16T13:05:40.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0678034040 con 0x7f06900b0400 2024-04-16T13:05:40.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.834+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069015d400 con 0x7f06900b0400 2024-04-16T13:05:40.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.835+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0690159150 con 0x7f06900b0400 2024-04-16T13:05:40.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.836+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06900683d0 con 0x7f06900b0400 2024-04-16T13:05:40.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.837+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f067804b070 con 0x7f06900b0400 2024-04-16T13:05:40.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.838+0000 7f0687400640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 0x7f066c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:40.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.838+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f06780adf40 con 0x7f06900b0400 2024-04-16T13:05:40.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.839+0000 7f068e800640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 0x7f066c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:40.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.840+0000 7f068e800640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 0x7f066c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06800012e0 tx=0x7f0680005eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:40.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:40.845+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f067807bed0 con 0x7f06900b0400 2024-04-16T13:05:41.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.055+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0690159320 con 0x7f06900b0400 2024-04-16T13:05:41.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.056+0000 7f0687400640 1 -- 172.21.15.67:0/2964560295 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f067807b7d0 con 0x7f06900b0400 2024-04-16T13:05:41.058 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 msgr2=0x7f066c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 0x7f066c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06800012e0 tx=0x7f0680005eb0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 msgr2=0x7f069015a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0678000c00 tx=0x7f0678004730 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 shutdown_connections 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f066c06c8f0 0x7f066c06edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f06900b07e0 0x7f069015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06900b0400 0x7f069015a200 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 --2- 172.21.15.67:0/2964560295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0690070ae0 0x7f069014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.059+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 >> 172.21.15.67:0/2964560295 conn(0x7f06900732c0 msgr2=0x7f06900af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.060+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 shutdown_connections 2024-04-16T13:05:41.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.060+0000 7f0694a00640 1 -- 172.21.15.67:0/2964560295 wait complete. 2024-04-16T13:05:41.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.304+0000 7f6a68400640 1 Processor -- start 2024-04-16T13:05:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.304+0000 7f6a68400640 1 -- start start 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.305+0000 7f6a68400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a600d4d70 0x7f6a600b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.305+0000 7f6a68400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a600d34c0 con 0x7f6a600d48e0 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a68400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a600d37a0 con 0x7f6a6015ecc0 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a68400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6a600d3a80 con 0x7f6a600d4d70 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a65000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6a600d48e0 0x7f6a600b7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:55292/0 (socket says 172.21.15.67:55292) 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a65000640 1 -- 172.21.15.67:0/452770811 learned_addr learned my addr 172.21.15.67:0/452770811 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a66400640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a600d4d70 0x7f6a600b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594765802 0 0) 0x7f6a600d34c0 con 0x7f6a600d48e0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.306+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a48003520 con 0x7f6a600d48e0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2564736157 0 0) 0x7f6a48003520 con 0x7f6a600d48e0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a600d4d70 msgr2=0x7f6a600b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a600d4d70 0x7f6a600b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 >> v1:172.21.15.82:6789/0 conn(0x7f6a6015ecc0 legacy=0x7f6a600d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a600d3d60 con 0x7f6a600d48e0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f6a4c001670 con 0x7f6a600d48e0 2024-04-16T13:05:41.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 >> v1:172.21.15.67:6789/0 conn(0x7f6a600d48e0 legacy=0x7f6a600b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a480039e0 0x7f6a48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a48005210 0x7f6a4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600d3a80 con 0x7f6a48004800 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4800c0c0 con 0x7f6a480039e0 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4800c2c0 con 0x7f6a48005210 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a66400640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a600d4d70 0x7f6a600b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.307+0000 7f6a65000640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65a00640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a480039e0 0x7f6a48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65000640 1 -- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a48005210 msgr2=0x7f6a4800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65000640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a48005210 0x7f6a4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65000640 1 -- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a480039e0 msgr2=0x7f6a48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65000640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a480039e0 0x7f6a48003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.308+0000 7f6a65000640 1 -- 172.21.15.67:0/452770811 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a48003520 con 0x7f6a48004800 2024-04-16T13:05:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a65000640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a48004c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c110 tx=0x7f6a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db09093e705b18bb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c007c40 con 0x7f6a48004800 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c030070 con 0x7f6a48004800 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a5fe00640 1 -- 172.21.15.67:0/452770811 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c005d30 con 0x7f6a48004800 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a68400640 1 -- 172.21.15.67:0/452770811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 msgr2=0x7f6a48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a68400640 1 --2- 172.21.15.67:0/452770811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a48004c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c110 tx=0x7f6a48005830 comp rx=0 tx=0).stop 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.309+0000 7f6a66400640 1 -- 172.21.15.67:0/452770811 reap_dead start 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.310+0000 7f6a68400640 1 -- 172.21.15.67:0/452770811 shutdown_connections 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.310+0000 7f6a68400640 1 -- 172.21.15.67:0/452770811 >> 172.21.15.67:0/452770811 conn(0x7f6a60067b80 msgr2=0x7f6a60067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.310+0000 7f6a68400640 1 -- 172.21.15.67:0/452770811 shutdown_connections 2024-04-16T13:05:41.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.310+0000 7f6a68400640 1 -- 172.21.15.67:0/452770811 wait complete. 2024-04-16T13:05:41.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.311+0000 7f6a68400640 1 Processor -- start 2024-04-16T13:05:41.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.312+0000 7f6a68400640 1 -- start start 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 0x7f6a60160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 0x7f6a600ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600d5170 con 0x7f6a48004800 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600d4560 con 0x7f6a600cdbf0 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a68400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6015f0a0 con 0x7f6a601603c0 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59506/0 (socket says 172.21.15.67:59506) 2024-04-16T13:05:41.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 -- 172.21.15.67:0/4182625955 learned_addr learned my addr 172.21.15.67:0/4182625955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:41.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a66400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 0x7f6a600ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65000640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 0x7f6a60160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 -- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 msgr2=0x7f6a60160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 0x7f6a60160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 -- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 msgr2=0x7f6a600ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 0x7f6a600ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65a00640 1 -- 172.21.15.67:0/4182625955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a600c8500 con 0x7f6a48004800 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a65000640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 0x7f6a60160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.313+0000 7f6a66400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 0x7f6a600ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a65a00640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400d560 tx=0x7f6a5400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54005480 con 0x7f6a48004800 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54017070 con 0x7f6a48004800 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54003810 con 0x7f6a48004800 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a600c87e0 con 0x7f6a48004800 2024-04-16T13:05:41.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.314+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a600c92c0 con 0x7f6a48004800 2024-04-16T13:05:41.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.315+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60068a70 con 0x7f6a48004800 2024-04-16T13:05:41.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.316+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a540039b0 con 0x7f6a48004800 2024-04-16T13:05:41.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.318+0000 7f6a5d600640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 0x7f6a4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.318+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6a5408be50 con 0x7f6a48004800 2024-04-16T13:05:41.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.318+0000 7f6a65000640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 0x7f6a4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.319+0000 7f6a65000640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 0x7f6a4006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c034000 tx=0x7f6a4c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.322+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a54059de0 con 0x7f6a48004800 2024-04-16T13:05:41.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.527+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6a60155830 con 0x7f6a48004800 2024-04-16T13:05:41.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.528+0000 7f6a5d600640 1 -- 172.21.15.67:0/4182625955 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f6a5408d0a0 con 0x7f6a48004800 2024-04-16T13:05:41.530 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:41.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 msgr2=0x7f6a4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 0x7f6a4006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c034000 tx=0x7f6a4c009030 comp rx=0 tx=0).stop 2024-04-16T13:05:41.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 msgr2=0x7f6a600c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400d560 tx=0x7f6a5400da20 comp rx=0 tx=0).stop 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 shutdown_connections 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6a4006c8f0 0x7f6a4006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a600cdbf0 0x7f6a600ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6a601603c0 0x7f6a60160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 --2- 172.21.15.67:0/4182625955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a48004800 0x7f6a600c71f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 >> 172.21.15.67:0/4182625955 conn(0x7f6a60067b80 msgr2=0x7f6a6015db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 shutdown_connections 2024-04-16T13:05:41.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.531+0000 7f6a68400640 1 -- 172.21.15.67:0/4182625955 wait complete. 2024-04-16T13:05:41.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.772+0000 7f5385c00640 1 Processor -- start 2024-04-16T13:05:41.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.772+0000 7f5385c00640 1 -- start start 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.773+0000 7f5385c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f538015b3a0 0x7f538015f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.773+0000 7f5385c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 0x7f53800ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.773+0000 7f5385c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f53800cd280 0x7f53800ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.773+0000 7f5385c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f538015ff30 con 0x7f538015b3a0 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f5385c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f538015f970 con 0x7f538015bb60 2024-04-16T13:05:41.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f5385c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f538015fc50 con 0x7f53800cd280 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f537fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f538015b3a0 0x7f538015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f537fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f538015b3a0 0x7f538015f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59514/0 (socket says 172.21.15.67:59514) 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f537fe00640 1 -- 172.21.15.67:0/4114378035 learned_addr learned my addr 172.21.15.67:0/4114378035 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f5385200640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f53800cd280 0x7f53800ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.774+0000 7f5377e00640 1 --2- 172.21.15.67:0/4114378035 >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 0x7f53800ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f537fe00640 1 -- 172.21.15.67:0/4114378035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f53800cd280 msgr2=0x7f53800ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:41.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f537fe00640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f53800cd280 0x7f53800ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f537fe00640 1 -- 172.21.15.67:0/4114378035 >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 msgr2=0x7f53800ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:41.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f537fe00640 1 --2- 172.21.15.67:0/4114378035 >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 0x7f53800ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f537fe00640 1 -- 172.21.15.67:0/4114378035 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53800cc540 con 0x7f538015b3a0 2024-04-16T13:05:41.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.775+0000 7f5377e00640 1 --2- 172.21.15.67:0/4114378035 >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 0x7f53800ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:41.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.776+0000 7f537fe00640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015b3a0 0x7f538015f000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f53800cda20 tx=0x7f537002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c497af8c730350 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f537f400640 1 -- 172.21.15.67:0/4114378035 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537002e070 con 0x7f538015b3a0 2024-04-16T13:05:41.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f537f400640 1 -- 172.21.15.67:0/4114378035 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370037070 con 0x7f538015b3a0 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f537f400640 1 -- 172.21.15.67:0/4114378035 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370031a00 con 0x7f538015b3a0 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 -- 172.21.15.67:0/4114378035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015b3a0 msgr2=0x7f538015f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015b3a0 0x7f538015f000 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f53800cda20 tx=0x7f537002b880 comp rx=0 tx=0).stop 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 -- 172.21.15.67:0/4114378035 shutdown_connections 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f53800cd280 0x7f53800ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 --2- 172.21.15.67:0/4114378035 >> v2:172.21.15.82:3300/0 conn(0x7f538015bb60 0x7f53800ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 --2- 172.21.15.67:0/4114378035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015b3a0 0x7f538015f000 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 -- 172.21.15.67:0/4114378035 >> 172.21.15.67:0/4114378035 conn(0x7f53800b2070 msgr2=0x7f53800b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 -- 172.21.15.67:0/4114378035 shutdown_connections 2024-04-16T13:05:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.777+0000 7f5385c00640 1 -- 172.21.15.67:0/4114378035 wait complete. 2024-04-16T13:05:41.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.779+0000 7f5385c00640 1 Processor -- start 2024-04-16T13:05:41.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.779+0000 7f5385c00640 1 -- start start 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53800cd280 0x7f53801506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538015b3a0 0x7f53801f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f538015f6c0 con 0x7f538015bb60 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f538015f540 con 0x7f53800cd280 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.780+0000 7f5385c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f53800cadd0 con 0x7f538015b3a0 2024-04-16T13:05:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59516/0 (socket says 172.21.15.67:59516) 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 -- 172.21.15.67:0/1553704675 learned_addr learned my addr 172.21.15.67:0/1553704675 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5377e00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538015b3a0 0x7f53801f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 -- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538015b3a0 msgr2=0x7f53801f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f537fe00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53800cd280 0x7f53801506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538015b3a0 0x7f53801f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 -- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53800cd280 msgr2=0x7f53801506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53800cd280 0x7f53801506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 -- 172.21.15.67:0/1553704675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538009c770 con 0x7f538015bb60 2024-04-16T13:05:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.781+0000 7f5385200640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f537800eed0 tx=0x7f537800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.782+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378018020 con 0x7f538015bb60 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.782+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378014400 con 0x7f538015bb60 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.782+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53780147f0 con 0x7f538015bb60 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.782+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538009ca50 con 0x7f538015bb60 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.782+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538009d010 con 0x7f538015bb60 2024-04-16T13:05:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.783+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5380075bd0 con 0x7f538015bb60 2024-04-16T13:05:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.784+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5378005d10 con 0x7f538015bb60 2024-04-16T13:05:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.785+0000 7f537cc00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 0x7f535c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.786+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f537808c890 con 0x7f538015bb60 2024-04-16T13:05:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.786+0000 7f537fe00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 0x7f535c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.787+0000 7f537fe00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 0x7f535c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5370036000 tx=0x7f5370008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:41.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.790+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5378022030 con 0x7f538015bb60 2024-04-16T13:05:42.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:41.999+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f538015eb40 con 0x7f538015bb60 2024-04-16T13:05:42.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.001+0000 7f537cc00640 1 -- 172.21.15.67:0/1553704675 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f537805a8f0 con 0x7f538015bb60 2024-04-16T13:05:42.004 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:42.004 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.005+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 msgr2=0x7f535c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.005+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 0x7f535c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5370036000 tx=0x7f5370008030 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.005+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 msgr2=0x7f53800c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.005+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f537800eed0 tx=0x7f537800b480 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 shutdown_connections 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f535c06c8f0 0x7f535c06edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538015bb60 0x7f53800c6280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538015b3a0 0x7f53801f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 --2- 172.21.15.67:0/1553704675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53800cd280 0x7f53801506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 >> 172.21.15.67:0/1553704675 conn(0x7f53800b2070 msgr2=0x7f5380073510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:42.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 shutdown_connections 2024-04-16T13:05:42.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.006+0000 7f5385c00640 1 -- 172.21.15.67:0/1553704675 wait complete. 2024-04-16T13:05:42.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:42.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.241+0000 7fda81a00640 1 Processor -- start 2024-04-16T13:05:42.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.241+0000 7fda81a00640 1 -- start start 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.242+0000 7fda81a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fda7c15d3f0 0x7fda7c1673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.242+0000 7fda81a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c0d04b0 0x7fda7c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.242+0000 7fda81a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7c1641b0 con 0x7fda7c1631e0 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.242+0000 7fda81a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c0d0e50 con 0x7fda7c15d3f0 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.242+0000 7fda81a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c163ed0 con 0x7fda7c0d04b0 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fda7c15d3f0 0x7fda7c1673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fda7c15d3f0 0x7fda7c1673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57746/0 (socket says 172.21.15.67:57746) 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 -- 172.21.15.67:0/1680324452 learned_addr learned my addr 172.21.15.67:0/1680324452 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda73400640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c0d04b0 0x7fda7c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 -- 172.21.15.67:0/1680324452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c0d04b0 msgr2=0x7fda7c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c0d04b0 0x7fda7c0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 -- 172.21.15.67:0/1680324452 >> v1:172.21.15.82:6789/0 conn(0x7fda7c1631e0 legacy=0x7fda7c163670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.243+0000 7fda7be00640 1 -- 172.21.15.67:0/1680324452 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c1668e0 con 0x7fda7c15d3f0 2024-04-16T13:05:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.244+0000 7fda7be00640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1673c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009870 tx=0x7fda6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8070284e850e217b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda7b400640 1 -- 172.21.15.67:0/1680324452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c035020 con 0x7fda7c15d3f0 2024-04-16T13:05:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda7b400640 1 -- 172.21.15.67:0/1680324452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c031640 con 0x7fda7c15d3f0 2024-04-16T13:05:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda7b400640 1 -- 172.21.15.67:0/1680324452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c02d040 con 0x7fda7c15d3f0 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 -- 172.21.15.67:0/1680324452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c15d3f0 msgr2=0x7fda7c1673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1673c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009870 tx=0x7fda6c02b8f0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 -- 172.21.15.67:0/1680324452 shutdown_connections 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c0d04b0 0x7fda7c0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 --2- 172.21.15.67:0/1680324452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1673c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 -- 172.21.15.67:0/1680324452 >> 172.21.15.67:0/1680324452 conn(0x7fda7c06bc00 msgr2=0x7fda7c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 -- 172.21.15.67:0/1680324452 shutdown_connections 2024-04-16T13:05:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.245+0000 7fda81a00640 1 -- 172.21.15.67:0/1680324452 wait complete. 2024-04-16T13:05:42.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.247+0000 7fda81a00640 1 Processor -- start 2024-04-16T13:05:42.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.247+0000 7fda81a00640 1 -- start start 2024-04-16T13:05:42.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1fb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 0x7fda7c0ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c0b4230 con 0x7fda7c0d04b0 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c166ea0 con 0x7fda7c15d3f0 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.248+0000 7fda81a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c0b43b0 con 0x7fda7c1631e0 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57762/0 (socket says 172.21.15.67:57762) 2024-04-16T13:05:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 -- 172.21.15.67:0/3032291397 learned_addr learned my addr 172.21.15.67:0/3032291397 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:42.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda81000640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 0x7fda7c0ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda73400640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 -- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 msgr2=0x7fda7c0ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 0x7fda7c0ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 -- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 msgr2=0x7fda7c1fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda7be00640 1 -- 172.21.15.67:0/3032291397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c06e2c0 con 0x7fda7c0d04b0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda73400640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.249+0000 7fda81000640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 0x7fda7c0ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda7be00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02b930 tx=0x7fda6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c040070 con 0x7fda7c0d04b0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6c0399f0 con 0x7fda7c0d04b0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c035040 con 0x7fda7c0d04b0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c06e5a0 con 0x7fda7c0d04b0 2024-04-16T13:05:42.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.250+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c06eb60 con 0x7fda7c0d04b0 2024-04-16T13:05:42.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.251+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c075bd0 con 0x7fda7c0d04b0 2024-04-16T13:05:42.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.252+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda6c038020 con 0x7fda7c0d04b0 2024-04-16T13:05:42.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.253+0000 7fda78c00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 0x7fda5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.253+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fda6c0ad940 con 0x7fda7c0d04b0 2024-04-16T13:05:42.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.254+0000 7fda73400640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 0x7fda5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.255+0000 7fda73400640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 0x7fda5806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b1d70 tx=0x7fda64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.258+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda6c07b970 con 0x7fda7c0d04b0 2024-04-16T13:05:42.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.460+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda7c0b4010 con 0x7fda7c0d04b0 2024-04-16T13:05:42.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.461+0000 7fda78c00640 1 -- 172.21.15.67:0/3032291397 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fda6c07b270 con 0x7fda7c0d04b0 2024-04-16T13:05:42.463 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 msgr2=0x7fda5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 0x7fda5806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0b1d70 tx=0x7fda64008040 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 msgr2=0x7fda7c1f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda6c02b930 tx=0x7fda6c0046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 shutdown_connections 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.463+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fda5806c8f0 0x7fda5806edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda7c1631e0 0x7fda7c0ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda7c15d3f0 0x7fda7c1fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 --2- 172.21.15.67:0/3032291397 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda7c0d04b0 0x7fda7c1f8b50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 >> 172.21.15.67:0/3032291397 conn(0x7fda7c06bc00 msgr2=0x7fda7c1646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:42.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 shutdown_connections 2024-04-16T13:05:42.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.464+0000 7fda81a00640 1 -- 172.21.15.67:0/3032291397 wait complete. 2024-04-16T13:05:42.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.710+0000 7f323ba00640 1 Processor -- start 2024-04-16T13:05:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.710+0000 7f323ba00640 1 -- start start 2024-04-16T13:05:42.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f323ba00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 0x7f323406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f323ba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32340cbc10 0x7f32340cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f323ba00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32340b0d80 con 0x7f32340b3b00 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f323ba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f32340b1060 con 0x7f32340cbc10 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f323ba00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f32340b1340 con 0x7f323415ebc0 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f3233e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f32340b3b00 0x7f32340b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41432/0 (socket says 172.21.15.67:41432) 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f3239a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32340cbc10 0x7f32340cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f3233e00640 1 -- 172.21.15.67:0/3750995778 learned_addr learned my addr 172.21.15.67:0/3750995778 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f3239000640 1 --2- 172.21.15.67:0/3750995778 >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 0x7f323406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.712+0000 7f3239a00640 1 -- 172.21.15.67:0/3750995778 >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 msgr2=0x7f323406ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.713+0000 7f3239a00640 1 --2- 172.21.15.67:0/3750995778 >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 0x7f323406ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.713+0000 7f3239a00640 1 -- 172.21.15.67:0/3750995778 >> v1:172.21.15.67:6789/0 conn(0x7f32340b3b00 legacy=0x7f32340b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.713+0000 7f3239a00640 1 -- 172.21.15.67:0/3750995778 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32340b1620 con 0x7f32340cbc10 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.713+0000 7f3233400640 1 -- 172.21.15.67:0/3750995778 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833690263 0 0) 0x7f32340b0d80 con 0x7f32340b3b00 2024-04-16T13:05:42.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.713+0000 7f3239000640 1 --2- 172.21.15.67:0/3750995778 >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 0x7f323406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.714+0000 7f3239a00640 1 --2- 172.21.15.67:0/3750995778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340cc060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3234072ce0 tx=0x7f322c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab14a31703a379f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.714+0000 7f3233400640 1 -- 172.21.15.67:0/3750995778 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c039070 con 0x7f32340cbc10 2024-04-16T13:05:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.714+0000 7f3233400640 1 -- 172.21.15.67:0/3750995778 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c02cc70 con 0x7f32340cbc10 2024-04-16T13:05:42.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.714+0000 7f3233400640 1 -- 172.21.15.67:0/3750995778 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c034660 con 0x7f32340cbc10 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 -- 172.21.15.67:0/3750995778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 msgr2=0x7f32340cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 --2- 172.21.15.67:0/3750995778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340cc060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3234072ce0 tx=0x7f322c02bec0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 -- 172.21.15.67:0/3750995778 shutdown_connections 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 --2- 172.21.15.67:0/3750995778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340cc060 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 --2- 172.21.15.67:0/3750995778 >> v2:172.21.15.82:3300/0 conn(0x7f323415ebc0 0x7f323406ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 -- 172.21.15.67:0/3750995778 >> 172.21.15.67:0/3750995778 conn(0x7f323409aa70 msgr2=0x7f32340b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 -- 172.21.15.67:0/3750995778 shutdown_connections 2024-04-16T13:05:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.715+0000 7f323ba00640 1 -- 172.21.15.67:0/3750995778 wait complete. 2024-04-16T13:05:42.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.717+0000 7f323ba00640 1 Processor -- start 2024-04-16T13:05:42.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.717+0000 7f323ba00640 1 -- start start 2024-04-16T13:05:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32340b3b00 0x7f3234155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f323415ebc0 0x7f32340d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f32340b2250 con 0x7f32340cbc10 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f323406c320 con 0x7f32340b3b00 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f323ba00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f323406bf60 con 0x7f323415ebc0 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f3233e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f3233e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57774/0 (socket says 172.21.15.67:57774) 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f3233e00640 1 -- 172.21.15.67:0/2359358836 learned_addr learned my addr 172.21.15.67:0/2359358836 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f3239000640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32340b3b00 0x7f3234155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.718+0000 7f3239a00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f323415ebc0 0x7f32340d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 -- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f323415ebc0 msgr2=0x7f32340d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f323415ebc0 0x7f32340d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 -- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32340b3b00 msgr2=0x7f3234155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32340b3b00 0x7f3234155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 -- 172.21.15.67:0/2359358836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323409b860 con 0x7f32340cbc10 2024-04-16T13:05:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3233e00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f322000c4b0 tx=0x7f322000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220018070 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3220007500 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220004a20 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.719+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32340b5240 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.720+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32340b5800 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.721+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3234068a70 con 0x7f32340cbc10 2024-04-16T13:05:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.722+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f322001b070 con 0x7f32340cbc10 2024-04-16T13:05:42.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.722+0000 7f3230c00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 0x7f321406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:42.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.723+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f322008b340 con 0x7f32340cbc10 2024-04-16T13:05:42.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.723+0000 7f3239000640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 0x7f321406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:42.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.724+0000 7f3239000640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 0x7f321406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f322400a950 tx=0x7f3224008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:42.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.727+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f323409b860 con 0x7f32340cbc10 2024-04-16T13:05:42.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.930+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3234070620 con 0x7f32340cbc10 2024-04-16T13:05:42.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.931+0000 7f3230c00640 1 -- 172.21.15.67:0/2359358836 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f3220059390 con 0x7f32340cbc10 2024-04-16T13:05:42.933 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:42.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 msgr2=0x7f321406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 0x7f321406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f322400a950 tx=0x7f3224008040 comp rx=0 tx=0).stop 2024-04-16T13:05:42.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 msgr2=0x7f32340b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:42.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f322000c4b0 tx=0x7f322000c970 comp rx=0 tx=0).stop 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 shutdown_connections 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f321406c8f0 0x7f321406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f323415ebc0 0x7f32340d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32340cbc10 0x7f32340b6d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 --2- 172.21.15.67:0/2359358836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32340b3b00 0x7f3234155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 >> 172.21.15.67:0/2359358836 conn(0x7f323409aa70 msgr2=0x7f32340cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 shutdown_connections 2024-04-16T13:05:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:42.934+0000 7f323ba00640 1 -- 172.21.15.67:0/2359358836 wait complete. 2024-04-16T13:05:42.956 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:43.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.180+0000 7f0b29600640 1 Processor -- start 2024-04-16T13:05:43.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.181+0000 7f0b29600640 1 -- start start 2024-04-16T13:05:43.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 0x7f0b2406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b24071de0 0x7f0b24072270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 0x7f0b2415d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2406e7f0 con 0x7f0b24071de0 2024-04-16T13:05:43.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2406dec0 con 0x7f0b240ce990 2024-04-16T13:05:43.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.182+0000 7f0b29600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2406e1a0 con 0x7f0b2415cdc0 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b24071de0 0x7f0b24072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b24071de0 0x7f0b24072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57776/0 (socket says 172.21.15.67:57776) 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 -- 172.21.15.67:0/339964512 learned_addr learned my addr 172.21.15.67:0/339964512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23e00640 1 --2- 172.21.15.67:0/339964512 >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 0x7f0b2406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b28c00640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 0x7f0b2415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 -- 172.21.15.67:0/339964512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 msgr2=0x7f0b2415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 0x7f0b2415d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 -- 172.21.15.67:0/339964512 >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 msgr2=0x7f0b2406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 --2- 172.21.15.67:0/339964512 >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 0x7f0b2406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23400640 1 -- 172.21.15.67:0/339964512 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2406e480 con 0x7f0b24071de0 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b23e00640 1 --2- 172.21.15.67:0/339964512 >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 0x7f0b2406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:43.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.183+0000 7f0b28c00640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 0x7f0b2415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.185+0000 7f0b23400640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b24071de0 0x7f0b24072270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0b2406c570 tx=0x7f0b1002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0626c41d9f2a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.185+0000 7f0b22a00640 1 -- 172.21.15.67:0/339964512 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b100317f0 con 0x7f0b24071de0 2024-04-16T13:05:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.185+0000 7f0b22a00640 1 -- 172.21.15.67:0/339964512 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b10037070 con 0x7f0b24071de0 2024-04-16T13:05:43.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.185+0000 7f0b22a00640 1 -- 172.21.15.67:0/339964512 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10031bb0 con 0x7f0b24071de0 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 -- 172.21.15.67:0/339964512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b24071de0 msgr2=0x7f0b24072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b24071de0 0x7f0b24072270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0b2406c570 tx=0x7f0b1002b890 comp rx=0 tx=0).stop 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 -- 172.21.15.67:0/339964512 shutdown_connections 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b2415cdc0 0x7f0b2415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 --2- 172.21.15.67:0/339964512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b24071de0 0x7f0b24072270 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 --2- 172.21.15.67:0/339964512 >> v2:172.21.15.82:3300/0 conn(0x7f0b240ce990 0x7f0b2406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 -- 172.21.15.67:0/339964512 >> 172.21.15.67:0/339964512 conn(0x7f0b24067d90 msgr2=0x7f0b2406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:43.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 -- 172.21.15.67:0/339964512 shutdown_connections 2024-04-16T13:05:43.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.186+0000 7f0b29600640 1 -- 172.21.15.67:0/339964512 wait complete. 2024-04-16T13:05:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.188+0000 7f0b29600640 1 Processor -- start 2024-04-16T13:05:43.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.188+0000 7f0b29600640 1 -- start start 2024-04-16T13:05:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 0x7f0b240ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b240ce990 0x7f0b24155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2415d790 con 0x7f0b2415cdc0 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2415db10 con 0x7f0b240ce990 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b29600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2415ddc0 con 0x7f0b24071de0 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b28c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b28c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57786/0 (socket says 172.21.15.67:57786) 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.189+0000 7f0b28c00640 1 -- 172.21.15.67:0/1178418510 learned_addr learned my addr 172.21.15.67:0/1178418510 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b23e00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 0x7f0b240ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b23400640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b240ce990 0x7f0b24155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 -- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 msgr2=0x7f0b240ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 0x7f0b240ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 -- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b240ce990 msgr2=0x7f0b24155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b240ce990 0x7f0b24155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 -- 172.21.15.67:0/1178418510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b240aa110 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b23e00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 0x7f0b240ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b28c00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00cd50 tx=0x7f0b1c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.190+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00f680 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.191+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00f840 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.191+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b240aa3f0 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.191+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00fc30 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.191+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b240ae430 con 0x7f0b2415cdc0 2024-04-16T13:05:43.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.192+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b24075bd0 con 0x7f0b2415cdc0 2024-04-16T13:05:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.193+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b1c0213f0 con 0x7f0b2415cdc0 2024-04-16T13:05:43.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.194+0000 7f0b1be00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 0x7f0b0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.194+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0b1c08cd70 con 0x7f0b2415cdc0 2024-04-16T13:05:43.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.194+0000 7f0b23e00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 0x7f0b0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.196+0000 7f0b23e00640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 0x7f0b0406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b140088b0 tx=0x7f0b14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.198+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b1c014030 con 0x7f0b2415cdc0 2024-04-16T13:05:43.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.404+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b240cfd00 con 0x7f0b2415cdc0 2024-04-16T13:05:43.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.405+0000 7f0b1be00640 1 -- 172.21.15.67:0/1178418510 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f0b1c05ad90 con 0x7f0b2415cdc0 2024-04-16T13:05:43.407 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.407+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 msgr2=0x7f0b0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.407+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 0x7f0b0406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b140088b0 tx=0x7f0b14008040 comp rx=0 tx=0).stop 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.407+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 msgr2=0x7f0b240adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.407+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00cd50 tx=0x7f0b1c00a650 comp rx=0 tx=0).stop 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 shutdown_connections 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0b0406c8f0 0x7f0b0406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b2415cdc0 0x7f0b240adef0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b240ce990 0x7f0b24155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 --2- 172.21.15.67:0/1178418510 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0b24071de0 0x7f0b240ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 >> 172.21.15.67:0/1178418510 conn(0x7f0b24067d90 msgr2=0x7f0b241569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 shutdown_connections 2024-04-16T13:05:43.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.408+0000 7f0b29600640 1 -- 172.21.15.67:0/1178418510 wait complete. 2024-04-16T13:05:43.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:43.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.655+0000 7f15c2400640 1 Processor -- start 2024-04-16T13:05:43.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.655+0000 7f15c2400640 1 -- start start 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 0x7f15bc09b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15bc15e210 0x7f15bc15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc09b410 con 0x7f15bc15e210 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc0d1860 con 0x7f15bc0ce730 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.656+0000 7f15c2400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc06d100 con 0x7f15bc09aa70 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15bc15e210 0x7f15bc15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15bc15e210 0x7f15bc15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57798/0 (socket says 172.21.15.67:57798) 2024-04-16T13:05:43.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 -- 172.21.15.67:0/3881398278 learned_addr learned my addr 172.21.15.67:0/3881398278 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1000640 1 --2- 172.21.15.67:0/3881398278 >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 0x7f15bc09b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15bbe00640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 -- 172.21.15.67:0/3881398278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 msgr2=0x7f15bc09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc09aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 -- 172.21.15.67:0/3881398278 >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 msgr2=0x7f15bc09b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 --2- 172.21.15.67:0/3881398278 >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 0x7f15bc09b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1a00640 1 -- 172.21.15.67:0/3881398278 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc0d0c50 con 0x7f15bc15e210 2024-04-16T13:05:43.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.657+0000 7f15c1000640 1 --2- 172.21.15.67:0/3881398278 >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 0x7f15bc09b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.658+0000 7f15c1a00640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc15e210 0x7f15bc15e6a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15bc073430 tx=0x7f15b402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64be144be3562fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.659+0000 7f15bb400640 1 -- 172.21.15.67:0/3881398278 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40317d0 con 0x7f15bc15e210 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.659+0000 7f15bb400640 1 -- 172.21.15.67:0/3881398278 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4037070 con 0x7f15bc15e210 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.659+0000 7f15bb400640 1 -- 172.21.15.67:0/3881398278 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4031b90 con 0x7f15bc15e210 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.659+0000 7f15c2400640 1 -- 172.21.15.67:0/3881398278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc15e210 msgr2=0x7f15bc15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.659+0000 7f15c2400640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc15e210 0x7f15bc15e6a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15bc073430 tx=0x7f15b402b870 comp rx=0 tx=0).stop 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 -- 172.21.15.67:0/3881398278 shutdown_connections 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc15e210 0x7f15bc15e6a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 --2- 172.21.15.67:0/3881398278 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 --2- 172.21.15.67:0/3881398278 >> v2:172.21.15.82:3300/0 conn(0x7f15bc0ce730 0x7f15bc09b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 -- 172.21.15.67:0/3881398278 >> 172.21.15.67:0/3881398278 conn(0x7f15bc0b4090 msgr2=0x7f15bc0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 -- 172.21.15.67:0/3881398278 shutdown_connections 2024-04-16T13:05:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.660+0000 7f15c2400640 1 -- 172.21.15.67:0/3881398278 wait complete. 2024-04-16T13:05:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.661+0000 7f15c2400640 1 Processor -- start 2024-04-16T13:05:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.662+0000 7f15c2400640 1 -- start start 2024-04-16T13:05:43.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc15e210 0x7f15bc0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0d14f0 con 0x7f15bc0ce730 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0d1210 con 0x7f15bc15e210 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c2400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc0d0870 con 0x7f15bc09aa70 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57812/0 (socket says 172.21.15.67:57812) 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 -- 172.21.15.67:0/319161558 learned_addr learned my addr 172.21.15.67:0/319161558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15c1000640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 -- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 msgr2=0x7f15bc156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 -- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc15e210 msgr2=0x7f15bc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc15e210 0x7f15bc0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.663+0000 7f15bbe00640 1 -- 172.21.15.67:0/319161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc0cb580 con 0x7f15bc0ce730 2024-04-16T13:05:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15bbe00640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c820 tx=0x7f15a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4015070 con 0x7f15bc0ce730 2024-04-16T13:05:43.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a4004220 con 0x7f15bc0ce730 2024-04-16T13:05:43.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc0cb860 con 0x7f15bc0ce730 2024-04-16T13:05:43.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400ce10 con 0x7f15bc0ce730 2024-04-16T13:05:43.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.664+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc0cb230 con 0x7f15bc0ce730 2024-04-16T13:05:43.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.665+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc068d00 con 0x7f15bc0ce730 2024-04-16T13:05:43.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.666+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15a4007830 con 0x7f15bc0ce730 2024-04-16T13:05:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.667+0000 7f15b8c00640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 0x7f159806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.667+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f15a408be70 con 0x7f15bc0ce730 2024-04-16T13:05:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.668+0000 7f15c1000640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 0x7f159806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.669+0000 7f15c1000640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 0x7f159806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15ac008f80 tx=0x7f15ac0084d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.672+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15bc068d00 con 0x7f15bc0ce730 2024-04-16T13:05:43.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.876+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f15bc075bd0 con 0x7f15bc0ce730 2024-04-16T13:05:43.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.877+0000 7f15b8c00640 1 -- 172.21.15.67:0/319161558 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f15a4059e10 con 0x7f15bc0ce730 2024-04-16T13:05:43.879 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:43.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 msgr2=0x7f159806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 0x7f159806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15ac008f80 tx=0x7f15ac0084d0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 msgr2=0x7f15bc0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:43.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c820 tx=0x7f15a400cce0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 shutdown_connections 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159806c8f0 0x7f159806edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc15e210 0x7f15bc0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15bc0ce730 0x7f15bc0ca7b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 --2- 172.21.15.67:0/319161558 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f15bc09aa70 0x7f15bc156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 >> 172.21.15.67:0/319161558 conn(0x7f15bc0b4090 msgr2=0x7f15bc0b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 shutdown_connections 2024-04-16T13:05:43.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:43.880+0000 7f15c2400640 1 -- 172.21.15.67:0/319161558 wait complete. 2024-04-16T13:05:43.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:44.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.127+0000 7f17bd000640 1 Processor -- start 2024-04-16T13:05:44.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.128+0000 7f17bd000640 1 -- start start 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17b815c440 0x7f17b815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 0x7f17b80b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b36d0 0x7f17b8143f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f17b815f640 con 0x7f17b815c440 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f17b815f920 con 0x7f17b80b3da0 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.129+0000 7f17bd000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f17b8071cf0 con 0x7f17b80b36d0 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17b815c440 0x7f17b815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17b815c440 0x7f17b815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57820/0 (socket says 172.21.15.67:57820) 2024-04-16T13:05:44.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 -- 172.21.15.67:0/1100466931 learned_addr learned my addr 172.21.15.67:0/1100466931 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7e00640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b36d0 0x7f17b8143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17afe00640 1 --2- 172.21.15.67:0/1100466931 >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 0x7f17b80b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 -- 172.21.15.67:0/1100466931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b36d0 msgr2=0x7f17b8143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b36d0 0x7f17b8143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 -- 172.21.15.67:0/1100466931 >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 msgr2=0x7f17b80b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 --2- 172.21.15.67:0/1100466931 >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 0x7f17b80b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17b7400640 1 -- 172.21.15.67:0/1100466931 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b815fc00 con 0x7f17b815c440 2024-04-16T13:05:44.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.130+0000 7f17afe00640 1 --2- 172.21.15.67:0/1100466931 >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 0x7f17b80b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:44.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.132+0000 7f17b7400640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b815ecf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b5880 tx=0x7f17a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f447bfad53e0bc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.132+0000 7f17b6a00640 1 -- 172.21.15.67:0/1100466931 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a802e070 con 0x7f17b815c440 2024-04-16T13:05:44.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.132+0000 7f17b6a00640 1 -- 172.21.15.67:0/1100466931 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8037070 con 0x7f17b815c440 2024-04-16T13:05:44.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.132+0000 7f17b6a00640 1 -- 172.21.15.67:0/1100466931 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8031a00 con 0x7f17b815c440 2024-04-16T13:05:44.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 -- 172.21.15.67:0/1100466931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 msgr2=0x7f17b815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b815ecf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b5880 tx=0x7f17a802b880 comp rx=0 tx=0).stop 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 -- 172.21.15.67:0/1100466931 shutdown_connections 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b36d0 0x7f17b8143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 --2- 172.21.15.67:0/1100466931 >> v2:172.21.15.82:3300/0 conn(0x7f17b80b3da0 0x7f17b80b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 --2- 172.21.15.67:0/1100466931 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b815ecf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 -- 172.21.15.67:0/1100466931 >> 172.21.15.67:0/1100466931 conn(0x7f17b80d0220 msgr2=0x7f17b80d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 -- 172.21.15.67:0/1100466931 shutdown_connections 2024-04-16T13:05:44.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.133+0000 7f17bd000640 1 -- 172.21.15.67:0/1100466931 wait complete. 2024-04-16T13:05:44.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.136+0000 7f17bd000640 1 Processor -- start 2024-04-16T13:05:44.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.136+0000 7f17bd000640 1 -- start start 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 0x7f17b81618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b3da0 0x7f17b815fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17b8144650 con 0x7f17b815c440 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17b81444d0 con 0x7f17b80b36d0 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.137+0000 7f17bd000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f17b81447d0 con 0x7f17b80b3da0 2024-04-16T13:05:44.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57834/0 (socket says 172.21.15.67:57834) 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 -- 172.21.15.67:0/2649086275 learned_addr learned my addr 172.21.15.67:0/2649086275 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7400640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 0x7f17b81618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 -- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b3da0 msgr2=0x7f17b815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17afe00640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b3da0 0x7f17b815fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b3da0 0x7f17b815fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 -- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 msgr2=0x7f17b81618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 0x7f17b81618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 -- 172.21.15.67:0/2649086275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b8161df0 con 0x7f17b815c440 2024-04-16T13:05:44.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7400640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 0x7f17b81618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.138+0000 7f17b7e00640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17b000ef00 tx=0x7f17b000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.139+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0018020 con 0x7f17b815c440 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.139+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b000bd10 con 0x7f17b815c440 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.139+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0014640 con 0x7f17b815c440 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.139+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b815c930 con 0x7f17b815c440 2024-04-16T13:05:44.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.139+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b815cef0 con 0x7f17b815c440 2024-04-16T13:05:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.140+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b8075bd0 con 0x7f17b815c440 2024-04-16T13:05:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.141+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17b0005d10 con 0x7f17b815c440 2024-04-16T13:05:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.142+0000 7f17af400640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.142+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f17b008c5b0 con 0x7f17b815c440 2024-04-16T13:05:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.143+0000 7f17b7400640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.144+0000 7f17b7400640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 0x7f179406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17a8036000 tx=0x7f17a8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.147+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17b0022070 con 0x7f17b815c440 2024-04-16T13:05:44.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.355+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17b815a560 con 0x7f17b815c440 2024-04-16T13:05:44.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.357+0000 7f17af400640 1 -- 172.21.15.67:0/2649086275 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f17b005a5d0 con 0x7f17b815c440 2024-04-16T13:05:44.359 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:44.360 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:44.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 msgr2=0x7f179406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 0x7f179406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17a8036000 tx=0x7f17a8008030 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 msgr2=0x7f17b81603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f17b000ef00 tx=0x7f17b000b480 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 shutdown_connections 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17b815c440 0x7f17b81603d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17b80b3da0 0x7f17b815fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 --2- 172.21.15.67:0/2649086275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17b80b36d0 0x7f17b81618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 >> 172.21.15.67:0/2649086275 conn(0x7f17b80d0220 msgr2=0x7f17b81515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 shutdown_connections 2024-04-16T13:05:44.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.360+0000 7f17bd000640 1 -- 172.21.15.67:0/2649086275 wait complete. 2024-04-16T13:05:44.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:44.381 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:44.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.601+0000 7f8eb6e00640 1 Processor -- start 2024-04-16T13:05:44.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.602+0000 7f8eb6e00640 1 -- start start 2024-04-16T13:05:44.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8eb0072b40 0x7f8eb006f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8eb015f170 0x7f8eb015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb015fe30 con 0x7f8eb015b4e0 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb0160110 con 0x7f8eb015f170 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb006ee70 con 0x7f8eb0072b40 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8eb015f170 0x7f8eb015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8eb015f170 0x7f8eb015f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57840/0 (socket says 172.21.15.67:57840) 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.603+0000 7f8eb6400640 1 -- 172.21.15.67:0/3130827749 learned_addr learned my addr 172.21.15.67:0/3130827749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.604+0000 7f8eb5000640 1 --2- 172.21.15.67:0/3130827749 >> v2:172.21.15.82:3300/0 conn(0x7f8eb0072b40 0x7f8eb006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.604+0000 7f8eb6400640 1 -- 172.21.15.67:0/3130827749 >> v2:172.21.15.82:3300/0 conn(0x7f8eb0072b40 msgr2=0x7f8eb006f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:44.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.604+0000 7f8eb6400640 1 --2- 172.21.15.67:0/3130827749 >> v2:172.21.15.82:3300/0 conn(0x7f8eb0072b40 0x7f8eb006f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.604+0000 7f8eb6400640 1 -- 172.21.15.67:0/3130827749 >> v1:172.21.15.82:6789/0 conn(0x7f8eb015b4e0 legacy=0x7f8eb0072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:44.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.604+0000 7f8eb6400640 1 -- 172.21.15.67:0/3130827749 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb006f150 con 0x7f8eb015f170 2024-04-16T13:05:44.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.605+0000 7f8eb6400640 1 --2- 172.21.15.67:0/3130827749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb015f170 0x7f8eb015f5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0160290 tx=0x7f8ea802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786bca6af7bf07b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.605+0000 7f8eafe00640 1 -- 172.21.15.67:0/3130827749 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea802e070 con 0x7f8eb015f170 2024-04-16T13:05:44.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.605+0000 7f8eafe00640 1 -- 172.21.15.67:0/3130827749 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8037070 con 0x7f8eb015f170 2024-04-16T13:05:44.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.605+0000 7f8eafe00640 1 -- 172.21.15.67:0/3130827749 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8031a00 con 0x7f8eb015f170 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 -- 172.21.15.67:0/3130827749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb015f170 msgr2=0x7f8eb015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/3130827749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb015f170 0x7f8eb015f5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0160290 tx=0x7f8ea802b880 comp rx=0 tx=0).stop 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 -- 172.21.15.67:0/3130827749 shutdown_connections 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/3130827749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb015f170 0x7f8eb015f5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/3130827749 >> v2:172.21.15.82:3300/0 conn(0x7f8eb0072b40 0x7f8eb006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 -- 172.21.15.67:0/3130827749 >> 172.21.15.67:0/3130827749 conn(0x7f8eb006be40 msgr2=0x7f8eb006c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 -- 172.21.15.67:0/3130827749 shutdown_connections 2024-04-16T13:05:44.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.606+0000 7f8eb6e00640 1 -- 172.21.15.67:0/3130827749 wait complete. 2024-04-16T13:05:44.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.608+0000 7f8eb6e00640 1 Processor -- start 2024-04-16T13:05:44.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.608+0000 7f8eb6e00640 1 -- start start 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb015b4e0 0x7f8eb00b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 0x7f8eb015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb015b8c0 con 0x7f8eb0072b40 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb015fae0 con 0x7f8eb015f170 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb6e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb015ba40 con 0x7f8eb015b4e0 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.609+0000 7f8eb5a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57846/0 (socket says 172.21.15.67:57846) 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 -- 172.21.15.67:0/2046620116 learned_addr learned my addr 172.21.15.67:0/2046620116 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5000640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb015b4e0 0x7f8eb00b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 -- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb015b4e0 msgr2=0x7f8eb00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb015b4e0 0x7f8eb00b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb6400640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 0x7f8eb015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 -- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 msgr2=0x7f8eb015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 0x7f8eb015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 -- 172.21.15.67:0/2046620116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb00b43c0 con 0x7f8eb0072b40 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb6400640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 0x7f8eb015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.610+0000 7f8eb5a00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c460 tx=0x7f8ea000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.611+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0016020 con 0x7f8eb0072b40 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.611+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0012870 con 0x7f8eb0072b40 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.611+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0012c60 con 0x7f8eb0072b40 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.611+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb00b46a0 con 0x7f8eb0072b40 2024-04-16T13:05:44.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.611+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb00b4c60 con 0x7f8eb0072b40 2024-04-16T13:05:44.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.612+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb0075bd0 con 0x7f8eb0072b40 2024-04-16T13:05:44.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.613+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ea0019020 con 0x7f8eb0072b40 2024-04-16T13:05:44.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.614+0000 7f8ead600640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 0x7f8e9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:44.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.614+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8ea008bfe0 con 0x7f8eb0072b40 2024-04-16T13:05:44.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.614+0000 7f8eb5000640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 0x7f8e9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:44.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.616+0000 7f8eb5000640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 0x7f8e9006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00b1860 tx=0x7f8e9c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:44.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.618+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ea0020020 con 0x7f8eb0072b40 2024-04-16T13:05:44.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.817+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8eb006e610 con 0x7f8eb0072b40 2024-04-16T13:05:44.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.818+0000 7f8ead600640 1 -- 172.21.15.67:0/2046620116 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f8ea00182c0 con 0x7f8eb0072b40 2024-04-16T13:05:44.820 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 msgr2=0x7f8e9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 0x7f8e9006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00b1860 tx=0x7f8e9c00b040 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 msgr2=0x7f8eb01410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c460 tx=0x7f8ea000c920 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 shutdown_connections 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8e9006c8f0 0x7f8e9006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb015f170 0x7f8eb015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8eb015b4e0 0x7f8eb00b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 --2- 172.21.15.67:0/2046620116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8eb0072b40 0x7f8eb01410b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:44.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 >> 172.21.15.67:0/2046620116 conn(0x7f8eb006be40 msgr2=0x7f8eb01577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 shutdown_connections 2024-04-16T13:05:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:44.820+0000 7f8eb6e00640 1 -- 172.21.15.67:0/2046620116 wait complete. 2024-04-16T13:05:44.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:45.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.050+0000 7fe239400640 1 Processor -- start 2024-04-16T13:05:45.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.050+0000 7fe239400640 1 -- start start 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe239400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe2340b4710 0x7fe23415f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe239400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe234160240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe239400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23406c120 con 0x7fe234159090 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe239400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fe23406c400 con 0x7fe2340b4710 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe239400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe23406c6e0 con 0x7fe23406ba20 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe232800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe234159090 0x7fe2340b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41440/0 (socket says 172.21.15.67:41440) 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.052+0000 7fe232800640 1 -- 172.21.15.67:0/3519792267 learned_addr learned my addr 172.21.15.67:0/3519792267 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe233200640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe234160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231e00640 1 --2- 172.21.15.67:0/3519792267 >> v2:172.21.15.82:3300/0 conn(0x7fe2340b4710 0x7fe23415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747692549 0 0) 0x7fe23406c120 con 0x7fe234159090 2024-04-16T13:05:45.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe214003520 con 0x7fe234159090 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4260672796 0 0) 0x7fe214003520 con 0x7fe234159090 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 msgr2=0x7fe234160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe234160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 >> v2:172.21.15.82:3300/0 conn(0x7fe2340b4710 msgr2=0x7fe23415f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 --2- 172.21.15.67:0/3519792267 >> v2:172.21.15.82:3300/0 conn(0x7fe2340b4710 0x7fe23415f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23406c9c0 con 0x7fe234159090 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fe224001690 con 0x7fe234159090 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 >> v1:172.21.15.67:6789/0 conn(0x7fe234159090 legacy=0x7fe2340b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe2140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe214003f30 0x7fe214004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe23406c400 con 0x7fe214004d40 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe23406c6e0 con 0x7fe214003f30 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.053+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe21400b9c0 con 0x7fe23406ba20 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe232800640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe2140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe231e00640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe214003f30 0x7fe214004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 -- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 msgr2=0x7fe2140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe2140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 -- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe214003f30 msgr2=0x7fe214004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe214003f30 0x7fe214004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe233200640 1 -- 172.21.15.67:0/3519792267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe214003520 con 0x7fe214004d40 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe232800640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe23406ba20 0x7fe2140039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.054+0000 7fe231e00640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe214003f30 0x7fe214004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.055+0000 7fe233200640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009ac0 tx=0x7fe214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f56775f8e7135 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.055+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c039070 con 0x7fe214004d40 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c02c6b0 con 0x7fe214004d40 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe231400640 1 -- 172.21.15.67:0/3519792267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c009690 con 0x7fe214004d40 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 -- 172.21.15.67:0/3519792267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe214004d40 msgr2=0x7fe2140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 --2- 172.21.15.67:0/3519792267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe214004d40 0x7fe2140051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009ac0 tx=0x7fe214005830 comp rx=0 tx=0).stop 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe233200640 1 -- 172.21.15.67:0/3519792267 reap_dead start 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 -- 172.21.15.67:0/3519792267 shutdown_connections 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 -- 172.21.15.67:0/3519792267 >> 172.21.15.67:0/3519792267 conn(0x7fe2340b3500 msgr2=0x7fe2340d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 -- 172.21.15.67:0/3519792267 shutdown_connections 2024-04-16T13:05:45.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.056+0000 7fe239400640 1 -- 172.21.15.67:0/3519792267 wait complete. 2024-04-16T13:05:45.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.058+0000 7fe239400640 1 Processor -- start 2024-04-16T13:05:45.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.058+0000 7fe239400640 1 -- start start 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe234153d90 0x7fe234156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 0x7fe2341460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2340b4d60 con 0x7fe234143990 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe23406be40 con 0x7fe234153d90 2024-04-16T13:05:45.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe239400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe234159470 con 0x7fe234156e60 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.059+0000 7fe232800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57872/0 (socket says 172.21.15.67:57872) 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 -- 172.21.15.67:0/2626882239 learned_addr learned my addr 172.21.15.67:0/2626882239 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe231e00640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe234153d90 0x7fe234156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe233200640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 0x7fe2341460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 -- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 msgr2=0x7fe2341460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 0x7fe2341460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 -- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe234153d90 msgr2=0x7fe234156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe234153d90 0x7fe234156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 -- 172.21.15.67:0/2626882239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe234157f90 con 0x7fe234143990 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe233200640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 0x7fe2341460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.060+0000 7fe232800640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe22400db10 tx=0x7fe224007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.061+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224019070 con 0x7fe234143990 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.061+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe224004cb0 con 0x7fe234143990 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.061+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224004e60 con 0x7fe234143990 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.061+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe234143d70 con 0x7fe234143990 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.061+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341579d0 con 0x7fe234143990 2024-04-16T13:05:45.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.062+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2341596e0 con 0x7fe234143990 2024-04-16T13:05:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.063+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe22401c070 con 0x7fe234143990 2024-04-16T13:05:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.064+0000 7fe22aa00640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 0x7fe21006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.064+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe22408bb00 con 0x7fe234143990 2024-04-16T13:05:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.065+0000 7fe231e00640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 0x7fe21006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.066+0000 7fe231e00640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 0x7fe21006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fd0 tx=0x7fe21c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.069+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe224059b30 con 0x7fe234143990 2024-04-16T13:05:45.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.264+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe234068a70 con 0x7fe234143990 2024-04-16T13:05:45.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.265+0000 7fe22aa00640 1 -- 172.21.15.67:0/2626882239 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fe224059430 con 0x7fe234143990 2024-04-16T13:05:45.267 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:45.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 msgr2=0x7fe21006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 0x7fe21006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fd0 tx=0x7fe21c00b040 comp rx=0 tx=0).stop 2024-04-16T13:05:45.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 msgr2=0x7fe234153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe22400db10 tx=0x7fe224007e50 comp rx=0 tx=0).stop 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 shutdown_connections 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fe21006c920 0x7fe21006ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe234156e60 0x7fe2341460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe234153d90 0x7fe234156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 --2- 172.21.15.67:0/2626882239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe234143990 0x7fe234153850 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 >> 172.21.15.67:0/2626882239 conn(0x7fe2340b3500 msgr2=0x7fe2340af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:45.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.267+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 shutdown_connections 2024-04-16T13:05:45.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.268+0000 7fe239400640 1 -- 172.21.15.67:0/2626882239 wait complete. 2024-04-16T13:05:45.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:45.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.502+0000 7fb0c3200640 1 Processor -- start 2024-04-16T13:05:45.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.503+0000 7fb0c3200640 1 -- start start 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.504+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 0x7fb0c40cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.504+0000 7fb0c3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.504+0000 7fb0c3200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c40d04d0 con 0x7fb0c40d4270 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.504+0000 7fb0c3200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c40b6e10 con 0x7fb0c40b7e70 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.504+0000 7fb0c3200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c40b6200 con 0x7fb0c415eca0 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57880/0 (socket says 172.21.15.67:57880) 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 -- 172.21.15.67:0/2460107089 learned_addr learned my addr 172.21.15.67:0/2460107089 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0c1e00640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 0x7fb0c40cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 -- 172.21.15.67:0/2460107089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 msgr2=0x7fb0c40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 0x7fb0c40cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 -- 172.21.15.67:0/2460107089 >> v1:172.21.15.67:6789/0 conn(0x7fb0c40d4270 legacy=0x7fb0c40d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0bbe00640 1 -- 172.21.15.67:0/2460107089 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c40b64e0 con 0x7fb0c40b7e70 2024-04-16T13:05:45.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.505+0000 7fb0c1e00640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 0x7fb0c40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.506+0000 7fb0bbe00640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40b6f90 tx=0x7fb0ac02b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b347f5f3a5ab77f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c1400640 1 -- 172.21.15.67:0/2460107089 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac034070 con 0x7fb0c40b7e70 2024-04-16T13:05:45.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c1400640 1 -- 172.21.15.67:0/2460107089 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac030830 con 0x7fb0c40b7e70 2024-04-16T13:05:45.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c1400640 1 -- 172.21.15.67:0/2460107089 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac030c00 con 0x7fb0c40b7e70 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 -- 172.21.15.67:0/2460107089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40b7e70 msgr2=0x7fb0c40d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40b6f90 tx=0x7fb0ac02b970 comp rx=0 tx=0).stop 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 -- 172.21.15.67:0/2460107089 shutdown_connections 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40b7e70 0x7fb0c40d0ed0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 --2- 172.21.15.67:0/2460107089 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c415eca0 0x7fb0c40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 -- 172.21.15.67:0/2460107089 >> 172.21.15.67:0/2460107089 conn(0x7fb0c406ccc0 msgr2=0x7fb0c406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.507+0000 7fb0c3200640 1 -- 172.21.15.67:0/2460107089 shutdown_connections 2024-04-16T13:05:45.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.508+0000 7fb0c3200640 1 -- 172.21.15.67:0/2460107089 wait complete. 2024-04-16T13:05:45.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.509+0000 7fb0c3200640 1 Processor -- start 2024-04-16T13:05:45.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.509+0000 7fb0c3200640 1 -- start start 2024-04-16T13:05:45.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c40b7e70 0x7fb0c40c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c415eca0 0x7fb0c4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c415f080 con 0x7fb0c40d4270 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c40b6aa0 con 0x7fb0c415eca0 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.510+0000 7fb0c3200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c415f200 con 0x7fb0c40b7e70 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57894/0 (socket says 172.21.15.67:57894) 2024-04-16T13:05:45.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 -- 172.21.15.67:0/85160124 learned_addr learned my addr 172.21.15.67:0/85160124 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 -- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c40b7e70 msgr2=0x7fb0c40c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c40b7e70 0x7fb0c40c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 -- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c415eca0 msgr2=0x7fb0c4151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c415eca0 0x7fb0c4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 -- 172.21.15.67:0/85160124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c415fba0 con 0x7fb0c40d4270 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.511+0000 7fb0bbe00640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac02b9b0 tx=0x7fb0ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.512+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac048070 con 0x7fb0c40d4270 2024-04-16T13:05:45.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.512+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac039860 con 0x7fb0c40d4270 2024-04-16T13:05:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.512+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c415fe20 con 0x7fb0c40d4270 2024-04-16T13:05:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.512+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac034040 con 0x7fb0c40d4270 2024-04-16T13:05:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.512+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c41603e0 con 0x7fb0c40d4270 2024-04-16T13:05:45.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.513+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c4075bd0 con 0x7fb0c40d4270 2024-04-16T13:05:45.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.514+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0ac04b070 con 0x7fb0c40d4270 2024-04-16T13:05:45.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.515+0000 7fb0ba000640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 0x7fb0a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.515+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb0ac0adbe0 con 0x7fb0c40d4270 2024-04-16T13:05:45.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.516+0000 7fb0c1e00640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 0x7fb0a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.517+0000 7fb0c1e00640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 0x7fb0a006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006fd0 tx=0x7fb0b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.520+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0c415fba0 con 0x7fb0c40d4270 2024-04-16T13:05:45.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.728+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb0c40ca8d0 con 0x7fb0c40d4270 2024-04-16T13:05:45.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.729+0000 7fb0ba000640 1 -- 172.21.15.67:0/85160124 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb0ac07bca0 con 0x7fb0c40d4270 2024-04-16T13:05:45.731 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:45.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 msgr2=0x7fb0a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 0x7fb0a006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006fd0 tx=0x7fb0b4008040 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 msgr2=0x7fb0c41f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac02b9b0 tx=0x7fb0ac004730 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 shutdown_connections 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb0a006c8f0 0x7fb0a006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c415eca0 0x7fb0c4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c40d4270 0x7fb0c41f2ba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 --2- 172.21.15.67:0/85160124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0c40b7e70 0x7fb0c40c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.731+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 >> 172.21.15.67:0/85160124 conn(0x7fb0c406ccc0 msgr2=0x7fb0c40cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.732+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 shutdown_connections 2024-04-16T13:05:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.732+0000 7fb0c3200640 1 -- 172.21.15.67:0/85160124 wait complete. 2024-04-16T13:05:45.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:45.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.948+0000 7f2662800640 1 Processor -- start 2024-04-16T13:05:45.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.949+0000 7f2662800640 1 -- start start 2024-04-16T13:05:45.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f2662800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f265c15ed00 0x7f265c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f2662800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 0x7f265c06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f2662800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f265c06bc70 con 0x7f265c1600b0 2024-04-16T13:05:45.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f2662800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f265c06d3c0 con 0x7f265c15ed00 2024-04-16T13:05:45.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f2662800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f265c06ba20 con 0x7f265c06ca30 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f265b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f265c15ed00 0x7f265c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f265b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f265c15ed00 0x7f265c0d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57910/0 (socket says 172.21.15.67:57910) 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.950+0000 7f265b400640 1 -- 172.21.15.67:0/622020134 learned_addr learned my addr 172.21.15.67:0/622020134 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265be00640 1 --2- 172.21.15.67:0/622020134 >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 0x7f265c06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265b400640 1 -- 172.21.15.67:0/622020134 >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 msgr2=0x7f265c06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265b400640 1 --2- 172.21.15.67:0/622020134 >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 0x7f265c06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265b400640 1 -- 172.21.15.67:0/622020134 >> v1:172.21.15.82:6789/0 conn(0x7f265c1600b0 legacy=0x7f265c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:45.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265b400640 1 -- 172.21.15.67:0/622020134 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265c06bf50 con 0x7f265c15ed00 2024-04-16T13:05:45.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.951+0000 7f265be00640 1 --2- 172.21.15.67:0/622020134 >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 0x7f265c06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.952+0000 7f265b400640 1 --2- 172.21.15.67:0/622020134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c15ed00 0x7f265c0d03b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f265c0d1cd0 tx=0x7f264c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecdd86add40033d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.952+0000 7f265a000640 1 -- 172.21.15.67:0/622020134 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c035020 con 0x7f265c15ed00 2024-04-16T13:05:45.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.952+0000 7f265a000640 1 -- 172.21.15.67:0/622020134 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c031870 con 0x7f265c15ed00 2024-04-16T13:05:45.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.952+0000 7f265a000640 1 -- 172.21.15.67:0/622020134 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c031c40 con 0x7f265c15ed00 2024-04-16T13:05:45.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.953+0000 7f2662800640 1 -- 172.21.15.67:0/622020134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c15ed00 msgr2=0x7f265c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.953+0000 7f2662800640 1 --2- 172.21.15.67:0/622020134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c15ed00 0x7f265c0d03b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f265c0d1cd0 tx=0x7f264c02b910 comp rx=0 tx=0).stop 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 -- 172.21.15.67:0/622020134 shutdown_connections 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 --2- 172.21.15.67:0/622020134 >> v2:172.21.15.82:3300/0 conn(0x7f265c06ca30 0x7f265c06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 --2- 172.21.15.67:0/622020134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c15ed00 0x7f265c0d03b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 -- 172.21.15.67:0/622020134 >> 172.21.15.67:0/622020134 conn(0x7f265c0d0d80 msgr2=0x7f265c0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 -- 172.21.15.67:0/622020134 shutdown_connections 2024-04-16T13:05:45.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.954+0000 7f2662800640 1 -- 172.21.15.67:0/622020134 wait complete. 2024-04-16T13:05:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.956+0000 7f2662800640 1 Processor -- start 2024-04-16T13:05:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.956+0000 7f2662800640 1 -- start start 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 0x7f265c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f265c15ed00 0x7f265c09e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f265c15f0e0 con 0x7f265c1600b0 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f265c06c510 con 0x7f265c15ed00 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f2662800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f265c0d08f0 con 0x7f265c06ca30 2024-04-16T13:05:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f265be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f265be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57924/0 (socket says 172.21.15.67:57924) 2024-04-16T13:05:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.957+0000 7f265be00640 1 -- 172.21.15.67:0/2163079581 learned_addr learned my addr 172.21.15.67:0/2163079581 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265b400640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 0x7f265c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 -- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 msgr2=0x7f265c0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 0x7f265c0af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 -- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f265c15ed00 msgr2=0x7f265c09e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f265c15ed00 0x7f265c09e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 -- 172.21.15.67:0/2163079581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265c0af850 con 0x7f265c1600b0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265b400640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 0x7f265c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f265be00640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f265400cef0 tx=0x7f265400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265401a070 con 0x7f265c1600b0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265400d860 con 0x7f265c1600b0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265400dc50 con 0x7f265c1600b0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.958+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265c0ae270 con 0x7f265c1600b0 2024-04-16T13:05:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.959+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f265c0ae830 con 0x7f265c1600b0 2024-04-16T13:05:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.960+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f265c075170 con 0x7f265c1600b0 2024-04-16T13:05:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.961+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f265401d070 con 0x7f265c1600b0 2024-04-16T13:05:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.962+0000 7f2653400640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 0x7f263c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.962+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f265408c880 con 0x7f265c1600b0 2024-04-16T13:05:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.962+0000 7f265b400640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 0x7f263c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.964+0000 7f265b400640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 0x7f263c06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f264c036000 tx=0x7f264c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:45.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:45.966+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f265405a8d0 con 0x7f265c1600b0 2024-04-16T13:05:46.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.176+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f265c0727b0 con 0x7f265c1600b0 2024-04-16T13:05:46.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.177+0000 7f2653400640 1 -- 172.21.15.67:0/2163079581 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f265405a1d0 con 0x7f265c1600b0 2024-04-16T13:05:46.179 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.179+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 msgr2=0x7f263c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.179+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 0x7f263c06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f264c036000 tx=0x7f264c008030 comp rx=0 tx=0).stop 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.179+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 msgr2=0x7f265c156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.179+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f265400cef0 tx=0x7f265400a710 comp rx=0 tx=0).stop 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 shutdown_connections 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f263c06c920 0x7f263c06ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f265c1600b0 0x7f265c156810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f265c15ed00 0x7f265c09e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 --2- 172.21.15.67:0/2163079581 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f265c06ca30 0x7f265c0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 >> 172.21.15.67:0/2163079581 conn(0x7f265c0d0d80 msgr2=0x7f265c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:46.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 shutdown_connections 2024-04-16T13:05:46.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.180+0000 7f2662800640 1 -- 172.21.15.67:0/2163079581 wait complete. 2024-04-16T13:05:46.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:46.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.394+0000 7f46d8a00640 1 Processor -- start 2024-04-16T13:05:46.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.394+0000 7f46d8a00640 1 -- start start 2024-04-16T13:05:46.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46d406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d40d05a0 con 0x7f46d415e6b0 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d8a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d406ceb0 con 0x7f46d406d8a0 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40d1b40 con 0x7f46d415ea90 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d2800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f46d415e6b0 0x7f46d40cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41450/0 (socket says 172.21.15.67:41450) 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.396+0000 7f46d2800640 1 -- 172.21.15.67:0/2291529971 learned_addr learned my addr 172.21.15.67:0/2291529971 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854244371 0 0) 0x7f46d40d05a0 con 0x7f46d415e6b0 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46c9e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46d406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b8003520 con 0x7f46d415e6b0 2024-04-16T13:05:46.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4258636945 0 0) 0x7f46b8003520 con 0x7f46d415e6b0 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 msgr2=0x7f46d406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46d406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 >> v1:172.21.15.82:6789/0 conn(0x7f46d406d8a0 legacy=0x7f46d40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d40cf3b0 con 0x7f46d415e6b0 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f46c4001b70 con 0x7f46d415e6b0 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 >> v1:172.21.15.67:6789/0 conn(0x7f46d415e6b0 legacy=0x7f46d40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b80039e0 0x7f46b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b8004d40 0x7f46b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d1b40 con 0x7f46b8004d40 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46b800bba0 con 0x7f46b80039e0 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.397+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46b800bda0 con 0x7f46d415ea90 2024-04-16T13:05:46.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b8004d40 0x7f46b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46c9e00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d2800640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b80039e0 0x7f46b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 -- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 msgr2=0x7f46b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46d415ea90 0x7f46b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 -- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b80039e0 msgr2=0x7f46b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b80039e0 0x7f46b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.398+0000 7f46d3200640 1 -- 172.21.15.67:0/2291529971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b8003520 con 0x7f46b8004d40 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.400+0000 7f46d3200640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b8004d40 0x7f46b80051c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f46cc001750 tx=0x7f46b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf3be3db8cfecb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.400+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc001370 con 0x7f46b8004d40 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.400+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc0052d0 con 0x7f46b8004d40 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.400+0000 7f46d1e00640 1 -- 172.21.15.67:0/2291529971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc003830 con 0x7f46b8004d40 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 -- 172.21.15.67:0/2291529971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b8004d40 msgr2=0x7f46b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 --2- 172.21.15.67:0/2291529971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46b8004d40 0x7f46b80051c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f46cc001750 tx=0x7f46b8005830 comp rx=0 tx=0).stop 2024-04-16T13:05:46.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d3200640 1 -- 172.21.15.67:0/2291529971 reap_dead start 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 -- 172.21.15.67:0/2291529971 shutdown_connections 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 -- 172.21.15.67:0/2291529971 >> 172.21.15.67:0/2291529971 conn(0x7f46d409d950 msgr2=0x7f46d408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 -- 172.21.15.67:0/2291529971 shutdown_connections 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.401+0000 7f46d8a00640 1 -- 172.21.15.67:0/2291529971 wait complete. 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.402+0000 7f46d8a00640 1 Processor -- start 2024-04-16T13:05:46.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 -- start start 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46b8004d40 0x7f46d40b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d4161760 0x7f46d40b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d1e20 con 0x7f46d41612e0 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40cf970 con 0x7f46d4161760 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.403+0000 7f46d8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40d16e0 con 0x7f46b8004d40 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57936/0 (socket says 172.21.15.67:57936) 2024-04-16T13:05:46.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 -- 172.21.15.67:0/3748156987 learned_addr learned my addr 172.21.15.67:0/3748156987 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:46.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46d2800640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46b8004d40 0x7f46d40b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 -- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46b8004d40 msgr2=0x7f46d40b9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46b8004d40 0x7f46d40b9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 -- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d4161760 msgr2=0x7f46d40b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46d3200640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d4161760 0x7f46d40b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d4161760 0x7f46d40b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.404+0000 7f46c9e00640 1 -- 172.21.15.67:0/3748156987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d40b9f40 con 0x7f46d41612e0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46c9e00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00f530 tx=0x7f46bc00f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc018020 con 0x7f46d41612e0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46bc005da0 con 0x7f46d41612e0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc006270 con 0x7f46d41612e0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d40b7d20 con 0x7f46d41612e0 2024-04-16T13:05:46.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.405+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d40b8f20 con 0x7f46d41612e0 2024-04-16T13:05:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.406+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d40b8d40 con 0x7f46d41612e0 2024-04-16T13:05:46.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.407+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46bc01b020 con 0x7f46d41612e0 2024-04-16T13:05:46.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.408+0000 7f46cb400640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 0x7f46b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.408+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f46bc08c340 con 0x7f46d41612e0 2024-04-16T13:05:46.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.409+0000 7f46d2800640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 0x7f46b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.410+0000 7f46d2800640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 0x7f46b006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f46c4002230 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.413+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46d40b8d40 con 0x7f46d41612e0 2024-04-16T13:05:46.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.609+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46d40ba540 con 0x7f46d41612e0 2024-04-16T13:05:46.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.611+0000 7f46cb400640 1 -- 172.21.15.67:0/3748156987 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f46bc060020 con 0x7f46d41612e0 2024-04-16T13:05:46.614 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:46.614 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:46.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 msgr2=0x7f46b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 0x7f46b006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f46c4002230 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 msgr2=0x7f46d40b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00f530 tx=0x7f46bc00f9f0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 shutdown_connections 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f46b006c8f0 0x7f46b006edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46d4161760 0x7f46d40b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46d41612e0 0x7f46d40b72a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 --2- 172.21.15.67:0/3748156987 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f46b8004d40 0x7f46d40b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 >> 172.21.15.67:0/3748156987 conn(0x7f46d409d950 msgr2=0x7f46d40d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 shutdown_connections 2024-04-16T13:05:46.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.614+0000 7f46d8a00640 1 -- 172.21.15.67:0/3748156987 wait complete. 2024-04-16T13:05:46.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:46.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:46.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.840+0000 7fb56e800640 1 Processor -- start 2024-04-16T13:05:46.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.840+0000 7fb56e800640 1 -- start start 2024-04-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.841+0000 7fb56e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5680d21c0 0x7fb5680d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.841+0000 7fb56e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.841+0000 7fb56e800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5680d0660 con 0x7fb56815e650 2024-04-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.841+0000 7fb56e800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb5680d2650 con 0x7fb5680d21c0 2024-04-16T13:05:46.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.841+0000 7fb56e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb5680d2930 con 0x7fb56815ea30 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5680d21c0 0x7fb5680d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb5680d21c0 0x7fb5680d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57938/0 (socket says 172.21.15.67:57938) 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 -- 172.21.15.67:0/3854203906 learned_addr learned my addr 172.21.15.67:0/3854203906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56de00640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 -- 172.21.15.67:0/3854203906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 msgr2=0x7fb5680d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 -- 172.21.15.67:0/3854203906 >> v1:172.21.15.82:6789/0 conn(0x7fb56815e650 legacy=0x7fb5680cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.842+0000 7fb56ca00640 1 -- 172.21.15.67:0/3854203906 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5680d2c10 con 0x7fb5680d21c0 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.843+0000 7fb56ca00640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5680d21c0 0x7fb5680d0f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb554009850 tx=0x7fb55402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d8f6facb1beacc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb567e00640 1 -- 172.21.15.67:0/3854203906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554004230 con 0x7fb5680d21c0 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb567e00640 1 -- 172.21.15.67:0/3854203906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5540043d0 con 0x7fb5680d21c0 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb567e00640 1 -- 172.21.15.67:0/3854203906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554003810 con 0x7fb5680d21c0 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 -- 172.21.15.67:0/3854203906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5680d21c0 msgr2=0x7fb5680d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5680d21c0 0x7fb5680d0f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb554009850 tx=0x7fb55402b960 comp rx=0 tx=0).stop 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 -- 172.21.15.67:0/3854203906 shutdown_connections 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 --2- 172.21.15.67:0/3854203906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5680d21c0 0x7fb5680d0f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 -- 172.21.15.67:0/3854203906 >> 172.21.15.67:0/3854203906 conn(0x7fb56808c000 msgr2=0x7fb5680d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 -- 172.21.15.67:0/3854203906 shutdown_connections 2024-04-16T13:05:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.844+0000 7fb56e800640 1 -- 172.21.15.67:0/3854203906 wait complete. 2024-04-16T13:05:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.846+0000 7fb56e800640 1 Processor -- start 2024-04-16T13:05:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.846+0000 7fb56e800640 1 -- start start 2024-04-16T13:05:46.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5680b18c0 0x7fb56815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5680d36f0 con 0x7fb56815e650 2024-04-16T13:05:46.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb5680d31d0 con 0x7fb5680b18c0 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb5681686d0 con 0x7fb56815ea30 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57948/0 (socket says 172.21.15.67:57948) 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56d400640 1 -- 172.21.15.67:0/329945798 learned_addr learned my addr 172.21.15.67:0/329945798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56ca00640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.847+0000 7fb56d400640 1 -- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 msgr2=0x7fb5680b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56d400640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56d400640 1 -- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5680b18c0 msgr2=0x7fb56815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56d400640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5680b18c0 0x7fb56815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56d400640 1 -- 172.21.15.67:0/329945798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb568155de0 con 0x7fb56815e650 2024-04-16T13:05:46.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56d400640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c450 tx=0x7fb56000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5600052d0 con 0x7fb56815e650 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560005470 con 0x7fb56815e650 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560012870 con 0x7fb56815e650 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56815ff70 con 0x7fb56815e650 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.848+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb568160530 con 0x7fb56815e650 2024-04-16T13:05:46.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.849+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb568075bd0 con 0x7fb56815e650 2024-04-16T13:05:46.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.850+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb560012a10 con 0x7fb56815e650 2024-04-16T13:05:46.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.851+0000 7fb565600640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 0x7fb54806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:46.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.851+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb56008bb60 con 0x7fb56815e650 2024-04-16T13:05:46.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.852+0000 7fb56ca00640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 0x7fb54806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:46.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.853+0000 7fb56ca00640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 0x7fb54806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb554035000 tx=0x7fb554008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:46.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:46.856+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb560059b80 con 0x7fb56815e650 2024-04-16T13:05:47.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.050+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5680b4990 con 0x7fb56815e650 2024-04-16T13:05:47.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.052+0000 7fb565600640 1 -- 172.21.15.67:0/329945798 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb560059480 con 0x7fb56815e650 2024-04-16T13:05:47.054 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 msgr2=0x7fb54806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 0x7fb54806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb554035000 tx=0x7fb554008030 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 msgr2=0x7fb568156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c450 tx=0x7fb56000c910 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 shutdown_connections 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb54806c8f0 0x7fb54806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5680b18c0 0x7fb56815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb56815ea30 0x7fb5680b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 --2- 172.21.15.67:0/329945798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb56815e650 0x7fb568156020 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 >> 172.21.15.67:0/329945798 conn(0x7fb56808c000 msgr2=0x7fb5680b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:47.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 shutdown_connections 2024-04-16T13:05:47.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.055+0000 7fb56e800640 1 -- 172.21.15.67:0/329945798 wait complete. 2024-04-16T13:05:47.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:47.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.299+0000 7fac1f200640 1 Processor -- start 2024-04-16T13:05:47.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.299+0000 7fac1f200640 1 -- start start 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.300+0000 7fac1f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac200cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.300+0000 7fac1f200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac200d04d0 con 0x7fac200d15e0 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.300+0000 7fac1f200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac200b6200 con 0x7fac200b7e70 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.300+0000 7fac1f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fac200b6e10 con 0x7fac2015eca0 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.301+0000 7fac1e800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fac200d15e0 0x7fac20162930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41456/0 (socket says 172.21.15.67:41456) 2024-04-16T13:05:47.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.301+0000 7fac1e800640 1 -- 172.21.15.67:0/4035915371 learned_addr learned my addr 172.21.15.67:0/4035915371 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.301+0000 7fac1de00640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac200cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.301+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385329953 0 0) 0x7fac200d04d0 con 0x7fac200d15e0 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.301+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac04003520 con 0x7fac200d15e0 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3307724729 0 0) 0x7fac04003520 con 0x7fac200d15e0 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 msgr2=0x7fac200cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:47.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac200cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 >> v1:172.21.15.82:6789/0 conn(0x7fac200b7e70 legacy=0x7fac200d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac200b64e0 con 0x7fac200d15e0 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fac18001a10 con 0x7fac200d15e0 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 >> v1:172.21.15.67:6789/0 conn(0x7fac200d15e0 legacy=0x7fac20162930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040039e0 0x7fac04003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac04004d40 0x7fac040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac200b6e10 con 0x7fac04004d40 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac0400baa0 con 0x7fac040039e0 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fac0400bca0 con 0x7fac2015eca0 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1e800640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac04004d40 0x7fac040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.302+0000 7fac1de00640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040039e0 0x7fac04003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac1e800640 1 -- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 msgr2=0x7fac04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac17e00640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac1e800640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac2015eca0 0x7fac04004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac1e800640 1 -- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040039e0 msgr2=0x7fac04003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac1e800640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac040039e0 0x7fac04003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.303+0000 7fac1e800640 1 -- 172.21.15.67:0/4035915371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac04003520 con 0x7fac04004d40 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1e800640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac04004d40 0x7fac040051c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fac200d1a70 tx=0x7fac04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a1bbfde5f71c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1800a3d0 con 0x7fac04004d40 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18034630 con 0x7fac04004d40 2024-04-16T13:05:47.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1d400640 1 -- 172.21.15.67:0/4035915371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18034a20 con 0x7fac04004d40 2024-04-16T13:05:47.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1f200640 1 -- 172.21.15.67:0/4035915371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac04004d40 msgr2=0x7fac040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.304+0000 7fac1f200640 1 --2- 172.21.15.67:0/4035915371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac04004d40 0x7fac040051c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fac200d1a70 tx=0x7fac04005830 comp rx=0 tx=0).stop 2024-04-16T13:05:47.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.305+0000 7fac1e800640 1 -- 172.21.15.67:0/4035915371 reap_dead start 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.305+0000 7fac1f200640 1 -- 172.21.15.67:0/4035915371 shutdown_connections 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.305+0000 7fac1f200640 1 -- 172.21.15.67:0/4035915371 >> 172.21.15.67:0/4035915371 conn(0x7fac2006ccc0 msgr2=0x7fac2006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.305+0000 7fac1f200640 1 -- 172.21.15.67:0/4035915371 shutdown_connections 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.305+0000 7fac1f200640 1 -- 172.21.15.67:0/4035915371 wait complete. 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.306+0000 7fac1f200640 1 Processor -- start 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 -- start start 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04004d40 0x7fac201488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac20149f60 0x7fac2014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fac2015f080 con 0x7fac2014bdd0 2024-04-16T13:05:47.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac200b6b20 con 0x7fac04004d40 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.307+0000 7fac1f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fac2015f200 con 0x7fac20149f60 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57972/0 (socket says 172.21.15.67:57972) 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 -- 172.21.15.67:0/2028692408 learned_addr learned my addr 172.21.15.67:0/2028692408 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 -- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac20149f60 msgr2=0x7fac2014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac20149f60 0x7fac2014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 -- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04004d40 msgr2=0x7fac201488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04004d40 0x7fac201488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 -- 172.21.15.67:0/2028692408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac20157200 con 0x7fac2014bdd0 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.308+0000 7fac1e800640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac1800a840 tx=0x7fac200b6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.309+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac18039040 con 0x7fac2014bdd0 2024-04-16T13:05:47.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.309+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac18043070 con 0x7fac2014bdd0 2024-04-16T13:05:47.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.309+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1800a3d0 con 0x7fac2014bdd0 2024-04-16T13:05:47.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.309+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac20148ec0 con 0x7fac2014bdd0 2024-04-16T13:05:47.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.309+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac20149480 con 0x7fac2014bdd0 2024-04-16T13:05:47.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.310+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac20075bd0 con 0x7fac2014bdd0 2024-04-16T13:05:47.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.311+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac18034630 con 0x7fac2014bdd0 2024-04-16T13:05:47.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.313+0000 7fac16000640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.313+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fac180addd0 con 0x7fac2014bdd0 2024-04-16T13:05:47.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.313+0000 7fac1de00640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.314+0000 7fac1de00640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 0x7fabfc06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac10009910 tx=0x7fac10008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.318+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac1807bd70 con 0x7fac2014bdd0 2024-04-16T13:05:47.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.511+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fac200d1fc0 con 0x7fac2014bdd0 2024-04-16T13:05:47.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.512+0000 7fac16000640 1 -- 172.21.15.67:0/2028692408 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fac180af020 con 0x7fac2014bdd0 2024-04-16T13:05:47.514 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 msgr2=0x7fabfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 0x7fabfc06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac10009910 tx=0x7fac10008040 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 msgr2=0x7fac2014c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac1800a840 tx=0x7fac200b6d80 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 shutdown_connections 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac2014bdd0 0x7fac2014c250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fac20149f60 0x7fac2014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 --2- 172.21.15.67:0/2028692408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04004d40 0x7fac201488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 >> 172.21.15.67:0/2028692408 conn(0x7fac2006ccc0 msgr2=0x7fac20157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:47.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 shutdown_connections 2024-04-16T13:05:47.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.515+0000 7fac1f200640 1 -- 172.21.15.67:0/2028692408 wait complete. 2024-04-16T13:05:47.535 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.750+0000 7f45a2600640 1 Processor -- start 2024-04-16T13:05:47.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.750+0000 7f45a2600640 1 -- start start 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.751+0000 7f45a2600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f459c15eb70 0x7f459c0ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f45a2600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f459c0b6890 0x7f459c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f45a2600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f459c0b6d00 con 0x7f459c0b63e0 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f45a2600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f459c0b9eb0 con 0x7f459c0b6890 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f45a2600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f459c0b8fe0 con 0x7f459c15eb70 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f459aa00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f459c0b63e0 0x7f459c0d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41466/0 (socket says 172.21.15.67:41466) 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f459aa00640 1 -- 172.21.15.67:0/452162162 learned_addr learned my addr 172.21.15.67:0/452162162 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:47.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f459be00640 1 --2- 172.21.15.67:0/452162162 >> v2:172.21.15.67:3300/0 conn(0x7f459c0b6890 0x7f459c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.752+0000 7f459b400640 1 --2- 172.21.15.67:0/452162162 >> v2:172.21.15.82:3300/0 conn(0x7f459c15eb70 0x7f459c0ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459a000640 1 -- 172.21.15.67:0/452162162 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058255466 0 0) 0x7f459c0b6d00 con 0x7f459c0b63e0 2024-04-16T13:05:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459a000640 1 -- 172.21.15.67:0/452162162 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4580003520 con 0x7f459c0b63e0 2024-04-16T13:05:47.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459be00640 1 -- 172.21.15.67:0/452162162 >> v2:172.21.15.82:3300/0 conn(0x7f459c15eb70 msgr2=0x7f459c0ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459be00640 1 --2- 172.21.15.67:0/452162162 >> v2:172.21.15.82:3300/0 conn(0x7f459c15eb70 0x7f459c0ba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459be00640 1 -- 172.21.15.67:0/452162162 >> v1:172.21.15.67:6789/0 conn(0x7f459c0b63e0 legacy=0x7f459c0d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.753+0000 7f459be00640 1 -- 172.21.15.67:0/452162162 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c0b92a0 con 0x7f459c0b6890 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.754+0000 7f459be00640 1 --2- 172.21.15.67:0/452162162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b6890 0x7f459c0b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f459c0d21f0 tx=0x7f459402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f73140abab49af server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.754+0000 7f459a000640 1 -- 172.21.15.67:0/452162162 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594039070 con 0x7f459c0b6890 2024-04-16T13:05:47.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.754+0000 7f459a000640 1 -- 172.21.15.67:0/452162162 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459402cc80 con 0x7f459c0b6890 2024-04-16T13:05:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.754+0000 7f459a000640 1 -- 172.21.15.67:0/452162162 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594034660 con 0x7f459c0b6890 2024-04-16T13:05:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 -- 172.21.15.67:0/452162162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b6890 msgr2=0x7f459c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 --2- 172.21.15.67:0/452162162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b6890 0x7f459c0b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f459c0d21f0 tx=0x7f459402bed0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 -- 172.21.15.67:0/452162162 shutdown_connections 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 --2- 172.21.15.67:0/452162162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b6890 0x7f459c0b8aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 --2- 172.21.15.67:0/452162162 >> v2:172.21.15.82:3300/0 conn(0x7f459c15eb70 0x7f459c0ba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 -- 172.21.15.67:0/452162162 >> 172.21.15.67:0/452162162 conn(0x7f459c067b80 msgr2=0x7f459c067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 -- 172.21.15.67:0/452162162 shutdown_connections 2024-04-16T13:05:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.755+0000 7f45a2600640 1 -- 172.21.15.67:0/452162162 wait complete. 2024-04-16T13:05:47.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.758+0000 7f45a2600640 1 Processor -- start 2024-04-16T13:05:47.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.758+0000 7f45a2600640 1 -- start start 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 0x7f459c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f459c15eb70 0x7f459c0d4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f459c0b9b40 con 0x7f459c0b63e0 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f459c0b9860 con 0x7f459c0b6890 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f45a2600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f459c15ef50 con 0x7f459c15eb70 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f459b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f459b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58000/0 (socket says 172.21.15.67:58000) 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.759+0000 7f459b400640 1 -- 172.21.15.67:0/3118817132 learned_addr learned my addr 172.21.15.67:0/3118817132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459aa00640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 0x7f459c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459be00640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f459c15eb70 0x7f459c0d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 -- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f459c15eb70 msgr2=0x7f459c0d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f459c15eb70 0x7f459c0d4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 -- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 msgr2=0x7f459c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 0x7f459c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 -- 172.21.15.67:0/3118817132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c15f5d0 con 0x7f459c0b63e0 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459aa00640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 0x7f459c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.760+0000 7f459b400640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f458c00d5f0 tx=0x7f458c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.761+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0125f0 con 0x7f459c0b63e0 2024-04-16T13:05:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.761+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c019070 con 0x7f459c0b63e0 2024-04-16T13:05:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.761+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c15f8b0 con 0x7f459c0b63e0 2024-04-16T13:05:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.761+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0129d0 con 0x7f459c0b63e0 2024-04-16T13:05:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.761+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c15fe70 con 0x7f459c0b63e0 2024-04-16T13:05:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.762+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c0cabe0 con 0x7f459c0b63e0 2024-04-16T13:05:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.763+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f458c012b70 con 0x7f459c0b63e0 2024-04-16T13:05:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.764+0000 7f4593400640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 0x7f457c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.764+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f458c08c3a0 con 0x7f459c0b63e0 2024-04-16T13:05:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.764+0000 7f459aa00640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 0x7f457c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:47.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.765+0000 7f459aa00640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 0x7f457c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f459c0c9ec0 tx=0x7f4588009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:47.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.768+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f458c05a330 con 0x7f459c0b63e0 2024-04-16T13:05:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.970+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f459c068a70 con 0x7f459c0b63e0 2024-04-16T13:05:47.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.972+0000 7f4593400640 1 -- 172.21.15.67:0/3118817132 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f458c059c30 con 0x7f459c0b63e0 2024-04-16T13:05:47.974 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.974+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 msgr2=0x7f457c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.974+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 0x7f457c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f459c0c9ec0 tx=0x7f4588009040 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.974+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 msgr2=0x7f459c1f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.974+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f458c00d5f0 tx=0x7f458c00dab0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.974+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 shutdown_connections 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f457c06c8f0 0x7f457c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f459c15eb70 0x7f459c0d4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f459c0b6890 0x7f459c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 --2- 172.21.15.67:0/3118817132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f459c0b63e0 0x7f459c1f7440 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 >> 172.21.15.67:0/3118817132 conn(0x7f459c067b80 msgr2=0x7f459c0c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 shutdown_connections 2024-04-16T13:05:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:47.975+0000 7f45a2600640 1 -- 172.21.15.67:0/3118817132 wait complete. 2024-04-16T13:05:47.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:48.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.216+0000 7efe52a00640 1 Processor -- start 2024-04-16T13:05:48.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.216+0000 7efe52a00640 1 -- start start 2024-04-16T13:05:48.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.217+0000 7efe52a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.217+0000 7efe52a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe4c0b63e0 0x7efe4c0b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.217+0000 7efe52a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4c0b92a0 con 0x7efe4c0d2c40 2024-04-16T13:05:48.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.217+0000 7efe52a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7efe4c0b9eb0 con 0x7efe4c0b63e0 2024-04-16T13:05:48.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.217+0000 7efe52a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c0b9580 con 0x7efe4c15eb70 2024-04-16T13:05:48.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.218+0000 7efe4be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.218+0000 7efe4b400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe4c0b63e0 0x7efe4c0b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.218+0000 7efe4be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:38394/0 (socket says 172.21.15.67:38394) 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.218+0000 7efe4be00640 1 -- 172.21.15.67:0/3021708101 learned_addr learned my addr 172.21.15.67:0/3021708101 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.219+0000 7efe4be00640 1 -- 172.21.15.67:0/3021708101 >> v2:172.21.15.82:3300/0 conn(0x7efe4c0b63e0 msgr2=0x7efe4c0b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.219+0000 7efe4be00640 1 --2- 172.21.15.67:0/3021708101 >> v2:172.21.15.82:3300/0 conn(0x7efe4c0b63e0 0x7efe4c0b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.219+0000 7efe4be00640 1 -- 172.21.15.67:0/3021708101 >> v1:172.21.15.82:6789/0 conn(0x7efe4c0d2c40 legacy=0x7efe4c0d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.219+0000 7efe4be00640 1 -- 172.21.15.67:0/3021708101 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c0b9860 con 0x7efe4c15eb70 2024-04-16T13:05:48.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.221+0000 7efe4be00640 1 --2- 172.21.15.67:0/3021708101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009e50 tx=0x7efe3c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c019a7cea96af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.221+0000 7efe4aa00640 1 -- 172.21.15.67:0/3021708101 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c02cb00 con 0x7efe4c15eb70 2024-04-16T13:05:48.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.221+0000 7efe4aa00640 1 -- 172.21.15.67:0/3021708101 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c02cca0 con 0x7efe4c15eb70 2024-04-16T13:05:48.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.221+0000 7efe4aa00640 1 -- 172.21.15.67:0/3021708101 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c034610 con 0x7efe4c15eb70 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 -- 172.21.15.67:0/3021708101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 msgr2=0x7efe4c0ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 --2- 172.21.15.67:0/3021708101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009e50 tx=0x7efe3c02bf60 comp rx=0 tx=0).stop 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 -- 172.21.15.67:0/3021708101 shutdown_connections 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 --2- 172.21.15.67:0/3021708101 >> v2:172.21.15.82:3300/0 conn(0x7efe4c0b63e0 0x7efe4c0b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 --2- 172.21.15.67:0/3021708101 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c15eb70 0x7efe4c0ba410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 -- 172.21.15.67:0/3021708101 >> 172.21.15.67:0/3021708101 conn(0x7efe4c067b80 msgr2=0x7efe4c067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 -- 172.21.15.67:0/3021708101 shutdown_connections 2024-04-16T13:05:48.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.222+0000 7efe52a00640 1 -- 172.21.15.67:0/3021708101 wait complete. 2024-04-16T13:05:48.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.224+0000 7efe52a00640 1 Processor -- start 2024-04-16T13:05:48.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.224+0000 7efe52a00640 1 -- start start 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c0b63e0 0x7efe4c0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c0d2c40 0x7efe4c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c0b8aa0 con 0x7efe4c15eb70 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c15ef50 con 0x7efe4c0b63e0 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe52a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7efe4c0b8c20 con 0x7efe4c0d2c40 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe50a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe50a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58012/0 (socket says 172.21.15.67:58012) 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.225+0000 7efe50a00640 1 -- 172.21.15.67:0/2508654189 learned_addr learned my addr 172.21.15.67:0/2508654189 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe4be00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c0b63e0 0x7efe4c0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe4b400640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c0d2c40 0x7efe4c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 -- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c0d2c40 msgr2=0x7efe4c15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c0d2c40 0x7efe4c15ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 -- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c0b63e0 msgr2=0x7efe4c0ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c0b63e0 0x7efe4c0ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 -- 172.21.15.67:0/2508654189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c15f200 con 0x7efe4c15eb70 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.226+0000 7efe50a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c400 tx=0x7efe4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.227+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44017070 con 0x7efe4c15eb70 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.227+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe440052d0 con 0x7efe4c15eb70 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.227+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44003810 con 0x7efe4c15eb70 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.227+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c15f4e0 con 0x7efe4c15eb70 2024-04-16T13:05:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.227+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c15faa0 con 0x7efe4c15eb70 2024-04-16T13:05:48.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.228+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4c15fca0 con 0x7efe4c15eb70 2024-04-16T13:05:48.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.229+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe4401a070 con 0x7efe4c15eb70 2024-04-16T13:05:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.230+0000 7efe43e00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 0x7efe2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.230+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efe4408b2a0 con 0x7efe4c15eb70 2024-04-16T13:05:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.231+0000 7efe4be00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 0x7efe2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.232+0000 7efe4be00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 0x7efe2806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe3c035000 tx=0x7efe3c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.235+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe4c15fca0 con 0x7efe4c15eb70 2024-04-16T13:05:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.439+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efe4c068a70 con 0x7efe4c15eb70 2024-04-16T13:05:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.440+0000 7efe43e00640 1 -- 172.21.15.67:0/2508654189 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7efe44058c70 con 0x7efe4c15eb70 2024-04-16T13:05:48.442 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 msgr2=0x7efe2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 0x7efe2806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe3c035000 tx=0x7efe3c030000 comp rx=0 tx=0).stop 2024-04-16T13:05:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 msgr2=0x7efe4c15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c400 tx=0x7efe4400c8c0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 shutdown_connections 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7efe2806c8f0 0x7efe2806edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe4c15eb70 0x7efe4c15ba40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7efe4c0d2c40 0x7efe4c15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 --2- 172.21.15.67:0/2508654189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe4c0b63e0 0x7efe4c0ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 >> 172.21.15.67:0/2508654189 conn(0x7efe4c067b80 msgr2=0x7efe4c0d4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 shutdown_connections 2024-04-16T13:05:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.443+0000 7efe52a00640 1 -- 172.21.15.67:0/2508654189 wait complete. 2024-04-16T13:05:48.472 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-16T13:05:48.472 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.691+0000 7f0f57200640 1 Processor -- start 2024-04-16T13:05:48.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.691+0000 7f0f57200640 1 -- start start 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f57200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f5015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f57200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f500cde10 con 0x7f0f500cf890 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f57200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5015f630 con 0x7f0f500cfcf0 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f57200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f500c6b00 con 0x7f0f500cc120 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f55400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f500cf890 0x7f0f500b3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41474/0 (socket says 172.21.15.67:41474) 2024-04-16T13:05:48.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f55400640 1 -- 172.21.15.67:0/1130198371 learned_addr learned my addr 172.21.15.67:0/1130198371 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.693+0000 7f0f55e00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f5015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626692267 0 0) 0x7f0f500cde10 con 0x7f0f500cf890 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f38003520 con 0x7f0f500cf890 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 43352998 0 0) 0x7f0f38003520 con 0x7f0f500cf890 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 msgr2=0x7f0f5015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:48.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f5015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 >> v1:172.21.15.82:6789/0 conn(0x7f0f500cfcf0 legacy=0x7f0f5006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f500ce0b0 con 0x7f0f500cf890 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f0f40001670 con 0x7f0f500cf890 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 >> v1:172.21.15.67:6789/0 conn(0x7f0f500cf890 legacy=0x7f0f500b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f380039e0 0x7f0f38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f38004800 0x7f0f38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f3800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f380054d0 con 0x7f0f38004800 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38005680 con 0x7f0f380039e0 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.694+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3800e190 con 0x7f0f500cc120 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f38004800 0x7f0f38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55e00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f380039e0 0x7f0f38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f56800640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f3800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 -- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 msgr2=0x7f0f3800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f500cc120 0x7f0f3800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 -- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f380039e0 msgr2=0x7f0f38003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f380039e0 0x7f0f38003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55400640 1 -- 172.21.15.67:0/1130198371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f38003520 con 0x7f0f38004800 2024-04-16T13:05:48.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.695+0000 7f0f55e00640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f380039e0 0x7f0f38003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.696+0000 7f0f55400640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f38004800 0x7f0f38004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c0e0 tx=0x7f0f38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e06a504945ea97e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40007c20 con 0x7f0f38004800 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40030070 con 0x7f0f38004800 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f54a00640 1 -- 172.21.15.67:0/1130198371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005db0 con 0x7f0f38004800 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 -- 172.21.15.67:0/1130198371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f38004800 msgr2=0x7f0f38004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 --2- 172.21.15.67:0/1130198371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f38004800 0x7f0f38004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c0e0 tx=0x7f0f38005830 comp rx=0 tx=0).stop 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f56800640 1 -- 172.21.15.67:0/1130198371 reap_dead start 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 -- 172.21.15.67:0/1130198371 shutdown_connections 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 -- 172.21.15.67:0/1130198371 >> 172.21.15.67:0/1130198371 conn(0x7f0f500b2070 msgr2=0x7f0f500b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 -- 172.21.15.67:0/1130198371 shutdown_connections 2024-04-16T13:05:48.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.697+0000 7f0f57200640 1 -- 172.21.15.67:0/1130198371 wait complete. 2024-04-16T13:05:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.699+0000 7f0f57200640 1 Processor -- start 2024-04-16T13:05:48.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.699+0000 7f0f57200640 1 -- start start 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f38004800 0x7f0f501eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50072de0 0x7f0f500b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500b38a0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500b4e20 con 0x7f0f50072de0 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.700+0000 7f0f57200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f500ce390 con 0x7f0f38004800 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58030/0 (socket says 172.21.15.67:58030) 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 -- 172.21.15.67:0/3763564001 learned_addr learned my addr 172.21.15.67:0/3763564001 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f55e00640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f38004800 0x7f0f501eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f55400640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50072de0 0x7f0f500b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 -- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f38004800 msgr2=0x7f0f501eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f38004800 0x7f0f501eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 -- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50072de0 msgr2=0x7f0f500b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50072de0 0x7f0f500b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 -- 172.21.15.67:0/3763564001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f501f3f10 con 0x7f0f500b0cc0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.701+0000 7f0f56800640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f5006c810 tx=0x7f0f4c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.702+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c003b80 con 0x7f0f500b0cc0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.702+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c018070 con 0x7f0f500b0cc0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.702+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f501f41f0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.702+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0050d0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.702+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f501f47b0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.703+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f50075bd0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.704+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f4c005270 con 0x7f0f500b0cc0 2024-04-16T13:05:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.705+0000 7f0f4a000640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 0x7f0f3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.705+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0f4c08bc40 con 0x7f0f500b0cc0 2024-04-16T13:05:48.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.706+0000 7f0f55e00640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 0x7f0f3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:48.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.707+0000 7f0f55e00640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 0x7f0f3406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009aa0 tx=0x7f0f44008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:48.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.709+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f4c059bd0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.917+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f500b47f0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.919+0000 7f0f4a000640 1 -- 172.21.15.67:0/3763564001 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f0f4c0594d0 con 0x7f0f500b0cc0 2024-04-16T13:05:48.922 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:48.922 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:48.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 msgr2=0x7f0f3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 0x7f0f3406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009aa0 tx=0x7f0f44008040 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 msgr2=0x7f0f501f0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0f5006c810 tx=0x7f0f4c00ea00 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 shutdown_connections 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f3406c8f0 0x7f0f3406edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f500b0cc0 0x7f0f501f0920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f50072de0 0x7f0f500b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 --2- 172.21.15.67:0/3763564001 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f38004800 0x7f0f501eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 >> 172.21.15.67:0/3763564001 conn(0x7f0f500b2070 msgr2=0x7f0f5006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 shutdown_connections 2024-04-16T13:05:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:48.922+0000 7f0f57200640 1 -- 172.21.15.67:0/3763564001 wait complete. 2024-04-16T13:05:48.945 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:48.945 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.170+0000 7ff32f200640 1 Processor -- start 2024-04-16T13:05:49.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.170+0000 7ff32f200640 1 -- start start 2024-04-16T13:05:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33015e650 0x7ff3300cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32f200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff3300d21c0 0x7ff3300d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32f200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3300d2650 con 0x7ff3300d0490 2024-04-16T13:05:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff3300d2930 con 0x7ff33015e650 2024-04-16T13:05:49.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32f200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff3300d2c10 con 0x7ff3300d21c0 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33015e650 0x7ff3300cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33015e650 0x7ff3300cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58034/0 (socket says 172.21.15.67:58034) 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.172+0000 7ff32de00640 1 -- 172.21.15.67:0/3838137039 learned_addr learned my addr 172.21.15.67:0/3838137039 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32d400640 1 --2- 172.21.15.67:0/3838137039 >> v2:172.21.15.82:3300/0 conn(0x7ff3300d21c0 0x7ff3300d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32de00640 1 -- 172.21.15.67:0/3838137039 >> v2:172.21.15.82:3300/0 conn(0x7ff3300d21c0 msgr2=0x7ff3300d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32de00640 1 --2- 172.21.15.67:0/3838137039 >> v2:172.21.15.82:3300/0 conn(0x7ff3300d21c0 0x7ff3300d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32de00640 1 -- 172.21.15.67:0/3838137039 >> v1:172.21.15.67:6789/0 conn(0x7ff3300d0490 legacy=0x7ff330162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32de00640 1 -- 172.21.15.67:0/3838137039 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3300d2ef0 con 0x7ff33015e650 2024-04-16T13:05:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.173+0000 7ff32ca00640 1 -- 172.21.15.67:0/3838137039 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145109950 0 0) 0x7ff3300d2650 con 0x7ff3300d0490 2024-04-16T13:05:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.174+0000 7ff32de00640 1 --2- 172.21.15.67:0/3838137039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff3300cff50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff3300b7150 tx=0x7ff31802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1137c0b601bb29ec server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.175+0000 7ff32ca00640 1 -- 172.21.15.67:0/3838137039 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318034070 con 0x7ff33015e650 2024-04-16T13:05:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.175+0000 7ff32ca00640 1 -- 172.21.15.67:0/3838137039 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff318030860 con 0x7ff33015e650 2024-04-16T13:05:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.175+0000 7ff32ca00640 1 -- 172.21.15.67:0/3838137039 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318030c30 con 0x7ff33015e650 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.175+0000 7ff32f200640 1 -- 172.21.15.67:0/3838137039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 msgr2=0x7ff3300cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.175+0000 7ff32f200640 1 --2- 172.21.15.67:0/3838137039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff3300cff50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff3300b7150 tx=0x7ff31802b9a0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 -- 172.21.15.67:0/3838137039 shutdown_connections 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 --2- 172.21.15.67:0/3838137039 >> v2:172.21.15.82:3300/0 conn(0x7ff3300d21c0 0x7ff3300d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 --2- 172.21.15.67:0/3838137039 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff3300cff50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 -- 172.21.15.67:0/3838137039 >> 172.21.15.67:0/3838137039 conn(0x7ff33008c000 msgr2=0x7ff3300d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 -- 172.21.15.67:0/3838137039 shutdown_connections 2024-04-16T13:05:49.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.176+0000 7ff32f200640 1 -- 172.21.15.67:0/3838137039 wait complete. 2024-04-16T13:05:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.177+0000 7ff32f200640 1 Processor -- start 2024-04-16T13:05:49.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.178+0000 7ff32f200640 1 -- start start 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.178+0000 7ff32f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.178+0000 7ff32f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff330159380 0x7ff3301597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3300cd150 0x7ff3300cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff33015ea30 con 0x7ff33015e650 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3300d36f0 con 0x7ff330159380 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff33015ebb0 con 0x7ff3300cd150 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58036/0 (socket says 172.21.15.67:58036) 2024-04-16T13:05:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 -- 172.21.15.67:0/1488310443 learned_addr learned my addr 172.21.15.67:0/1488310443 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:49.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32d400640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff330159380 0x7ff3301597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32e800640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3300cd150 0x7ff3300cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 -- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3300cd150 msgr2=0x7ff3300cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3300cd150 0x7ff3300cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 -- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff330159380 msgr2=0x7ff3301597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff330159380 0x7ff3301597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.179+0000 7ff32de00640 1 -- 172.21.15.67:0/1488310443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3300cc390 con 0x7ff33015e650 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff32de00640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff318009960 tx=0x7ff318004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318048070 con 0x7ff33015e650 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff318030660 con 0x7ff33015e650 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3300cc670 con 0x7ff33015e650 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318034040 con 0x7ff33015e650 2024-04-16T13:05:49.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.180+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3300ccc30 con 0x7ff33015e650 2024-04-16T13:05:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.181+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff330075bd0 con 0x7ff33015e650 2024-04-16T13:05:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.182+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff31804b070 con 0x7ff33015e650 2024-04-16T13:05:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.184+0000 7ff326000640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 0x7ff30c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.184+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff3180adfc0 con 0x7ff33015e650 2024-04-16T13:05:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.184+0000 7ff32d400640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 0x7ff30c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.186+0000 7ff32d400640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 0x7ff30c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b9b0 tx=0x7ff320008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.189+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff31807bff0 con 0x7ff33015e650 2024-04-16T13:05:49.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.392+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3300d1e40 con 0x7ff33015e650 2024-04-16T13:05:49.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.393+0000 7ff326000640 1 -- 172.21.15.67:0/1488310443 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff31807b8f0 con 0x7ff33015e650 2024-04-16T13:05:49.395 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:49.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 msgr2=0x7ff30c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 0x7ff30c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b9b0 tx=0x7ff320008040 comp rx=0 tx=0).stop 2024-04-16T13:05:49.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 msgr2=0x7ff330158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff318009960 tx=0x7ff318004730 comp rx=0 tx=0).stop 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 shutdown_connections 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff30c06c8f0 0x7ff30c06edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff3300cd150 0x7ff3300cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff330159380 0x7ff3301597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 --2- 172.21.15.67:0/1488310443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33015e650 0x7ff330158a60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.395+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 >> 172.21.15.67:0/1488310443 conn(0x7ff33008c000 msgr2=0x7ff3300d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.396+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 shutdown_connections 2024-04-16T13:05:49.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.396+0000 7ff32f200640 1 -- 172.21.15.67:0/1488310443 wait complete. 2024-04-16T13:05:49.416 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:49.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.648+0000 7f19b7200640 1 Processor -- start 2024-04-16T13:05:49.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.648+0000 7f19b7200640 1 -- start start 2024-04-16T13:05:49.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19b7200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19b015c860 0x7f19b00c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19b7200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b00cce80 con 0x7f19b00cc9f0 2024-04-16T13:05:49.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19b7200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b00c6e70 con 0x7f19b00b3700 2024-04-16T13:05:49.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19b7200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f19b00c7710 con 0x7f19b015c860 2024-04-16T13:05:49.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19af400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f19b00cc9f0 0x7f19b0160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41498/0 (socket says 172.21.15.67:41498) 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.650+0000 7f19af400640 1 -- 172.21.15.67:0/4011511513 learned_addr learned my addr 172.21.15.67:0/4011511513 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19afe00640 1 --2- 172.21.15.67:0/4011511513 >> v2:172.21.15.82:3300/0 conn(0x7f19b015c860 0x7f19b00c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147681730 0 0) 0x7f19b00cce80 con 0x7f19b00cc9f0 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1994003520 con 0x7f19b00cc9f0 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1845212150 0 0) 0x7f1994003520 con 0x7f19b00cc9f0 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 >> v2:172.21.15.82:3300/0 conn(0x7f19b015c860 msgr2=0x7f19b00c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:49.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 --2- 172.21.15.67:0/4011511513 >> v2:172.21.15.82:3300/0 conn(0x7f19b015c860 0x7f19b00c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 >> v1:172.21.15.82:6789/0 conn(0x7f19b00b3700 legacy=0x7f19b00cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b00c7150 con 0x7f19b00cc9f0 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f199c001670 con 0x7f19b00cc9f0 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 >> v1:172.21.15.67:6789/0 conn(0x7f19b00cc9f0 legacy=0x7f19b0160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 0x7f1994003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1994004800 0x7f1994004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19940051c0 0x7f199400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19b00c7710 con 0x7f19940039b0 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f199400c060 con 0x7f1994004800 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.651+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f199400c260 con 0x7f19940051c0 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 0x7f1994003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19af400640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1994004800 0x7f1994004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19b5200640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19940051c0 0x7f199400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 -- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19940051c0 msgr2=0x7f199400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19940051c0 0x7f199400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 -- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1994004800 msgr2=0x7f1994004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1994004800 0x7f1994004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19afe00640 1 -- 172.21.15.67:0/4011511513 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1994003520 con 0x7f19940039b0 2024-04-16T13:05:49.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.652+0000 7f19b5200640 1 -- 172.21.15.67:0/4011511513 reap_dead start 2024-04-16T13:05:49.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.653+0000 7f19afe00640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 0x7f1994003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009ac0 tx=0x7f1994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72d400dfadf6d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0039070 con 0x7f19940039b0 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a002c6d0 con 0x7f19940039b0 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19aea00640 1 -- 172.21.15.67:0/4011511513 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0009690 con 0x7f19940039b0 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19b7200640 1 -- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 msgr2=0x7f1994003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19b7200640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 0x7f1994003dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009ac0 tx=0x7f1994005830 comp rx=0 tx=0).stop 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19b7200640 1 -- 172.21.15.67:0/4011511513 shutdown_connections 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19b7200640 1 --2- 172.21.15.67:0/4011511513 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19940039b0 0x7f1994003dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.654+0000 7f19b7200640 1 -- 172.21.15.67:0/4011511513 >> 172.21.15.67:0/4011511513 conn(0x7f19b0067d90 msgr2=0x7f19b006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.655+0000 7f19b7200640 1 -- 172.21.15.67:0/4011511513 shutdown_connections 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.655+0000 7f19b7200640 1 -- 172.21.15.67:0/4011511513 wait complete. 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.656+0000 7f19b7200640 1 Processor -- start 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.656+0000 7f19b7200640 1 -- start start 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19940039b0 0x7f19b015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0149820 0x7f19b01f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19b015cc40 con 0x7f19b01598b0 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19b01605c0 con 0x7f19940039b0 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.657+0000 7f19b7200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f19b00c6890 con 0x7f19b0149820 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58068/0 (socket says 172.21.15.67:58068) 2024-04-16T13:05:49.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 -- 172.21.15.67:0/223006211 learned_addr learned my addr 172.21.15.67:0/223006211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19af400640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0149820 0x7f19b01f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19afe00640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19940039b0 0x7f19b015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 -- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0149820 msgr2=0x7f19b01f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0149820 0x7f19b01f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 -- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19940039b0 msgr2=0x7f19b015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19940039b0 0x7f19b015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.658+0000 7f19b5200640 1 -- 172.21.15.67:0/223006211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b015ff10 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19b5200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19b0070140 tx=0x7f19a800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8018070 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a8003b70 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b01f6460 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8005070 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.659+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b01f6a20 con 0x7f19b01598b0 2024-04-16T13:05:49.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.660+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b0068a70 con 0x7f19b01598b0 2024-04-16T13:05:49.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.661+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19a801b070 con 0x7f19b01598b0 2024-04-16T13:05:49.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.662+0000 7f19a7e00640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 0x7f199006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:49.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.662+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f19a808b6c0 con 0x7f19b01598b0 2024-04-16T13:05:49.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.663+0000 7f19afe00640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 0x7f199006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:49.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.664+0000 7f19afe00640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 0x7f199006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19a0036000 tx=0x7f19a0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:49.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.667+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19a8059650 con 0x7f19b01598b0 2024-04-16T13:05:49.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.875+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f19b00b49f0 con 0x7f19b01598b0 2024-04-16T13:05:49.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.876+0000 7f19a7e00640 1 -- 172.21.15.67:0/223006211 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f19a8058f50 con 0x7f19b01598b0 2024-04-16T13:05:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.878+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 msgr2=0x7f199006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.878+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 0x7f199006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19a0036000 tx=0x7f19a0030000 comp rx=0 tx=0).stop 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.878+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 msgr2=0x7f19b0159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.878+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19b0070140 tx=0x7f19a800dc00 comp rx=0 tx=0).stop 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.878+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 shutdown_connections 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f199006c8f0 0x7f199006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19b01598b0 0x7f19b0159d30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f19b0149820 0x7f19b01f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 --2- 172.21.15.67:0/223006211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19940039b0 0x7f19b015f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:49.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 >> 172.21.15.67:0/223006211 conn(0x7f19b0067d90 msgr2=0x7f19b00733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:49.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 shutdown_connections 2024-04-16T13:05:49.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:49.879+0000 7f19b7200640 1 -- 172.21.15.67:0/223006211 wait complete. 2024-04-16T13:05:49.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.130+0000 7fa232c00640 1 Processor -- start 2024-04-16T13:05:50.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.130+0000 7fa232c00640 1 -- start start 2024-04-16T13:05:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa22c071de0 0x7fa22c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa22c162480 0x7fa22c1628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa22c072780 con 0x7fa22c071de0 2024-04-16T13:05:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa22c1633e0 con 0x7fa22c162480 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa232c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c162e30 con 0x7fa22c144c40 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa230e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa22c071de0 0x7fa22c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa230e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa22c071de0 0x7fa22c072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58082/0 (socket says 172.21.15.67:58082) 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.132+0000 7fa230e00640 1 -- 172.21.15.67:0/622398572 learned_addr learned my addr 172.21.15.67:0/622398572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa231800640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa230e00640 1 -- 172.21.15.67:0/622398572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 msgr2=0x7fa22c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa232200640 1 --2- 172.21.15.67:0/622398572 >> v2:172.21.15.82:3300/0 conn(0x7fa22c162480 0x7fa22c1628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa230e00640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c0af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa230e00640 1 -- 172.21.15.67:0/622398572 >> v2:172.21.15.82:3300/0 conn(0x7fa22c162480 msgr2=0x7fa22c1628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa230e00640 1 --2- 172.21.15.67:0/622398572 >> v2:172.21.15.82:3300/0 conn(0x7fa22c162480 0x7fa22c1628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa230e00640 1 -- 172.21.15.67:0/622398572 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c163100 con 0x7fa22c071de0 2024-04-16T13:05:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.133+0000 7fa231800640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.134+0000 7fa230e00640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c071de0 0x7fa22c072240 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa22c071d70 tx=0x7fa21802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8230e40726d3d01c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.135+0000 7fa22be00640 1 -- 172.21.15.67:0/622398572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218035020 con 0x7fa22c071de0 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.135+0000 7fa22be00640 1 -- 172.21.15.67:0/622398572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218031870 con 0x7fa22c071de0 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.135+0000 7fa22be00640 1 -- 172.21.15.67:0/622398572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218031c40 con 0x7fa22c071de0 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 -- 172.21.15.67:0/622398572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c071de0 msgr2=0x7fa22c072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c071de0 0x7fa22c072240 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa22c071d70 tx=0x7fa21802b910 comp rx=0 tx=0).stop 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 -- 172.21.15.67:0/622398572 shutdown_connections 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 --2- 172.21.15.67:0/622398572 >> v2:172.21.15.82:3300/0 conn(0x7fa22c162480 0x7fa22c1628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c071de0 0x7fa22c072240 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 --2- 172.21.15.67:0/622398572 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c0af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 -- 172.21.15.67:0/622398572 >> 172.21.15.67:0/622398572 conn(0x7fa22c067d90 msgr2=0x7fa22c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 -- 172.21.15.67:0/622398572 shutdown_connections 2024-04-16T13:05:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.136+0000 7fa232c00640 1 -- 172.21.15.67:0/622398572 wait complete. 2024-04-16T13:05:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.138+0000 7fa232c00640 1 Processor -- start 2024-04-16T13:05:50.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.138+0000 7fa232c00640 1 -- start start 2024-04-16T13:05:50.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c071de0 0x7fa22c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c1f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0af2a0 con 0x7fa22c162480 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c0aefc0 con 0x7fa22c071de0 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa22c0afd00 con 0x7fa22c144c40 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58084/0 (socket says 172.21.15.67:58084) 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.139+0000 7fa232200640 1 -- 172.21.15.67:0/2187379483 learned_addr learned my addr 172.21.15.67:0/2187379483 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa230e00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c1f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa231800640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c071de0 0x7fa22c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 -- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 msgr2=0x7fa22c1f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c1f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 -- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c071de0 msgr2=0x7fa22c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c071de0 0x7fa22c0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 -- 172.21.15.67:0/2187379483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c0ce160 con 0x7fa22c162480 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa230e00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c1f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa232200640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa22400cc30 tx=0x7fa22400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22400ce40 con 0x7fa22c162480 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.140+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224003990 con 0x7fa22c162480 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.141+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224003d40 con 0x7fa22c162480 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.141+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c0ce440 con 0x7fa22c162480 2024-04-16T13:05:50.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.141+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c0cea00 con 0x7fa22c162480 2024-04-16T13:05:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.142+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22c075bd0 con 0x7fa22c162480 2024-04-16T13:05:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.143+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa224003ee0 con 0x7fa22c162480 2024-04-16T13:05:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.144+0000 7fa229600640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 0x7fa20c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.144+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa22408c440 con 0x7fa22c162480 2024-04-16T13:05:50.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.144+0000 7fa231800640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 0x7fa20c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.145+0000 7fa231800640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 0x7fa20c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa220006fd0 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.148+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa224014030 con 0x7fa22c162480 2024-04-16T13:05:50.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.353+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa22c147950 con 0x7fa22c162480 2024-04-16T13:05:50.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.354+0000 7fa229600640 1 -- 172.21.15.67:0/2187379483 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa22405a460 con 0x7fa22c162480 2024-04-16T13:05:50.356 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 msgr2=0x7fa20c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 0x7fa20c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa220006fd0 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-04-16T13:05:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 msgr2=0x7fa22c135110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa22400cc30 tx=0x7fa22400a5c0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 shutdown_connections 2024-04-16T13:05:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa20c06c8f0 0x7fa20c06edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa22c162480 0x7fa22c135110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa22c144c40 0x7fa22c1f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 --2- 172.21.15.67:0/2187379483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c071de0 0x7fa22c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 >> 172.21.15.67:0/2187379483 conn(0x7fa22c067d90 msgr2=0x7fa22c143ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 shutdown_connections 2024-04-16T13:05:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.357+0000 7fa232c00640 1 -- 172.21.15.67:0/2187379483 wait complete. 2024-04-16T13:05:50.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:50.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.602+0000 7ff68aa00640 1 Processor -- start 2024-04-16T13:05:50.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.603+0000 7ff68aa00640 1 -- start start 2024-04-16T13:05:50.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.604+0000 7ff68aa00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6840cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.604+0000 7ff68aa00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6840c6e70 con 0x7ff68415c860 2024-04-16T13:05:50.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.604+0000 7ff68aa00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6840c7150 con 0x7ff6840b3700 2024-04-16T13:05:50.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.604+0000 7ff68aa00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff6840c7710 con 0x7ff6840c6890 2024-04-16T13:05:50.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.605+0000 7ff683e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff68415c860 0x7ff684160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41508/0 (socket says 172.21.15.67:41508) 2024-04-16T13:05:50.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.605+0000 7ff683e00640 1 -- 172.21.15.67:0/3218931873 learned_addr learned my addr 172.21.15.67:0/3218931873 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:50.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.605+0000 7ff683400640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6840cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.605+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599368955 0 0) 0x7ff6840c6e70 con 0x7ff68415c860 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.605+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff668003520 con 0x7ff68415c860 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550096907 0 0) 0x7ff668003520 con 0x7ff68415c860 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 msgr2=0x7ff6840cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6840cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 >> v1:172.21.15.82:6789/0 conn(0x7ff6840b3700 legacy=0x7ff6840cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6840c7430 con 0x7ff68415c860 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7ff674001670 con 0x7ff68415c860 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 >> v1:172.21.15.67:6789/0 conn(0x7ff68415c860 legacy=0x7ff684160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668003f60 0x7ff668004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff668004d40 0x7ff6680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff6840c7710 con 0x7ff668004d40 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff66800baa0 con 0x7ff668003f60 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff66800bca0 con 0x7ff6840c6890 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.606+0000 7ff688a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff668004d40 0x7ff6680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff683e00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff683400640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668003f60 0x7ff668004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff688a00640 1 -- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 msgr2=0x7ff6680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff688a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff6840c6890 0x7ff6680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff688a00640 1 -- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668003f60 msgr2=0x7ff668004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff688a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668003f60 0x7ff668004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.607+0000 7ff688a00640 1 -- 172.21.15.67:0/3218931873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff668003520 con 0x7ff668004d40 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.608+0000 7ff688a00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff668004d40 0x7ff6680051c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff67c001e50 tx=0x7ff668005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d75327c1cefabc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.608+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c001a70 con 0x7ff668004d40 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.608+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67c003b70 con 0x7ff668004d40 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.608+0000 7ff682a00640 1 -- 172.21.15.67:0/3218931873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67c0050d0 con 0x7ff668004d40 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 -- 172.21.15.67:0/3218931873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff668004d40 msgr2=0x7ff6680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3218931873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff668004d40 0x7ff6680051c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff67c001e50 tx=0x7ff668005830 comp rx=0 tx=0).stop 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff688a00640 1 -- 172.21.15.67:0/3218931873 reap_dead start 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 -- 172.21.15.67:0/3218931873 shutdown_connections 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 -- 172.21.15.67:0/3218931873 >> 172.21.15.67:0/3218931873 conn(0x7ff684067d90 msgr2=0x7ff68406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 -- 172.21.15.67:0/3218931873 shutdown_connections 2024-04-16T13:05:50.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.609+0000 7ff68aa00640 1 -- 172.21.15.67:0/3218931873 wait complete. 2024-04-16T13:05:50.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.611+0000 7ff68aa00640 1 Processor -- start 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.611+0000 7ff68aa00640 1 -- start start 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668004d40 0x7ff68414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 0x7ff684159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff6841611f0 con 0x7ff6840ca920 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff68415cc40 con 0x7ff668004d40 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff68aa00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff684161370 con 0x7ff68414add0 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff683400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff683400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58096/0 (socket says 172.21.15.67:58096) 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.612+0000 7ff683400640 1 -- 172.21.15.67:0/3196303598 learned_addr learned my addr 172.21.15.67:0/3196303598 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683e00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668004d40 0x7ff68414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff688a00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 0x7ff684159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 -- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 msgr2=0x7ff684159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 0x7ff684159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 -- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668004d40 msgr2=0x7ff68414a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668004d40 0x7ff68414a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 -- 172.21.15.67:0/3196303598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68414ab80 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff688a00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 0x7ff684159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.613+0000 7ff683400640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff66c011600 tx=0x7ff66c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.614+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c015870 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.614+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c015a10 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.614+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c015dc0 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.614+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6840cae70 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.614+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6840cc910 con 0x7ff6840ca920 2024-04-16T13:05:50.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.615+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff684068a70 con 0x7ff6840ca920 2024-04-16T13:05:50.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.616+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff66c00f450 con 0x7ff6840ca920 2024-04-16T13:05:50.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.617+0000 7ff67be00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 0x7ff66006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:50.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.617+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff66c08c8f0 con 0x7ff6840ca920 2024-04-16T13:05:50.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.617+0000 7ff683e00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 0x7ff66006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:50.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.619+0000 7ff683e00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 0x7ff66006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff674001050 tx=0x7ff674009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:50.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.621+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff66c019030 con 0x7ff6840ca920 2024-04-16T13:05:50.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.826+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff684158770 con 0x7ff6840ca920 2024-04-16T13:05:50.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.827+0000 7ff67be00640 1 -- 172.21.15.67:0/3196303598 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ff66c05a880 con 0x7ff6840ca920 2024-04-16T13:05:50.829 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 msgr2=0x7ff66006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 0x7ff66006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff674001050 tx=0x7ff674009040 comp rx=0 tx=0).stop 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 msgr2=0x7ff684159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff66c011600 tx=0x7ff66c011ac0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 shutdown_connections 2024-04-16T13:05:50.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff66006c8f0 0x7ff66006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff68414add0 0x7ff684159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6840ca920 0x7ff684159230 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 --2- 172.21.15.67:0/3196303598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff668004d40 0x7ff68414a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 >> 172.21.15.67:0/3196303598 conn(0x7ff684067d90 msgr2=0x7ff684073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 shutdown_connections 2024-04-16T13:05:50.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:50.830+0000 7ff68aa00640 1 -- 172.21.15.67:0/3196303598 wait complete. 2024-04-16T13:05:50.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-16T13:05:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.061+0000 7f12ad200640 1 Processor -- start 2024-04-16T13:05:51.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.061+0000 7f12ad200640 1 -- start start 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12ad200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12a8072a90 0x7f12a80d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12ad200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a80d0970 0x7f12a806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12ad200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8073130 con 0x7f12a815c680 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12ad200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f12a8073d40 con 0x7f12a8072a90 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12ad200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12a8072ed0 con 0x7f12a80d0970 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12a6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12a8072a90 0x7f12a80d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12a6a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f12a8072a90 0x7f12a80d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58100/0 (socket says 172.21.15.67:58100) 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.063+0000 7f12a6a00640 1 -- 172.21.15.67:0/4039555486 learned_addr learned my addr 172.21.15.67:0/4039555486 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.064+0000 7f12a7e00640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a80d0970 0x7f12a806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.064+0000 7f12a6a00640 1 -- 172.21.15.67:0/4039555486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a80d0970 msgr2=0x7f12a806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:51.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.064+0000 7f12a6a00640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a80d0970 0x7f12a806dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.064+0000 7f12a6a00640 1 -- 172.21.15.67:0/4039555486 >> v1:172.21.15.82:6789/0 conn(0x7f12a815c680 legacy=0x7f12a8160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:51.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.064+0000 7f12a6a00640 1 -- 172.21.15.67:0/4039555486 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a8073410 con 0x7f12a8072a90 2024-04-16T13:05:51.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.065+0000 7f12a6a00640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a80d0430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1294009870 tx=0x7f129402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7309b798b9c41b79 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12a6000640 1 -- 172.21.15.67:0/4039555486 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12940317c0 con 0x7f12a8072a90 2024-04-16T13:05:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12a6000640 1 -- 172.21.15.67:0/4039555486 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1294037070 con 0x7f12a8072a90 2024-04-16T13:05:51.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12a6000640 1 -- 172.21.15.67:0/4039555486 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1294031b80 con 0x7f12a8072a90 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 -- 172.21.15.67:0/4039555486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 msgr2=0x7f12a80d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a80d0430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1294009870 tx=0x7f129402b860 comp rx=0 tx=0).stop 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 -- 172.21.15.67:0/4039555486 shutdown_connections 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a80d0970 0x7f12a806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 --2- 172.21.15.67:0/4039555486 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a80d0430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.066+0000 7f12ad200640 1 -- 172.21.15.67:0/4039555486 >> 172.21.15.67:0/4039555486 conn(0x7f12a806bc00 msgr2=0x7f12a806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.067+0000 7f12ad200640 1 -- 172.21.15.67:0/4039555486 shutdown_connections 2024-04-16T13:05:51.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.067+0000 7f12ad200640 1 -- 172.21.15.67:0/4039555486 wait complete. 2024-04-16T13:05:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.068+0000 7f12ad200640 1 Processor -- start 2024-04-16T13:05:51.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.068+0000 7f12ad200640 1 -- start start 2024-04-16T13:05:51.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a80d0970 0x7f12a809c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a815c680 0x7f12a809ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12a806e2d0 con 0x7f12a8072a90 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12a80739d0 con 0x7f12a80d0970 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.069+0000 7f12ad200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f12a806e450 con 0x7f12a815c680 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58102/0 (socket says 172.21.15.67:58102) 2024-04-16T13:05:51.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 -- 172.21.15.67:0/551748834 learned_addr learned my addr 172.21.15.67:0/551748834 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 -- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a815c680 msgr2=0x7f12a809ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a815c680 0x7f12a809ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 -- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a80d0970 msgr2=0x7f12a809c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a80d0970 0x7f12a809c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 -- 172.21.15.67:0/551748834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a81f2bf0 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.070+0000 7f12a7400640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f129800b3f0 tx=0x7f129800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.071+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298015020 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.071+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298011830 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.071+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298011c20 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.071+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a809d030 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.071+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a809d5f0 con 0x7f12a8072a90 2024-04-16T13:05:51.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.072+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a8075bd0 con 0x7f12a8072a90 2024-04-16T13:05:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.073+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1298018020 con 0x7f12a8072a90 2024-04-16T13:05:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.074+0000 7f129f400640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 0x7f128806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.074+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f129808bb60 con 0x7f12a8072a90 2024-04-16T13:05:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.075+0000 7f12a6a00640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 0x7f128806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:51.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.076+0000 7f12a6a00640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 0x7f128806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1294036000 tx=0x7f1294030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:51.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.078+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f129801f030 con 0x7f12a8072a90 2024-04-16T13:05:51.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.360+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f12a80b0e20 con 0x7f12a8072a90 2024-04-16T13:05:51.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.736+0000 7f129f400640 1 -- 172.21.15.67:0/551748834 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v84) ==== 147+0+0 (secure 0 0 0) 0x7f1298059b90 con 0x7f12a8072a90 2024-04-16T13:05:51.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 msgr2=0x7f128806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 0x7f128806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1294036000 tx=0x7f1294030000 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 msgr2=0x7f12a815abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f129800b3f0 tx=0x7f129800b8b0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 shutdown_connections 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f128806c8f0 0x7f128806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f12a815c680 0x7f12a809ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12a80d0970 0x7f12a809c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 --2- 172.21.15.67:0/551748834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12a8072a90 0x7f12a815abb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.740+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 >> 172.21.15.67:0/551748834 conn(0x7f12a806bc00 msgr2=0x7f12a80b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.741+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 shutdown_connections 2024-04-16T13:05:51.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.741+0000 7f12ad200640 1 -- 172.21.15.67:0/551748834 wait complete. 2024-04-16T13:05:51.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-16T13:05:51.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.996+0000 7fb6c7200640 1 Processor -- start 2024-04-16T13:05:51.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.996+0000 7fb6c7200640 1 -- start start 2024-04-16T13:05:51.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.997+0000 7fb6c7200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6c806c130 0x7fb6c80ae990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.997+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6c80aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.997+0000 7fb6c7200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c8070310 con 0x7fb6c815e9c0 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.997+0000 7fb6c7200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c80ae500 con 0x7fb6c806c130 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.997+0000 7fb6c7200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80b6590 con 0x7fb6c806fe30 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c5e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb6c815e9c0 0x7fb6c806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51410/0 (socket says 172.21.15.67:51410) 2024-04-16T13:05:52.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c5e00640 1 -- 172.21.15.67:0/1639357371 learned_addr learned my addr 172.21.15.67:0/1639357371 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c5400640 1 --2- 172.21.15.67:0/1639357371 >> v2:172.21.15.82:3300/0 conn(0x7fb6c806c130 0x7fb6c80ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c6800640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6c80aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083020518 0 0) 0x7fb6c8070310 con 0x7fb6c815e9c0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.998+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6ac003520 con 0x7fb6c815e9c0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4206005882 0 0) 0x7fb6ac003520 con 0x7fb6c815e9c0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 msgr2=0x7fb6c80aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6c80aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 >> v2:172.21.15.82:3300/0 conn(0x7fb6c806c130 msgr2=0x7fb6c80ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 --2- 172.21.15.67:0/1639357371 >> v2:172.21.15.82:3300/0 conn(0x7fb6c806c130 0x7fb6c80ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c80b6870 con 0x7fb6c815e9c0 2024-04-16T13:05:52.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fb6c0001a10 con 0x7fb6c815e9c0 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 >> v1:172.21.15.67:6789/0 conn(0x7fb6c815e9c0 legacy=0x7fb6c806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6ac003f30 0x7fb6ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80ae500 con 0x7fb6ac004d40 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80b6590 con 0x7fb6ac003f30 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac00ba10 con 0x7fb6c806fe30 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:51.999+0000 7fb6c6800640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c5e00640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c5400640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6ac003f30 0x7fb6ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c6800640 1 -- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 msgr2=0x7fb6ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c6800640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c806fe30 0x7fb6ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c6800640 1 -- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6ac003f30 msgr2=0x7fb6ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c6800640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6ac003f30 0x7fb6ac004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.000+0000 7fb6c6800640 1 -- 172.21.15.67:0/1639357371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac003520 con 0x7fb6ac004d40 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.001+0000 7fb6c6800640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6ac0051c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800ba00 tx=0x7fb6ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda7033588eec1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.001+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8036020 con 0x7fb6ac004d40 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.001+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b8032620 con 0x7fb6ac004d40 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.001+0000 7fb6c4a00640 1 -- 172.21.15.67:0/1639357371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800b600 con 0x7fb6ac004d40 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 -- 172.21.15.67:0/1639357371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 msgr2=0x7fb6ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 --2- 172.21.15.67:0/1639357371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6ac0051c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800ba00 tx=0x7fb6ac005830 comp rx=0 tx=0).stop 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c6800640 1 -- 172.21.15.67:0/1639357371 reap_dead start 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 -- 172.21.15.67:0/1639357371 shutdown_connections 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 -- 172.21.15.67:0/1639357371 >> 172.21.15.67:0/1639357371 conn(0x7fb6c80732c0 msgr2=0x7fb6c809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 -- 172.21.15.67:0/1639357371 shutdown_connections 2024-04-16T13:05:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.002+0000 7fb6c7200640 1 -- 172.21.15.67:0/1639357371 wait complete. 2024-04-16T13:05:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.004+0000 7fb6c7200640 1 Processor -- start 2024-04-16T13:05:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.004+0000 7fb6c7200640 1 -- start start 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c8153510 0x7fb6c815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c8148180 0x7fb6c815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80b6330 con 0x7fb6ac004d40 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80b61b0 con 0x7fb6c8153510 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c7200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80b0cc0 con 0x7fb6c8148180 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41688/0 (socket says 172.21.15.67:41688) 2024-04-16T13:05:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 -- 172.21.15.67:0/371896472 learned_addr learned my addr 172.21.15.67:0/371896472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 -- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c8148180 msgr2=0x7fb6c815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c8148180 0x7fb6c815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5e00640 1 -- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c8153510 msgr2=0x7fb6c815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.005+0000 7fb6c5400640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c8153510 0x7fb6c815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6c5e00640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c8153510 0x7fb6c815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6c5e00640 1 -- 172.21.15.67:0/371896472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c8153a20 con 0x7fb6ac004d40 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6c5e00640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007ab0 tx=0x7fb6c000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000ee90 con 0x7fb6ac004d40 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0018070 con 0x7fb6ac004d40 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0013660 con 0x7fb6ac004d40 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c8153d00 con 0x7fb6ac004d40 2024-04-16T13:05:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.006+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c81542c0 con 0x7fb6ac004d40 2024-04-16T13:05:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.007+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c8154490 con 0x7fb6ac004d40 2024-04-16T13:05:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.008+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6c0013800 con 0x7fb6ac004d40 2024-04-16T13:05:52.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.009+0000 7fb6be000640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 0x7fb6a406efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.009+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb6c008c670 con 0x7fb6ac004d40 2024-04-16T13:05:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.010+0000 7fb6c5400640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 0x7fb6a406efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.011+0000 7fb6c5400640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 0x7fb6a406efd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8158bd0 tx=0x7fb6b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.015+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb6c005a680 con 0x7fb6ac004d40 2024-04-16T13:05:52.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.218+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb6c81584c0 con 0x7fb6ac004d40 2024-04-16T13:05:52.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.226+0000 7fb6be000640 1 -- 172.21.15.67:0/371896472 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb6c0059f80 con 0x7fb6ac004d40 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.228+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 msgr2=0x7fb6a406efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.228+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 0x7fb6a406efd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8158bd0 tx=0x7fb6b0008040 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.228+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 msgr2=0x7fb6c8152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007ab0 tx=0x7fb6c000e530 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 shutdown_connections 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb6a406cb10 0x7fb6a406efd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb6c8148180 0x7fb6c815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c8153510 0x7fb6c815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 --2- 172.21.15.67:0/371896472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6ac004d40 0x7fb6c8152fd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 >> 172.21.15.67:0/371896472 conn(0x7fb6c80732c0 msgr2=0x7fb6c806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:52.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 shutdown_connections 2024-04-16T13:05:52.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.229+0000 7fb6c7200640 1 -- 172.21.15.67:0/371896472 wait complete. 2024-04-16T13:05:52.251 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-16T13:05:52.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T13:05:52.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-16T13:05:52.500 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-16T13:05:52.500 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:52.500 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:52.562 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:52.562 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:52.619 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:52.619 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:52.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.901+0000 7f6d34800640 1 Processor -- start 2024-04-16T13:05:52.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.901+0000 7f6d34800640 1 -- start start 2024-04-16T13:05:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d34800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d2c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d34800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d2c071e50 0x7f6d2c0722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d34800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2c06dd50 con 0x7f6d2c146150 2024-04-16T13:05:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d34800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2c15d4e0 con 0x7f6d2c071e50 2024-04-16T13:05:52.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d34800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c15d7c0 con 0x7f6d2c0cec90 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d31e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6d2c146150 0x7f6d2c15cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51422/0 (socket says 172.21.15.67:51422) 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.903+0000 7f6d31e00640 1 -- 172.21.15.67:0/1882435283 learned_addr learned my addr 172.21.15.67:0/1882435283 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d31400640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d2c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d32800640 1 --2- 172.21.15.67:0/1882435283 >> v2:172.21.15.82:3300/0 conn(0x7f6d2c071e50 0x7f6d2c0722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126814531 0 0) 0x7f6d2c06dd50 con 0x7f6d2c146150 2024-04-16T13:05:52.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d14003520 con 0x7f6d2c146150 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234263439 0 0) 0x7f6d14003520 con 0x7f6d2c146150 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 msgr2=0x7f6d2c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d2c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 >> v2:172.21.15.82:3300/0 conn(0x7f6d2c071e50 msgr2=0x7f6d2c0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 --2- 172.21.15.67:0/1882435283 >> v2:172.21.15.82:3300/0 conn(0x7f6d2c071e50 0x7f6d2c0722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c15daa0 con 0x7f6d2c146150 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f6d20001670 con 0x7f6d2c146150 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.904+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 >> v1:172.21.15.67:6789/0 conn(0x7f6d2c146150 legacy=0x7f6d2c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14004d40 0x7f6d140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c15d4e0 con 0x7f6d14003f80 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c15d7c0 con 0x7f6d14004d40 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1400baf0 con 0x7f6d2c0cec90 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d31400640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d32800640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14004d40 0x7f6d140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.905+0000 7f6d31e00640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d31400640 1 -- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 msgr2=0x7f6d140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d31400640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cec90 0x7f6d140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d31400640 1 -- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14004d40 msgr2=0x7f6d140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d31400640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14004d40 0x7f6d140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d31400640 1 -- 172.21.15.67:0/1882435283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d14003520 con 0x7f6d14003f80 2024-04-16T13:05:52.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.906+0000 7f6d32800640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d14004d40 0x7f6d140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:52.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.907+0000 7f6d31400640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d14004800 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009ac0 tx=0x7f6d14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7979953bd4849c31 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.907+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c039070 con 0x7f6d14003f80 2024-04-16T13:05:52.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.907+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c02c6b0 con 0x7f6d14003f80 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.907+0000 7f6d30a00640 1 -- 172.21.15.67:0/1882435283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c009690 con 0x7f6d14003f80 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 -- 172.21.15.67:0/1882435283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 msgr2=0x7f6d14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 --2- 172.21.15.67:0/1882435283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d14004800 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009ac0 tx=0x7f6d14005830 comp rx=0 tx=0).stop 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d32800640 1 -- 172.21.15.67:0/1882435283 reap_dead start 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 -- 172.21.15.67:0/1882435283 shutdown_connections 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 -- 172.21.15.67:0/1882435283 >> 172.21.15.67:0/1882435283 conn(0x7f6d2c0b2210 msgr2=0x7f6d2c0b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 -- 172.21.15.67:0/1882435283 shutdown_connections 2024-04-16T13:05:52.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.908+0000 7f6d34800640 1 -- 172.21.15.67:0/1882435283 wait complete. 2024-04-16T13:05:52.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.910+0000 7f6d34800640 1 Processor -- start 2024-04-16T13:05:52.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.910+0000 7f6d34800640 1 -- start start 2024-04-16T13:05:52.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cbd20 0x7f6d2c1f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d2c0cc1a0 0x7f6d2c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c15e250 con 0x7f6d14003f80 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c15e0d0 con 0x7f6d2c0cc1a0 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d34800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c15e3d0 con 0x7f6d2c0cbd20 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.911+0000 7f6d31e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41710/0 (socket says 172.21.15.67:41710) 2024-04-16T13:05:52.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 -- 172.21.15.67:0/2600291335 learned_addr learned my addr 172.21.15.67:0/2600291335 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31400640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cbd20 0x7f6d2c1f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d32800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d2c0cc1a0 0x7f6d2c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 -- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cbd20 msgr2=0x7f6d2c1f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cbd20 0x7f6d2c1f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 -- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d2c0cc1a0 msgr2=0x7f6d2c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:52.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d2c0cc1a0 0x7f6d2c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 -- 172.21.15.67:0/2600291335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c0adcd0 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.912+0000 7f6d31e00640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e780 tx=0x7f6d2000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.913+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000c870 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.913+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d20018070 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.913+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000cc70 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.913+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c0adfb0 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.913+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c0ae570 con 0x7f6d14003f80 2024-04-16T13:05:52.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.914+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2c075bd0 con 0x7f6d14003f80 2024-04-16T13:05:52.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.915+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d2001d460 con 0x7f6d14003f80 2024-04-16T13:05:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.916+0000 7f6d26000640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.916+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6d2008bed0 con 0x7f6d14003f80 2024-04-16T13:05:52.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.917+0000 7f6d31400640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:52.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.918+0000 7f6d31400640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 0x7f6d1006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c036000 tx=0x7f6d1c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:52.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:52.920+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6d20059e60 con 0x7f6d14003f80 2024-04-16T13:05:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.123+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d2c0d0240 con 0x7f6d14003f80 2024-04-16T13:05:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.126+0000 7f6d26000640 1 -- 172.21.15.67:0/2600291335 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f6d20059760 con 0x7f6d14003f80 2024-04-16T13:05:53.128 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:53.128 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 msgr2=0x7f6d1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 0x7f6d1006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c036000 tx=0x7f6d1c030000 comp rx=0 tx=0).stop 2024-04-16T13:05:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 msgr2=0x7f6d2c0b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000e780 tx=0x7f6d2000ec40 comp rx=0 tx=0).stop 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 shutdown_connections 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f6d1006c920 0x7f6d1006ede0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d2c0cc1a0 0x7f6d2c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f6d2c0cbd20 0x7f6d2c1f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 --2- 172.21.15.67:0/2600291335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6d14003f80 0x7f6d2c0b4e70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 >> 172.21.15.67:0/2600291335 conn(0x7f6d2c0b2210 msgr2=0x7f6d2c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 shutdown_connections 2024-04-16T13:05:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.129+0000 7f6d34800640 1 -- 172.21.15.67:0/2600291335 wait complete. 2024-04-16T13:05:53.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:53.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:53.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.375+0000 7f45e0200640 1 Processor -- start 2024-04-16T13:05:53.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.375+0000 7f45e0200640 1 -- start start 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.376+0000 7f45e0200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 0x7f45d815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.376+0000 7f45e0200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45d815f8f0 0x7f45d80cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.376+0000 7f45e0200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d8160000 con 0x7f45d80d1570 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.376+0000 7f45e0200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f45d81602e0 con 0x7f45d815f8f0 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.376+0000 7f45e0200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45d815fda0 con 0x7f45d815cac0 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45d815f8f0 0x7f45d80cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f45d815f8f0 0x7f45d80cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41714/0 (socket says 172.21.15.67:41714) 2024-04-16T13:05:53.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 -- 172.21.15.67:0/2418396551 learned_addr learned my addr 172.21.15.67:0/2418396551 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45dce00640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 0x7f45d815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 -- 172.21.15.67:0/2418396551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 msgr2=0x7f45d815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 0x7f45d815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.377+0000 7f45de200640 1 -- 172.21.15.67:0/2418396551 >> v1:172.21.15.82:6789/0 conn(0x7f45d80d1570 legacy=0x7f45d80d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.378+0000 7f45de200640 1 -- 172.21.15.67:0/2418396551 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d815bfe0 con 0x7f45d815f8f0 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.378+0000 7f45dce00640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 0x7f45d815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:53.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.379+0000 7f45de200640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d815f8f0 0x7f45d80cc020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009e80 tx=0x7f45d002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936c50b30a9e148 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.379+0000 7f45d7e00640 1 -- 172.21.15.67:0/2418396551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d002cae0 con 0x7f45d815f8f0 2024-04-16T13:05:53.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.379+0000 7f45d7e00640 1 -- 172.21.15.67:0/2418396551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d002cc80 con 0x7f45d815f8f0 2024-04-16T13:05:53.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.379+0000 7f45d7e00640 1 -- 172.21.15.67:0/2418396551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0034610 con 0x7f45d815f8f0 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 -- 172.21.15.67:0/2418396551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d815f8f0 msgr2=0x7f45d80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d815f8f0 0x7f45d80cc020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009e80 tx=0x7f45d002bf40 comp rx=0 tx=0).stop 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 -- 172.21.15.67:0/2418396551 shutdown_connections 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d815f8f0 0x7f45d80cc020 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 --2- 172.21.15.67:0/2418396551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815cac0 0x7f45d815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 -- 172.21.15.67:0/2418396551 >> 172.21.15.67:0/2418396551 conn(0x7f45d80734a0 msgr2=0x7f45d809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 -- 172.21.15.67:0/2418396551 shutdown_connections 2024-04-16T13:05:53.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.380+0000 7f45e0200640 1 -- 172.21.15.67:0/2418396551 wait complete. 2024-04-16T13:05:53.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.382+0000 7f45e0200640 1 Processor -- start 2024-04-16T13:05:53.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.382+0000 7f45e0200640 1 -- start start 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 0x7f45d8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 0x7f45d806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45d815bc10 con 0x7f45d80d1570 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45d815c5a0 con 0x7f45d815cac0 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45e0200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f45d815bd90 con 0x7f45d815f8f0 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41716/0 (socket says 172.21.15.67:41716) 2024-04-16T13:05:53.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 -- 172.21.15.67:0/2553347527 learned_addr learned my addr 172.21.15.67:0/2553347527 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45de200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 0x7f45d806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dce00640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 0x7f45d8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 -- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 msgr2=0x7f45d806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 0x7f45d806f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 -- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 msgr2=0x7f45d8157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 0x7f45d8157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dd800640 1 -- 172.21.15.67:0/2553347527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d81f4770 con 0x7f45d80d1570 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45de200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 0x7f45d806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.383+0000 7f45dce00640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 0x7f45d8157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45dd800640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c400 tx=0x7f45cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0052d0 con 0x7f45d80d1570 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc005490 con 0x7f45d80d1570 2024-04-16T13:05:53.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc007260 con 0x7f45d80d1570 2024-04-16T13:05:53.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d81f4a50 con 0x7f45d80d1570 2024-04-16T13:05:53.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.384+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d81f5010 con 0x7f45d80d1570 2024-04-16T13:05:53.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.385+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d8068a70 con 0x7f45d80d1570 2024-04-16T13:05:53.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.386+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45cc007400 con 0x7f45d80d1570 2024-04-16T13:05:53.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.387+0000 7f45d5600640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.387+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f45cc08b480 con 0x7f45d80d1570 2024-04-16T13:05:53.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.388+0000 7f45dce00640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.389+0000 7f45dce00640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 0x7f45b806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45d80cdfc0 tx=0x7f45c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.393+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45cc0594b0 con 0x7f45d80d1570 2024-04-16T13:05:53.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.607+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45d8073b70 con 0x7f45d80d1570 2024-04-16T13:05:53.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.608+0000 7f45d5600640 1 -- 172.21.15.67:0/2553347527 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f45cc058db0 con 0x7f45d80d1570 2024-04-16T13:05:53.609 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:53.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 msgr2=0x7f45b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 0x7f45b806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45d80cdfc0 tx=0x7f45c4008040 comp rx=0 tx=0).stop 2024-04-16T13:05:53.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 msgr2=0x7f45d8150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c400 tx=0x7f45cc00c8c0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 shutdown_connections 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f45d815f8f0 0x7f45d806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45d815cac0 0x7f45d8157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 --2- 172.21.15.67:0/2553347527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d80d1570 0x7f45d8150680 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 >> 172.21.15.67:0/2553347527 conn(0x7f45d80734a0 msgr2=0x7f45d809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 shutdown_connections 2024-04-16T13:05:53.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.611+0000 7f45e0200640 1 -- 172.21.15.67:0/2553347527 wait complete. 2024-04-16T13:05:53.632 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.854+0000 7f1192600640 1 Processor -- start 2024-04-16T13:05:53.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.854+0000 7f1192600640 1 -- start start 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.855+0000 7f1192600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f118c13e880 0x7f118c15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.855+0000 7f1192600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f118c1418d0 0x7f118c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.855+0000 7f1192600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c15c290 con 0x7f118c0b56e0 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.855+0000 7f1192600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f118c0b5b10 con 0x7f118c1418d0 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.855+0000 7f1192600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f118c15c570 con 0x7f118c13e880 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f118c1418d0 0x7f118c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f118c1418d0 0x7f118c0b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41732/0 (socket says 172.21.15.67:41732) 2024-04-16T13:05:53.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 -- 172.21.15.67:0/3157867242 learned_addr learned my addr 172.21.15.67:0/3157867242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f118b400640 1 --2- 172.21.15.67:0/3157867242 >> v2:172.21.15.82:3300/0 conn(0x7f118c13e880 0x7f118c15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 -- 172.21.15.67:0/3157867242 >> v2:172.21.15.82:3300/0 conn(0x7f118c13e880 msgr2=0x7f118c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 --2- 172.21.15.67:0/3157867242 >> v2:172.21.15.82:3300/0 conn(0x7f118c13e880 0x7f118c15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 -- 172.21.15.67:0/3157867242 >> v1:172.21.15.82:6789/0 conn(0x7f118c0b56e0 legacy=0x7f118c0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:53.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.856+0000 7f1182a00640 1 -- 172.21.15.67:0/3157867242 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c15c850 con 0x7f118c1418d0 2024-04-16T13:05:53.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f1182a00640 1 --2- 172.21.15.67:0/3157867242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c1418d0 0x7f118c0b51a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f118c1454d0 tx=0x7f117402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1c2cec7f235895 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f118aa00640 1 -- 172.21.15.67:0/3157867242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174035020 con 0x7f118c1418d0 2024-04-16T13:05:53.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f118aa00640 1 -- 172.21.15.67:0/3157867242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1174031870 con 0x7f118c1418d0 2024-04-16T13:05:53.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f118aa00640 1 -- 172.21.15.67:0/3157867242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174031c40 con 0x7f118c1418d0 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f1192600640 1 -- 172.21.15.67:0/3157867242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c1418d0 msgr2=0x7f118c0b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.858+0000 7f1192600640 1 --2- 172.21.15.67:0/3157867242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c1418d0 0x7f118c0b51a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f118c1454d0 tx=0x7f117402b910 comp rx=0 tx=0).stop 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 -- 172.21.15.67:0/3157867242 shutdown_connections 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 --2- 172.21.15.67:0/3157867242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c1418d0 0x7f118c0b51a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 --2- 172.21.15.67:0/3157867242 >> v2:172.21.15.82:3300/0 conn(0x7f118c13e880 0x7f118c15bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 -- 172.21.15.67:0/3157867242 >> 172.21.15.67:0/3157867242 conn(0x7f118c067d90 msgr2=0x7f118c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 -- 172.21.15.67:0/3157867242 shutdown_connections 2024-04-16T13:05:53.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.859+0000 7f1192600640 1 -- 172.21.15.67:0/3157867242 wait complete. 2024-04-16T13:05:53.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.860+0000 7f1192600640 1 Processor -- start 2024-04-16T13:05:53.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.861+0000 7f1192600640 1 -- start start 2024-04-16T13:05:53.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.861+0000 7f1192600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 0x7f118c13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1192600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1192600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f118c1418d0 0x7f118c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1192600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f118c140370 con 0x7f118c13e880 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1192600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f118c141d60 con 0x7f118c0b56e0 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1192600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f118c1404f0 con 0x7f118c1418d0 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41734/0 (socket says 172.21.15.67:41734) 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 -- 172.21.15.67:0/3235122120 learned_addr learned my addr 172.21.15.67:0/3235122120 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f118b400640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 0x7f118c13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 -- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f118c1418d0 msgr2=0x7f118c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f118c1418d0 0x7f118c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 -- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 msgr2=0x7f118c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 0x7f118c13a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f1182a00640 1 -- 172.21.15.67:0/3235122120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c144aa0 con 0x7f118c13e880 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.862+0000 7f118b400640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 0x7f118c13a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:53.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1182a00640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1174000c00 tx=0x7f11740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174040070 con 0x7f118c13e880 2024-04-16T13:05:53.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1174030d00 con 0x7f118c13e880 2024-04-16T13:05:53.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174035040 con 0x7f118c13e880 2024-04-16T13:05:53.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c1444e0 con 0x7f118c13e880 2024-04-16T13:05:53.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.863+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c156410 con 0x7f118c13e880 2024-04-16T13:05:53.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.864+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c068a70 con 0x7f118c13e880 2024-04-16T13:05:53.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.865+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f117404b060 con 0x7f118c13e880 2024-04-16T13:05:53.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.866+0000 7f1183e00640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:53.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.866+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f11740add70 con 0x7f118c13e880 2024-04-16T13:05:53.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.867+0000 7f118b400640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:53.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.868+0000 7f118b400640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 0x7f116806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f117c007330 tx=0x7f117c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:53.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:53.871+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f117407bd90 con 0x7f118c13e880 2024-04-16T13:05:54.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.077+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f118c155ea0 con 0x7f118c13e880 2024-04-16T13:05:54.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.078+0000 7f1183e00640 1 -- 172.21.15.67:0/3235122120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f117407b690 con 0x7f118c13e880 2024-04-16T13:05:54.079 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:54.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 msgr2=0x7f116806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 0x7f116806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f117c007330 tx=0x7f117c00b040 comp rx=0 tx=0).stop 2024-04-16T13:05:54.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 msgr2=0x7f118c143bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1174000c00 tx=0x7f11740046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 shutdown_connections 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f116806c8f0 0x7f116806edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f118c1418d0 0x7f118c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f118c13e880 0x7f118c143bb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 --2- 172.21.15.67:0/3235122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f118c0b56e0 0x7f118c13a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 >> 172.21.15.67:0/3235122120 conn(0x7f118c067d90 msgr2=0x7f118c072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 shutdown_connections 2024-04-16T13:05:54.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.081+0000 7f1192600640 1 -- 172.21.15.67:0/3235122120 wait complete. 2024-04-16T13:05:54.101 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:54.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.326+0000 7fb1dfe00640 1 Processor -- start 2024-04-16T13:05:54.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.326+0000 7fb1dfe00640 1 -- start start 2024-04-16T13:05:54.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1e00b7fd0 0x7fb1e009b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb1e009b9c0 0x7fb1e00d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e00cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e00b5e10 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e0160450 con 0x7fb1e009b9c0 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.327+0000 7fb1dfe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e009bf00 con 0x7fb1e00d0e10 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1e00b7fd0 0x7fb1e009b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1e00b7fd0 0x7fb1e009b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41746/0 (socket says 172.21.15.67:41746) 2024-04-16T13:05:54.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 -- 172.21.15.67:0/2742962259 learned_addr learned my addr 172.21.15.67:0/2742962259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1de000640 1 --2- 172.21.15.67:0/2742962259 >> v2:172.21.15.82:3300/0 conn(0x7fb1e009b9c0 0x7fb1e00d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1df400640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e00cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 -- 172.21.15.67:0/2742962259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 msgr2=0x7fb1e00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e00cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 -- 172.21.15.67:0/2742962259 >> v2:172.21.15.82:3300/0 conn(0x7fb1e009b9c0 msgr2=0x7fb1e00d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 --2- 172.21.15.67:0/2742962259 >> v2:172.21.15.82:3300/0 conn(0x7fb1e009b9c0 0x7fb1e00d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.328+0000 7fb1dea00640 1 -- 172.21.15.67:0/2742962259 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00b5520 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.329+0000 7fb1dea00640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e009b480 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1e006f8d0 tx=0x7fb1d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5b497aa6fe44e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dd600640 1 -- 172.21.15.67:0/2742962259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0035020 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dd600640 1 -- 172.21.15.67:0/2742962259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d0031870 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dd600640 1 -- 172.21.15.67:0/2742962259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0031c40 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 -- 172.21.15.67:0/2742962259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 msgr2=0x7fb1e009b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e009b480 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1e006f8d0 tx=0x7fb1d002b910 comp rx=0 tx=0).stop 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 -- 172.21.15.67:0/2742962259 shutdown_connections 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e00cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/2742962259 >> v2:172.21.15.82:3300/0 conn(0x7fb1e009b9c0 0x7fb1e00d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/2742962259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e009b480 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 -- 172.21.15.67:0/2742962259 >> 172.21.15.67:0/2742962259 conn(0x7fb1e00b4090 msgr2=0x7fb1e00b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 -- 172.21.15.67:0/2742962259 shutdown_connections 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.330+0000 7fb1dfe00640 1 -- 172.21.15.67:0/2742962259 wait complete. 2024-04-16T13:05:54.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.332+0000 7fb1dfe00640 1 Processor -- start 2024-04-16T13:05:54.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.332+0000 7fb1dfe00640 1 -- start start 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e009b9c0 0x7fb1e01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00b83b0 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00b5aa0 con 0x7fb1e009b9c0 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.333+0000 7fb1dfe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00d0550 con 0x7fb1e00d0e10 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41750/0 (socket says 172.21.15.67:41750) 2024-04-16T13:05:54.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 -- 172.21.15.67:0/3124527060 learned_addr learned my addr 172.21.15.67:0/3124527060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1dea00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e009b9c0 0x7fb1e01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1df400640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 -- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 msgr2=0x7fb1e0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 -- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e009b9c0 msgr2=0x7fb1e01591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e009b9c0 0x7fb1e01591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 -- 172.21.15.67:0/3124527060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00c6270 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.334+0000 7fb1de000640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc007e60 tx=0x7fb1cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.335+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014620 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.335+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc019070 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.335+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0149e0 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.335+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e00c6550 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.335+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e00c6b10 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.336+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e0075bd0 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.337+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1cc014b80 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.338+0000 7fb1d6a00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 0x7fb1c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.339+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1cc08c7d0 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.339+0000 7fb1dea00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 0x7fb1c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.340+0000 7fb1dea00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 0x7fb1c006ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036000 tx=0x7fb1d003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.344+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb1cc05a760 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.548+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb1e00b6e50 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.549+0000 7fb1d6a00640 1 -- 172.21.15.67:0/3124527060 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb1cc05a060 con 0x7fb1e00b7fd0 2024-04-16T13:05:54.550 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.551+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 msgr2=0x7fb1c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.551+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 0x7fb1c006ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0036000 tx=0x7fb1d003c040 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 msgr2=0x7fb1e00caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc007e60 tx=0x7fb1cc00e4b0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 shutdown_connections 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb1c006c920 0x7fb1c006ede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1e00d0e10 0x7fb1e0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1e00b7fd0 0x7fb1e00caf50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 --2- 172.21.15.67:0/3124527060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1e009b9c0 0x7fb1e01591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 >> 172.21.15.67:0/3124527060 conn(0x7fb1e00b4090 msgr2=0x7fb1e00b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:54.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 shutdown_connections 2024-04-16T13:05:54.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.552+0000 7fb1dfe00640 1 -- 172.21.15.67:0/3124527060 wait complete. 2024-04-16T13:05:54.573 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:54.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.798+0000 7f89e4a00640 1 Processor -- start 2024-04-16T13:05:54.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.798+0000 7f89e4a00640 1 -- start start 2024-04-16T13:05:54.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.800+0000 7f89e4a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89e00ce990 0x7f89e006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.800+0000 7f89e4a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.800+0000 7f89e4a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e006dec0 con 0x7f89e015cdc0 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.800+0000 7f89e4a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f89e0072780 con 0x7f89e00ce990 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.800+0000 7f89e4a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f89e006e7f0 con 0x7f89e0071de0 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89e00ce990 0x7f89e006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89e00ce990 0x7f89e006ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41752/0 (socket says 172.21.15.67:41752) 2024-04-16T13:05:54.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 -- 172.21.15.67:0/976680826 learned_addr learned my addr 172.21.15.67:0/976680826 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89dea00640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 -- 172.21.15.67:0/976680826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 msgr2=0x7f89e0072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 -- 172.21.15.67:0/976680826 >> v1:172.21.15.82:6789/0 conn(0x7f89e015cdc0 legacy=0x7f89e015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.801+0000 7f89df400640 1 -- 172.21.15.67:0/976680826 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e006e1a0 con 0x7f89e00ce990 2024-04-16T13:05:54.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.802+0000 7f89df400640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e00ce990 0x7f89e006ec80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea35a3fea6706571 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.803+0000 7f89de000640 1 -- 172.21.15.67:0/976680826 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00317c0 con 0x7f89e00ce990 2024-04-16T13:05:54.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.803+0000 7f89de000640 1 -- 172.21.15.67:0/976680826 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d0037070 con 0x7f89e00ce990 2024-04-16T13:05:54.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.803+0000 7f89de000640 1 -- 172.21.15.67:0/976680826 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0031b80 con 0x7f89e00ce990 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.803+0000 7f89e4a00640 1 -- 172.21.15.67:0/976680826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e00ce990 msgr2=0x7f89e006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.803+0000 7f89e4a00640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e00ce990 0x7f89e006ec80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d002b860 comp rx=0 tx=0).stop 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 -- 172.21.15.67:0/976680826 shutdown_connections 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 --2- 172.21.15.67:0/976680826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e00ce990 0x7f89e006ec80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 -- 172.21.15.67:0/976680826 >> 172.21.15.67:0/976680826 conn(0x7f89e0067d90 msgr2=0x7f89e006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 -- 172.21.15.67:0/976680826 shutdown_connections 2024-04-16T13:05:54.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.804+0000 7f89e4a00640 1 -- 172.21.15.67:0/976680826 wait complete. 2024-04-16T13:05:54.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.805+0000 7f89e4a00640 1 Processor -- start 2024-04-16T13:05:54.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.806+0000 7f89e4a00640 1 -- start start 2024-04-16T13:05:54.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.806+0000 7f89e4a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.806+0000 7f89e4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 0x7f89e01e5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89e4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89e4a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89e015db10 con 0x7f89e015cdc0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89e4a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00ced70 con 0x7f89e00ce990 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89e4a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f89e015ddc0 con 0x7f89e0071de0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41762/0 (socket says 172.21.15.67:41762) 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 -- 172.21.15.67:0/1455584286 learned_addr learned my addr 172.21.15.67:0/1455584286 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89df400640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dea00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 0x7f89e01e5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 -- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 msgr2=0x7f89e0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 -- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 msgr2=0x7f89e01e5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 0x7f89e01e5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dfe00640 1 -- 172.21.15.67:0/1455584286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e01f63d0 con 0x7f89e015cdc0 2024-04-16T13:05:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.807+0000 7f89dea00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 0x7f89e01e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:54.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89dfe00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f89d800b970 tx=0x7f89d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8019070 con 0x7f89e015cdc0 2024-04-16T13:05:54.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d800cb40 con 0x7f89e015cdc0 2024-04-16T13:05:54.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8014440 con 0x7f89e015cdc0 2024-04-16T13:05:54.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e01f66b0 con 0x7f89e015cdc0 2024-04-16T13:05:54.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.808+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e01f6c70 con 0x7f89e015cdc0 2024-04-16T13:05:54.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.809+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e0075bd0 con 0x7f89e015cdc0 2024-04-16T13:05:54.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.810+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89d801c070 con 0x7f89e015cdc0 2024-04-16T13:05:54.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.811+0000 7f89d7400640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:54.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.811+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f89d808bbf0 con 0x7f89e015cdc0 2024-04-16T13:05:54.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.812+0000 7f89df400640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.813+0000 7f89df400640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 0x7f89c006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f89d0036000 tx=0x7f89d003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:54.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:54.816+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89d8059b80 con 0x7f89e015cdc0 2024-04-16T13:05:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.019+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f89e01f7100 con 0x7f89e015cdc0 2024-04-16T13:05:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.020+0000 7f89d7400640 1 -- 172.21.15.67:0/1455584286 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f89d8059480 con 0x7f89e015cdc0 2024-04-16T13:05:55.021 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.022+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 msgr2=0x7f89c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.022+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 0x7f89c006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f89d0036000 tx=0x7f89d003d040 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.022+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 msgr2=0x7f89e00b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.022+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f89d800b970 tx=0x7f89d800be30 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 shutdown_connections 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89e015cdc0 0x7f89e00b4b40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89e00ce990 0x7f89e01e5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 --2- 172.21.15.67:0/1455584286 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f89e0071de0 0x7f89e0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 >> 172.21.15.67:0/1455584286 conn(0x7f89e0067d90 msgr2=0x7f89e00b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 shutdown_connections 2024-04-16T13:05:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.023+0000 7f89e4a00640 1 -- 172.21.15.67:0/1455584286 wait complete. 2024-04-16T13:05:55.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:05:55.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.274+0000 7fc607200640 1 Processor -- start 2024-04-16T13:05:55.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.274+0000 7fc607200640 1 -- start start 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6080ce990 0x7fc60806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc608072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc60815cdc0 0x7fc60815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc608072780 con 0x7fc6080ce990 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc60806e7f0 con 0x7fc60815cdc0 2024-04-16T13:05:55.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc607200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc60806dec0 con 0x7fc608071de0 2024-04-16T13:05:55.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.276+0000 7fc605e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6080ce990 0x7fc60806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6080ce990 0x7fc60806ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41776/0 (socket says 172.21.15.67:41776) 2024-04-16T13:05:55.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 -- 172.21.15.67:0/1042431958 learned_addr learned my addr 172.21.15.67:0/1042431958 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc606800640 1 --2- 172.21.15.67:0/1042431958 >> v2:172.21.15.82:3300/0 conn(0x7fc60815cdc0 0x7fc60815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605400640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc608072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 -- 172.21.15.67:0/1042431958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 msgr2=0x7fc608072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc608072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 -- 172.21.15.67:0/1042431958 >> v2:172.21.15.82:3300/0 conn(0x7fc60815cdc0 msgr2=0x7fc60815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 --2- 172.21.15.67:0/1042431958 >> v2:172.21.15.82:3300/0 conn(0x7fc60815cdc0 0x7fc60815d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.277+0000 7fc605e00640 1 -- 172.21.15.67:0/1042431958 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60806e1a0 con 0x7fc6080ce990 2024-04-16T13:05:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.278+0000 7fc605e00640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6080ce990 0x7fc60806ec80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc608160120 tx=0x7fc5f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dc4acab7f74bf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.279+0000 7fc604a00640 1 -- 172.21.15.67:0/1042431958 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f802e070 con 0x7fc6080ce990 2024-04-16T13:05:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.279+0000 7fc604a00640 1 -- 172.21.15.67:0/1042431958 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8037070 con 0x7fc6080ce990 2024-04-16T13:05:55.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.279+0000 7fc604a00640 1 -- 172.21.15.67:0/1042431958 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8031a00 con 0x7fc6080ce990 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.279+0000 7fc607200640 1 -- 172.21.15.67:0/1042431958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6080ce990 msgr2=0x7fc60806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.279+0000 7fc607200640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6080ce990 0x7fc60806ec80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc608160120 tx=0x7fc5f802b880 comp rx=0 tx=0).stop 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 -- 172.21.15.67:0/1042431958 shutdown_connections 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 --2- 172.21.15.67:0/1042431958 >> v2:172.21.15.82:3300/0 conn(0x7fc60815cdc0 0x7fc60815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc608072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 --2- 172.21.15.67:0/1042431958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6080ce990 0x7fc60806ec80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 -- 172.21.15.67:0/1042431958 >> 172.21.15.67:0/1042431958 conn(0x7fc608067d90 msgr2=0x7fc60806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 -- 172.21.15.67:0/1042431958 shutdown_connections 2024-04-16T13:05:55.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.280+0000 7fc607200640 1 -- 172.21.15.67:0/1042431958 wait complete. 2024-04-16T13:05:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.281+0000 7fc607200640 1 Processor -- start 2024-04-16T13:05:55.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.282+0000 7fc607200640 1 -- start start 2024-04-16T13:05:55.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.282+0000 7fc607200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc60814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc607200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 0x7fc6081e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc607200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc607200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc60815db10 con 0x7fc60815cdc0 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc607200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6080ced70 con 0x7fc6080ce990 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc607200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc60815d790 con 0x7fc608071de0 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41780/0 (socket says 172.21.15.67:41780) 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 -- 172.21.15.67:0/2055909396 learned_addr learned my addr 172.21.15.67:0/2055909396 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc605e00640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc60814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc605400640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 0x7fc6081e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 -- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 msgr2=0x7fc60814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc60814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 -- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 msgr2=0x7fc6081e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 0x7fc6081e56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc606800640 1 -- 172.21.15.67:0/2055909396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60814b2c0 con 0x7fc60815cdc0 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.283+0000 7fc605400640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 0x7fc6081e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:55.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc606800640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc600007e90 tx=0x7fc60000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:55.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600014420 con 0x7fc60815cdc0 2024-04-16T13:05:55.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600019070 con 0x7fc60815cdc0 2024-04-16T13:05:55.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600014800 con 0x7fc60815cdc0 2024-04-16T13:05:55.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6081f5730 con 0x7fc60815cdc0 2024-04-16T13:05:55.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.284+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6081f5cf0 con 0x7fc60815cdc0 2024-04-16T13:05:55.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.286+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc608072960 con 0x7fc60815cdc0 2024-04-16T13:05:55.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.287+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6000149a0 con 0x7fc60815cdc0 2024-04-16T13:05:55.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.288+0000 7fc5fe000640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 0x7fc5e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:55.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.288+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc60008c7d0 con 0x7fc60815cdc0 2024-04-16T13:05:55.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.289+0000 7fc605e00640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 0x7fc5e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:55.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.290+0000 7fc605e00640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 0x7fc5e806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8036000 tx=0x7fc5f803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:55.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.293+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc608072960 con 0x7fc60815cdc0 2024-04-16T13:05:55.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.508+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc608075bd0 con 0x7fc60815cdc0 2024-04-16T13:05:55.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.509+0000 7fc5fe000640 1 -- 172.21.15.67:0/2055909396 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fc60814b2c0 con 0x7fc60815cdc0 2024-04-16T13:05:55.510 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 msgr2=0x7fc5e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 0x7fc5e806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8036000 tx=0x7fc5f803d040 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 msgr2=0x7fc6081e5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc600007e90 tx=0x7fc60000e4b0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 shutdown_connections 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc5e806c920 0x7fc5e806ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc60815cdc0 0x7fc6081e5c30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6080ce990 0x7fc6081e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 --2- 172.21.15.67:0/2055909396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc608071de0 0x7fc60814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 >> 172.21.15.67:0/2055909396 conn(0x7fc608067d90 msgr2=0x7fc60815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 shutdown_connections 2024-04-16T13:05:55.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:55.511+0000 7fc607200640 1 -- 172.21.15.67:0/2055909396 wait complete. 2024-04-16T13:05:55.534 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T13:05:55.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:55.534 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-16T13:05:55.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:05:55.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:55.642 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T13:05:55.694 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:05:55.694 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:55.751 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:05:55.751 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:55.807 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:05:55.807 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:55.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:56.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.090+0000 7f181ce00640 1 Processor -- start 2024-04-16T13:05:56.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.090+0000 7f181ce00640 1 -- start start 2024-04-16T13:05:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f181ce00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18180ad5d0 0x7f181806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f181ce00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1818160800 con 0x7f181815c6f0 2024-04-16T13:05:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f181ce00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1818160ad0 con 0x7f18180ad170 2024-04-16T13:05:56.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f181ce00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1818161090 con 0x7f18180ad5d0 2024-04-16T13:05:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f1817400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f181815c6f0 0x7f18181600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51426/0 (socket says 172.21.15.67:51426) 2024-04-16T13:05:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.092+0000 7f1817400640 1 -- 172.21.15.67:0/1205308853 learned_addr learned my addr 172.21.15.67:0/1205308853 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1817e00640 1 --2- 172.21.15.67:0/1205308853 >> v2:172.21.15.82:3300/0 conn(0x7f18180ad5d0 0x7f181806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793976019 0 0) 0x7f1818160800 con 0x7f181815c6f0 2024-04-16T13:05:56.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003520 con 0x7f181815c6f0 2024-04-16T13:05:56.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1668402839 0 0) 0x7f17fc003520 con 0x7f181815c6f0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 >> v2:172.21.15.82:3300/0 conn(0x7f18180ad5d0 msgr2=0x7f181806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 --2- 172.21.15.67:0/1205308853 >> v2:172.21.15.82:3300/0 conn(0x7f18180ad5d0 0x7f181806ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 >> v1:172.21.15.82:6789/0 conn(0x7f18180ad170 legacy=0x7f181806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1818160db0 con 0x7f181815c6f0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f1808001670 con 0x7f181815c6f0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 >> v1:172.21.15.67:6789/0 conn(0x7f181815c6f0 legacy=0x7f18181600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17fc0039b0 0x7f17fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc004800 0x7f17fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 0x7f17fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc00c030 con 0x7f17fc0051c0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc00c1e0 con 0x7f17fc0039b0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.093+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc00c3e0 con 0x7f17fc004800 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 0x7f17fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817400640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17fc0039b0 0x7f17fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1816a00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc004800 0x7f17fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 -- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc004800 msgr2=0x7f17fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc004800 0x7f17fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 -- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17fc0039b0 msgr2=0x7f17fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17fc0039b0 0x7f17fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.094+0000 7f1817e00640 1 -- 172.21.15.67:0/1205308853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc003520 con 0x7f17fc0051c0 2024-04-16T13:05:56.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.095+0000 7f1817400640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17fc0039b0 0x7f17fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:05:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.095+0000 7f1817e00640 1 -- 172.21.15.67:0/1205308853 reap_dead start 2024-04-16T13:05:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f1817e00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 0x7f17fc00b9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1810009fc0 tx=0x7f17fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f346190331134df server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810009c10 con 0x7f17fc0051c0 2024-04-16T13:05:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181002cca0 con 0x7f17fc0051c0 2024-04-16T13:05:56.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f1816000640 1 -- 172.21.15.67:0/1205308853 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810003bd0 con 0x7f17fc0051c0 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f181ce00640 1 -- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 msgr2=0x7f17fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.096+0000 7f181ce00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 0x7f17fc00b9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1810009fc0 tx=0x7f17fc005830 comp rx=0 tx=0).stop 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.097+0000 7f181ce00640 1 -- 172.21.15.67:0/1205308853 shutdown_connections 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.097+0000 7f181ce00640 1 --2- 172.21.15.67:0/1205308853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17fc0051c0 0x7f17fc00b9c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.097+0000 7f181ce00640 1 -- 172.21.15.67:0/1205308853 >> 172.21.15.67:0/1205308853 conn(0x7f18180d0220 msgr2=0x7f18180d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.097+0000 7f181ce00640 1 -- 172.21.15.67:0/1205308853 shutdown_connections 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.097+0000 7f181ce00640 1 -- 172.21.15.67:0/1205308853 wait complete. 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.098+0000 7f181ce00640 1 Processor -- start 2024-04-16T13:05:56.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.099+0000 7f181ce00640 1 -- start start 2024-04-16T13:05:56.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc0051c0 0x7f1818142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18180ceb00 0x7f181814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f18180ada60 con 0x7f18180b4550 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f181806e110 con 0x7f18180ceb00 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f181ce00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f18180af200 con 0x7f17fc0051c0 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41800/0 (socket says 172.21.15.67:41800) 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 -- 172.21.15.67:0/939662247 learned_addr learned my addr 172.21.15.67:0/939662247 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817400640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc0051c0 0x7f1818142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1816a00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18180ceb00 0x7f181814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 -- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc0051c0 msgr2=0x7f1818142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc0051c0 0x7f1818142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 -- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18180ceb00 msgr2=0x7f181814bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18180ceb00 0x7f181814bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.100+0000 7f1817e00640 1 -- 172.21.15.67:0/939662247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1818156b80 con 0x7f18180b4550 2024-04-16T13:05:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f1817e00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f181002c6d0 tx=0x7f1810009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810043020 con 0x7f18180b4550 2024-04-16T13:05:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181002ce50 con 0x7f18180b4550 2024-04-16T13:05:56.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810003e10 con 0x7f18180b4550 2024-04-16T13:05:56.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18181565c0 con 0x7f18180b4550 2024-04-16T13:05:56.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.101+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18180cc420 con 0x7f18180b4550 2024-04-16T13:05:56.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.103+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18180cc620 con 0x7f18180b4550 2024-04-16T13:05:56.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.104+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1810046020 con 0x7f18180b4550 2024-04-16T13:05:56.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.104+0000 7f180f400640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.105+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f18100ae690 con 0x7f18180b4550 2024-04-16T13:05:56.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.105+0000 7f1817400640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.106+0000 7f1817400640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 0x7f17f806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1808001200 tx=0x7f1808009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.109+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18180cc620 con 0x7f18180b4550 2024-04-16T13:05:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.316+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1818075bd0 con 0x7f18180b4550 2024-04-16T13:05:56.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.318+0000 7f180f400640 1 -- 172.21.15.67:0/939662247 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f181004d020 con 0x7f18180b4550 2024-04-16T13:05:56.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:56.320 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 msgr2=0x7f17f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 0x7f17f806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1808001200 tx=0x7f1808009040 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 msgr2=0x7f18180b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f181002c6d0 tx=0x7f1810009750 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 shutdown_connections 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18180b4550 0x7f18180b49d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18180ceb00 0x7f181814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 --2- 172.21.15.67:0/939662247 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f17fc0051c0 0x7f1818142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.321+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 >> 172.21.15.67:0/939662247 conn(0x7f18180d0220 msgr2=0x7f181815e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.322+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 shutdown_connections 2024-04-16T13:05:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.322+0000 7f181ce00640 1 -- 172.21.15.67:0/939662247 wait complete. 2024-04-16T13:05:56.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:56.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.558+0000 7fb9ecc00640 1 Processor -- start 2024-04-16T13:05:56.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.558+0000 7fb9ecc00640 1 -- start start 2024-04-16T13:05:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.560+0000 7fb9ecc00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9e8161d60 0x7fb9e8162db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.560+0000 7fb9ecc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.560+0000 7fb9ecc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e8162140 con 0x7fb9e80cde40 2024-04-16T13:05:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.560+0000 7fb9ecc00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e81632f0 con 0x7fb9e8161d60 2024-04-16T13:05:56.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.560+0000 7fb9ecc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e80ce390 con 0x7fb9e80d0bc0 2024-04-16T13:05:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.561+0000 7fb9e7400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9e8161d60 0x7fb9e8162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.561+0000 7fb9e7e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.561+0000 7fb9e7400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9e8161d60 0x7fb9e8162db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:57250/0 (socket says 172.21.15.67:57250) 2024-04-16T13:05:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.561+0000 7fb9e7400640 1 -- 172.21.15.67:0/1161226919 learned_addr learned my addr 172.21.15.67:0/1161226919 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:56.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.561+0000 7fb9e7e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e806e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:58606/0 (socket says 172.21.15.67:58606) 2024-04-16T13:05:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.562+0000 7fb9e7400640 1 -- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 msgr2=0x7fb9e806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.562+0000 7fb9e7400640 1 --2- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e806e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.562+0000 7fb9e7400640 1 -- 172.21.15.67:0/1161226919 >> v1:172.21.15.82:6789/0 conn(0x7fb9e80cde40 legacy=0x7fb9e80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.562+0000 7fb9e7400640 1 -- 172.21.15.67:0/1161226919 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e80ce670 con 0x7fb9e8161d60 2024-04-16T13:05:56.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.563+0000 7fb9e7400640 1 --2- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e8162db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650d2eab74b2eff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.564+0000 7fb9e6a00640 1 -- 172.21.15.67:0/1161226919 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8034070 con 0x7fb9e8161d60 2024-04-16T13:05:56.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.564+0000 7fb9e6a00640 1 -- 172.21.15.67:0/1161226919 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8030840 con 0x7fb9e8161d60 2024-04-16T13:05:56.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.564+0000 7fb9e6a00640 1 -- 172.21.15.67:0/1161226919 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8030c10 con 0x7fb9e8161d60 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 -- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 msgr2=0x7fb9e8162db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e8162db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009870 tx=0x7fb9d802b980 comp rx=0 tx=0).stop 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 -- 172.21.15.67:0/1161226919 shutdown_connections 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e806e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/1161226919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e8162db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 -- 172.21.15.67:0/1161226919 >> 172.21.15.67:0/1161226919 conn(0x7fb9e806bc00 msgr2=0x7fb9e806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 -- 172.21.15.67:0/1161226919 shutdown_connections 2024-04-16T13:05:56.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.565+0000 7fb9ecc00640 1 -- 172.21.15.67:0/1161226919 wait complete. 2024-04-16T13:05:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.567+0000 7fb9ecc00640 1 Processor -- start 2024-04-16T13:05:56.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.567+0000 7fb9ecc00640 1 -- start start 2024-04-16T13:05:56.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e80ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806e030 con 0x7fb9e80cde40 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e806dd50 con 0x7fb9e8161d60 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9ecc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e806ea90 con 0x7fb9e80d0bc0 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41806/0 (socket says 172.21.15.67:41806) 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 -- 172.21.15.67:0/2063478841 learned_addr learned my addr 172.21.15.67:0/2063478841 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7e00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9dfe00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e80ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 -- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 msgr2=0x7fb9e80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e80ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 -- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 msgr2=0x7fb9e815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9e7400640 1 -- 172.21.15.67:0/2063478841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e8148830 con 0x7fb9e80cde40 2024-04-16T13:05:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.568+0000 7fb9dfe00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e80ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:56.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9e7400640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802b9c0 tx=0x7fb9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8034040 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d8039d90 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8043630 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e8148b10 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.569+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81490d0 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.571+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e8075bd0 con 0x7fb9e80cde40 2024-04-16T13:05:56.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.571+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9d804a060 con 0x7fb9e80cde40 2024-04-16T13:05:56.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.572+0000 7fb9df400640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 0x7fb9c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:56.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.573+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb9d80adff0 con 0x7fb9e80cde40 2024-04-16T13:05:56.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.573+0000 7fb9dfe00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 0x7fb9c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:56.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.574+0000 7fb9dfe00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 0x7fb9c406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8161770 tx=0x7fb9d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:56.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.577+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9d803e070 con 0x7fb9e80cde40 2024-04-16T13:05:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.788+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9e80b0ab0 con 0x7fb9e80cde40 2024-04-16T13:05:56.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.789+0000 7fb9df400640 1 -- 172.21.15.67:0/2063478841 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fb9d802d330 con 0x7fb9e80cde40 2024-04-16T13:05:56.791 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 msgr2=0x7fb9c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 0x7fb9c406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8161770 tx=0x7fb9d0009040 comp rx=0 tx=0).stop 2024-04-16T13:05:56.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 msgr2=0x7fb9e81ea9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802b9c0 tx=0x7fb9d80046c0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 shutdown_connections 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb9c406c8f0 0x7fb9c406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9e8161d60 0x7fb9e815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb9e80d0bc0 0x7fb9e80ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 --2- 172.21.15.67:0/2063478841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9e80cde40 0x7fb9e81ea9c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 >> 172.21.15.67:0/2063478841 conn(0x7fb9e806bc00 msgr2=0x7fb9e80b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 shutdown_connections 2024-04-16T13:05:56.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:56.792+0000 7fb9ecc00640 1 -- 172.21.15.67:0/2063478841 wait complete. 2024-04-16T13:05:56.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:05:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.033+0000 7f7266a00640 1 Processor -- start 2024-04-16T13:05:57.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.033+0000 7f7266a00640 1 -- start start 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f7266a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726015c860 0x7f72600c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f7266a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 0x7f72600b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f7266a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72600cce80 con 0x7f72600cc9f0 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f7266a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f72600b4070 con 0x7f726015c860 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f7266a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f72600c7710 con 0x7f72600b3700 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f725fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726015c860 0x7f72600c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f725fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f726015c860 0x7f72600c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41810/0 (socket says 172.21.15.67:41810) 2024-04-16T13:05:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.035+0000 7f725fe00640 1 -- 172.21.15.67:0/2911500447 learned_addr learned my addr 172.21.15.67:0/2911500447 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f725fe00640 1 -- 172.21.15.67:0/2911500447 >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 msgr2=0x7f72600b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f7264a00640 1 --2- 172.21.15.67:0/2911500447 >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 0x7f72600b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f725fe00640 1 --2- 172.21.15.67:0/2911500447 >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 0x7f72600b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f725fe00640 1 -- 172.21.15.67:0/2911500447 >> v1:172.21.15.67:6789/0 conn(0x7f72600cc9f0 legacy=0x7f7260160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f725fe00640 1 -- 172.21.15.67:0/2911500447 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72600c6e70 con 0x7f726015c860 2024-04-16T13:05:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.036+0000 7f7264a00640 1 --2- 172.21.15.67:0/2911500447 >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 0x7f72600b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.037+0000 7f725fe00640 1 --2- 172.21.15.67:0/2911500447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726015c860 0x7f72600c6890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72600d0440 tx=0x7f725002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bb6b92a63bd66c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.037+0000 7f725ea00640 1 -- 172.21.15.67:0/2911500447 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250034070 con 0x7f726015c860 2024-04-16T13:05:57.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.037+0000 7f725ea00640 1 -- 172.21.15.67:0/2911500447 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7250030860 con 0x7f726015c860 2024-04-16T13:05:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.037+0000 7f725ea00640 1 -- 172.21.15.67:0/2911500447 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250030c30 con 0x7f726015c860 2024-04-16T13:05:57.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 -- 172.21.15.67:0/2911500447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726015c860 msgr2=0x7f72600c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 --2- 172.21.15.67:0/2911500447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726015c860 0x7f72600c6890 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72600d0440 tx=0x7f725002b9a0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 -- 172.21.15.67:0/2911500447 shutdown_connections 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 --2- 172.21.15.67:0/2911500447 >> v2:172.21.15.82:3300/0 conn(0x7f72600b3700 0x7f72600b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 --2- 172.21.15.67:0/2911500447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f726015c860 0x7f72600c6890 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 -- 172.21.15.67:0/2911500447 >> 172.21.15.67:0/2911500447 conn(0x7f7260067d90 msgr2=0x7f726006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 -- 172.21.15.67:0/2911500447 shutdown_connections 2024-04-16T13:05:57.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.038+0000 7f7266a00640 1 -- 172.21.15.67:0/2911500447 wait complete. 2024-04-16T13:05:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.040+0000 7f7266a00640 1 Processor -- start 2024-04-16T13:05:57.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.040+0000 7f7266a00640 1 -- start start 2024-04-16T13:05:57.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 0x7f72601552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f726015c860 0x7f72600c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f72601605c0 con 0x7f72600cc9f0 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72600c7430 con 0x7f72600b3700 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.041+0000 7f7266a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f726015cc40 con 0x7f726015c860 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41820/0 (socket says 172.21.15.67:41820) 2024-04-16T13:05:57.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 -- 172.21.15.67:0/1732914808 learned_addr learned my addr 172.21.15.67:0/1732914808 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f7264a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f726015c860 0x7f72600c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 -- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f726015c860 msgr2=0x7f72600c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725fe00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 0x7f72601552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f726015c860 0x7f72600c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 -- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 msgr2=0x7f72601552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 0x7f72601552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725f400640 1 -- 172.21.15.67:0/1732914808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726015a0f0 con 0x7f72600cc9f0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.042+0000 7f725fe00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 0x7f72601552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f725f400640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c400 tx=0x7f724c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c0052d0 con 0x7f72600cc9f0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724c005490 con 0x7f72600cc9f0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c007260 con 0x7f72600cc9f0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7260159850 con 0x7f72600cc9f0 2024-04-16T13:05:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.043+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7260159e10 con 0x7f72600cc9f0 2024-04-16T13:05:57.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.044+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7260068390 con 0x7f72600cc9f0 2024-04-16T13:05:57.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.045+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f724c007400 con 0x7f72600cc9f0 2024-04-16T13:05:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.046+0000 7f7257e00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 0x7f724006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.046+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f724c08b580 con 0x7f72600cc9f0 2024-04-16T13:05:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.047+0000 7f725fe00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 0x7f724006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.048+0000 7f725fe00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 0x7f724006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.051+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7260068390 con 0x7f72600cc9f0 2024-04-16T13:05:57.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.252+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7260068a70 con 0x7f72600cc9f0 2024-04-16T13:05:57.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.253+0000 7f7257e00640 1 -- 172.21.15.67:0/1732914808 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f724c059510 con 0x7f72600cc9f0 2024-04-16T13:05:57.254 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:57.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 msgr2=0x7f724006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 0x7f724006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003b040 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 msgr2=0x7f7260158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c400 tx=0x7f724c00c8c0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 shutdown_connections 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f724006c8f0 0x7f724006edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f726015c860 0x7f72600c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72600cc9f0 0x7f7260158f50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 --2- 172.21.15.67:0/1732914808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72600b3700 0x7f72601552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 >> 172.21.15.67:0/1732914808 conn(0x7f7260067d90 msgr2=0x7f7260158160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 shutdown_connections 2024-04-16T13:05:57.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.256+0000 7f7266a00640 1 -- 172.21.15.67:0/1732914808 wait complete. 2024-04-16T13:05:57.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:05:57.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.495+0000 7fc388a00640 1 Processor -- start 2024-04-16T13:05:57.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.496+0000 7fc388a00640 1 -- start start 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.497+0000 7fc388a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3841456a0 0x7fc3840b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.497+0000 7fc388a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3840afbb0 0x7fc38406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc388a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3840b0100 con 0x7fc38406bf60 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc388a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fc38406c3b0 con 0x7fc3840afbb0 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc388a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3840b03e0 con 0x7fc3841456a0 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc383200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc38406bf60 0x7fc3840d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51442/0 (socket says 172.21.15.67:51442) 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc383200640 1 -- 172.21.15.67:0/1164672142 learned_addr learned my addr 172.21.15.67:0/1164672142 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:57.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc381e00640 1 --2- 172.21.15.67:0/1164672142 >> v2:172.21.15.82:3300/0 conn(0x7fc3840afbb0 0x7fc38406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.498+0000 7fc382800640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3841456a0 0x7fc3840b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381400640 1 -- 172.21.15.67:0/1164672142 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 316521671 0 0) 0x7fc3840b0100 con 0x7fc38406bf60 2024-04-16T13:05:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381400640 1 -- 172.21.15.67:0/1164672142 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003520 con 0x7fc38406bf60 2024-04-16T13:05:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381e00640 1 -- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3841456a0 msgr2=0x7fc3840b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:57.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381e00640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3841456a0 0x7fc3840b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381e00640 1 -- 172.21.15.67:0/1164672142 >> v1:172.21.15.67:6789/0 conn(0x7fc38406bf60 legacy=0x7fc3840d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.499+0000 7fc381e00640 1 -- 172.21.15.67:0/1164672142 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3840b06c0 con 0x7fc3840afbb0 2024-04-16T13:05:57.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.500+0000 7fc381e00640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38406ba20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cad36206cc6b326 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.501+0000 7fc381400640 1 -- 172.21.15.67:0/1164672142 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c035020 con 0x7fc3840afbb0 2024-04-16T13:05:57.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.501+0000 7fc381400640 1 -- 172.21.15.67:0/1164672142 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c031810 con 0x7fc3840afbb0 2024-04-16T13:05:57.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.501+0000 7fc381400640 1 -- 172.21.15.67:0/1164672142 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c031be0 con 0x7fc3840afbb0 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 -- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 msgr2=0x7fc38406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38406ba20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0097a0 tx=0x7fc36c02b8b0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 -- 172.21.15.67:0/1164672142 shutdown_connections 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38406ba20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 --2- 172.21.15.67:0/1164672142 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc3841456a0 0x7fc3840b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 -- 172.21.15.67:0/1164672142 >> 172.21.15.67:0/1164672142 conn(0x7fc3840732c0 msgr2=0x7fc38409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 -- 172.21.15.67:0/1164672142 shutdown_connections 2024-04-16T13:05:57.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.502+0000 7fc388a00640 1 -- 172.21.15.67:0/1164672142 wait complete. 2024-04-16T13:05:57.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.504+0000 7fc388a00640 1 Processor -- start 2024-04-16T13:05:57.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.504+0000 7fc388a00640 1 -- start start 2024-04-16T13:05:57.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc38406bf60 0x7fc384142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38409c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3840b66f0 con 0x7fc3841456a0 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3840b0c80 con 0x7fc3840afbb0 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.505+0000 7fc388a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc3840b6870 con 0x7fc38406bf60 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41826/0 (socket says 172.21.15.67:41826) 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 -- 172.21.15.67:0/3379833371 learned_addr learned my addr 172.21.15.67:0/3379833371 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc381e00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38409c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc382800640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc38406bf60 0x7fc384142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 -- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc38406bf60 msgr2=0x7fc384142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc38406bf60 0x7fc384142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 -- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 msgr2=0x7fc38409c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38409c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.506+0000 7fc383200640 1 -- 172.21.15.67:0/3379833371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38413f680 con 0x7fc3841456a0 2024-04-16T13:05:57.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc383200640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c460 tx=0x7fc37c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c017070 con 0x7fc3841456a0 2024-04-16T13:05:57.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c005ce0 con 0x7fc3841456a0 2024-04-16T13:05:57.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c007290 con 0x7fc3841456a0 2024-04-16T13:05:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc384140ed0 con 0x7fc3841456a0 2024-04-16T13:05:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.507+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc384140060 con 0x7fc3841456a0 2024-04-16T13:05:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.508+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc384140cf0 con 0x7fc3841456a0 2024-04-16T13:05:57.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.509+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc37c01a070 con 0x7fc3841456a0 2024-04-16T13:05:57.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.510+0000 7fc37aa00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 0x7fc36006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.510+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc37c08b260 con 0x7fc3841456a0 2024-04-16T13:05:57.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.511+0000 7fc382800640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 0x7fc36006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.512+0000 7fc382800640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 0x7fc36006ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b3980 tx=0x7fc37400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.515+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc384140cf0 con 0x7fc3841456a0 2024-04-16T13:05:57.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.717+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc38406c800 con 0x7fc3841456a0 2024-04-16T13:05:57.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.718+0000 7fc37aa00640 1 -- 172.21.15.67:0/3379833371 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fc37c059290 con 0x7fc3841456a0 2024-04-16T13:05:57.719 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.720+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 msgr2=0x7fc36006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.720+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 0x7fc36006ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc3840b3980 tx=0x7fc37400b040 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.720+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 msgr2=0x7fc38406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.720+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c460 tx=0x7fc37c00c920 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 shutdown_connections 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc36006c920 0x7fc36006ede0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3841456a0 0x7fc38406ee20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840afbb0 0x7fc38409c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 --2- 172.21.15.67:0/3379833371 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc38406bf60 0x7fc384142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 >> 172.21.15.67:0/3379833371 conn(0x7fc3840732c0 msgr2=0x7fc3840b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 shutdown_connections 2024-04-16T13:05:57.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.721+0000 7fc388a00640 1 -- 172.21.15.67:0/3379833371 wait complete. 2024-04-16T13:05:57.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:05:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.969+0000 7f5bbbe00640 1 Processor -- start 2024-04-16T13:05:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.969+0000 7f5bbbe00640 1 -- start start 2024-04-16T13:05:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.970+0000 7f5bbbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.970+0000 7f5bbbe00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5bbc06f470 0x7f5bbc15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.970+0000 7f5bbbe00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bbc15bc40 con 0x7f5bbc13e5d0 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.970+0000 7f5bbbe00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc06f8e0 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.970+0000 7f5bbbe00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc15bf20 con 0x7f5bbc06f470 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41840/0 (socket says 172.21.15.67:41840) 2024-04-16T13:05:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 -- 172.21.15.67:0/941521647 learned_addr learned my addr 172.21.15.67:0/941521647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bbb400640 1 --2- 172.21.15.67:0/941521647 >> v2:172.21.15.82:3300/0 conn(0x7f5bbc06f470 0x7f5bbc15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 -- 172.21.15.67:0/941521647 >> v2:172.21.15.82:3300/0 conn(0x7f5bbc06f470 msgr2=0x7f5bbc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 --2- 172.21.15.67:0/941521647 >> v2:172.21.15.82:3300/0 conn(0x7f5bbc06f470 0x7f5bbc15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 -- 172.21.15.67:0/941521647 >> v1:172.21.15.82:6789/0 conn(0x7f5bbc13e5d0 legacy=0x7f5bbc0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.971+0000 7f5bb2000640 1 -- 172.21.15.67:0/941521647 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc15c200 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.973+0000 7f5bb2000640 1 --2- 172.21.15.67:0/941521647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0730e0 tx=0x7f5ba402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ef8f57c39cf2c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.973+0000 7f5bba000640 1 -- 172.21.15.67:0/941521647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4035020 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.973+0000 7f5bba000640 1 -- 172.21.15.67:0/941521647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4031870 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.973+0000 7f5bba000640 1 -- 172.21.15.67:0/941521647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4031c40 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 -- 172.21.15.67:0/941521647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 msgr2=0x7f5bbc06ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/941521647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0730e0 tx=0x7f5ba402b910 comp rx=0 tx=0).stop 2024-04-16T13:05:57.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 -- 172.21.15.67:0/941521647 shutdown_connections 2024-04-16T13:05:57.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/941521647 >> v2:172.21.15.82:3300/0 conn(0x7f5bbc06f470 0x7f5bbc15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/941521647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc06ef30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 -- 172.21.15.67:0/941521647 >> 172.21.15.67:0/941521647 conn(0x7f5bbc067d90 msgr2=0x7f5bbc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:57.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 -- 172.21.15.67:0/941521647 shutdown_connections 2024-04-16T13:05:57.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.974+0000 7f5bbbe00640 1 -- 172.21.15.67:0/941521647 wait complete. 2024-04-16T13:05:57.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.976+0000 7f5bbbe00640 1 Processor -- start 2024-04-16T13:05:57.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.976+0000 7f5bbbe00640 1 -- start start 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bbc06f470 0x7f5bbc13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bbc13e5d0 0x7f5bbc141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0d0110 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc15c7c0 con 0x7f5bbc06f470 2024-04-16T13:05:57.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.977+0000 7f5bbbe00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc0afd20 con 0x7f5bbc13e5d0 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41848/0 (socket says 172.21.15.67:41848) 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 -- 172.21.15.67:0/1362761867 learned_addr learned my addr 172.21.15.67:0/1362761867 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbaa00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bbc06f470 0x7f5bbc13dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bb2000640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bbc13e5d0 0x7f5bbc141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 -- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bbc13e5d0 msgr2=0x7f5bbc141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bbc13e5d0 0x7f5bbc141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 -- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bbc06f470 msgr2=0x7f5bbc13dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bbc06f470 0x7f5bbc13dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 -- 172.21.15.67:0/1362761867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc142560 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.978+0000 7f5bbb400640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400d800 tx=0x7f5bb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.979+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400b6c0 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.979+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb4019070 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.979+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc142840 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.979+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400bac0 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.979+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc143590 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.980+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bbc075bd0 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.981+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bb400bc60 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.982+0000 7f5bb3400640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 0x7f5b9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:57.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.983+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5bb408c410 con 0x7f5bbc13ebb0 2024-04-16T13:05:57.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.983+0000 7f5bbaa00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 0x7f5b9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:57.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.984+0000 7f5bbaa00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 0x7f5b9806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5bac005520 tx=0x7f5bac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:57.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:57.987+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bb405a430 con 0x7f5bbc13ebb0 2024-04-16T13:05:58.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.193+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5bbc0b3600 con 0x7f5bbc13ebb0 2024-04-16T13:05:58.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.194+0000 7f5bb3400640 1 -- 172.21.15.67:0/1362761867 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5bb4059d30 con 0x7f5bbc13ebb0 2024-04-16T13:05:58.195 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 msgr2=0x7f5b9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 0x7f5b9806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5bac005520 tx=0x7f5bac009040 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 msgr2=0x7f5bbc1401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400d800 tx=0x7f5bb400dcc0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 shutdown_connections 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5b9806c8f0 0x7f5b9806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bbc13ebb0 0x7f5bbc1401a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bbc13e5d0 0x7f5bbc141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 --2- 172.21.15.67:0/1362761867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bbc06f470 0x7f5bbc13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 >> 172.21.15.67:0/1362761867 conn(0x7f5bbc067d90 msgr2=0x7f5bbc06ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 shutdown_connections 2024-04-16T13:05:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.197+0000 7f5bbbe00640 1 -- 172.21.15.67:0/1362761867 wait complete. 2024-04-16T13:05:58.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:05:58.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.439+0000 7fad5ec00640 1 Processor -- start 2024-04-16T13:05:58.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.440+0000 7fad5ec00640 1 -- start start 2024-04-16T13:05:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.441+0000 7fad5ec00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad5815ed40 0x7fad580d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.441+0000 7fad5ec00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 0x7fad5809b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.441+0000 7fad5ec00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad580d0f50 con 0x7fad5806d540 2024-04-16T13:05:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.441+0000 7fad5ec00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fad580d1230 con 0x7fad5815ed40 2024-04-16T13:05:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.441+0000 7fad5ec00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fad580d1510 con 0x7fad580d0990 2024-04-16T13:05:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.442+0000 7fad57400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 0x7fad5809b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.442+0000 7fad57e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fad5815ed40 0x7fad580d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.442+0000 7fad57400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 0x7fad5809b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:58674/0 (socket says 172.21.15.67:58674) 2024-04-16T13:05:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.442+0000 7fad57400640 1 -- 172.21.15.67:0/3475400164 learned_addr learned my addr 172.21.15.67:0/3475400164 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.443+0000 7fad57e00640 1 -- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 msgr2=0x7fad5809b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.443+0000 7fad57e00640 1 --2- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 0x7fad5809b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.443+0000 7fad57e00640 1 -- 172.21.15.67:0/3475400164 >> v1:172.21.15.82:6789/0 conn(0x7fad5806d540 legacy=0x7fad580ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.443+0000 7fad57e00640 1 -- 172.21.15.67:0/3475400164 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad580d17f0 con 0x7fad5815ed40 2024-04-16T13:05:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.444+0000 7fad57e00640 1 --2- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad580d1ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad480097a0 tx=0x7fad4802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f509bb3b4fa35f2f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:58.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.445+0000 7fad56a00640 1 -- 172.21.15.67:0/3475400164 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48035020 con 0x7fad5815ed40 2024-04-16T13:05:58.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.445+0000 7fad56a00640 1 -- 172.21.15.67:0/3475400164 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad48031830 con 0x7fad5815ed40 2024-04-16T13:05:58.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.445+0000 7fad56a00640 1 -- 172.21.15.67:0/3475400164 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48031c00 con 0x7fad5815ed40 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 -- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 msgr2=0x7fad580d1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 --2- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad580d1ff0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad480097a0 tx=0x7fad4802b8d0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 -- 172.21.15.67:0/3475400164 shutdown_connections 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 --2- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad580d0990 0x7fad5809b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 --2- 172.21.15.67:0/3475400164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad580d1ff0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 -- 172.21.15.67:0/3475400164 >> 172.21.15.67:0/3475400164 conn(0x7fad580b4240 msgr2=0x7fad580b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 -- 172.21.15.67:0/3475400164 shutdown_connections 2024-04-16T13:05:58.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.446+0000 7fad5ec00640 1 -- 172.21.15.67:0/3475400164 wait complete. 2024-04-16T13:05:58.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.448+0000 7fad5ec00640 1 Processor -- start 2024-04-16T13:05:58.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.448+0000 7fad5ec00640 1 -- start start 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5806d540 0x7fad58155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad5814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806d9d0 con 0x7fad580d0990 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806cf60 con 0x7fad5815ed40 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5ec00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fad5806db50 con 0x7fad5806d540 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad57400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad57400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41862/0 (socket says 172.21.15.67:41862) 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad57400640 1 -- 172.21.15.67:0/782183927 learned_addr learned my addr 172.21.15.67:0/782183927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad57e00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5806d540 0x7fad58155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.449+0000 7fad5cc00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad5814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 -- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5806d540 msgr2=0x7fad58155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5806d540 0x7fad58155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 -- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 msgr2=0x7fad5814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad5814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 -- 172.21.15.67:0/782183927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5815aa80 con 0x7fad580d0990 2024-04-16T13:05:58.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad57400640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fd0 tx=0x7fad4000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40017070 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4000c940 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5815ad30 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.450+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4000cd10 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.451+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad58156f70 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.452+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad58156d60 con 0x7fad580d0990 2024-04-16T13:05:58.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.453+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad4001a070 con 0x7fad580d0990 2024-04-16T13:05:58.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.453+0000 7fad4fe00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:58.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.454+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fad4008bed0 con 0x7fad580d0990 2024-04-16T13:05:58.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.454+0000 7fad57e00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:58.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.455+0000 7fad57e00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 0x7fad3406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad48036000 tx=0x7fad4803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:58.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.458+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad40059ef0 con 0x7fad580d0990 2024-04-16T13:05:58.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.675+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad58068a70 con 0x7fad580d0990 2024-04-16T13:05:58.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.676+0000 7fad4fe00640 1 -- 172.21.15.67:0/782183927 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fad400597f0 con 0x7fad580d0990 2024-04-16T13:05:58.677 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.678+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 msgr2=0x7fad3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 0x7fad3406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad48036000 tx=0x7fad4803c040 comp rx=0 tx=0).stop 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 msgr2=0x7fad5815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad40009fd0 tx=0x7fad4000ed40 comp rx=0 tx=0).stop 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 shutdown_connections 2024-04-16T13:05:58.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad5815ed40 0x7fad5814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad580d0990 0x7fad5815a540 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 --2- 172.21.15.67:0/782183927 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fad5806d540 0x7fad58155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 >> 172.21.15.67:0/782183927 conn(0x7fad580b4240 msgr2=0x7fad58070150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 shutdown_connections 2024-04-16T13:05:58.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:58.679+0000 7fad5ec00640 1 -- 172.21.15.67:0/782183927 wait complete. 2024-04-16T13:05:58.700 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T13:05:58.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:58.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-16T13:05:58.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:05:58.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:05:58.811 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T13:05:58.875 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:58.875 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:58.936 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:58.937 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:58.995 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:05:58.995 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:05:59.049 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:05:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.278+0000 7f494da00640 1 Processor -- start 2024-04-16T13:05:59.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.278+0000 7f494da00640 1 -- start start 2024-04-16T13:05:59.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.280+0000 7f494da00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 0x7f494815f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.280+0000 7f494da00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.280+0000 7f494da00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494815ff30 con 0x7f49480cd280 2024-04-16T13:05:59.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.280+0000 7f494da00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f494815f970 con 0x7f494815b3a0 2024-04-16T13:05:59.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.280+0000 7f494da00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f494815fc50 con 0x7f494815bb60 2024-04-16T13:05:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.281+0000 7f493f400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.281+0000 7f4947e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 0x7f494815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.281+0000 7f493f400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:58688/0 (socket says 172.21.15.67:58688) 2024-04-16T13:05:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.281+0000 7f493f400640 1 -- 172.21.15.67:0/2211866737 learned_addr learned my addr 172.21.15.67:0/2211866737 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:59.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.282+0000 7f493f400640 1 -- 172.21.15.67:0/2211866737 >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 msgr2=0x7f494815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.282+0000 7f493f400640 1 --2- 172.21.15.67:0/2211866737 >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 0x7f494815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.282+0000 7f493f400640 1 -- 172.21.15.67:0/2211866737 >> v1:172.21.15.82:6789/0 conn(0x7f49480cd280 legacy=0x7f49480ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.282+0000 7f493f400640 1 -- 172.21.15.67:0/2211866737 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49480cc540 con 0x7f494815bb60 2024-04-16T13:05:59.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.282+0000 7f4947e00640 1 --2- 172.21.15.67:0/2211866737 >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 0x7f494815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:05:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.283+0000 7f493f400640 1 --2- 172.21.15.67:0/2211866737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f49300098a0 tx=0x7f493002db00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a5d5737229e624e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.283+0000 7f4947400640 1 -- 172.21.15.67:0/2211866737 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493002f8c0 con 0x7f494815bb60 2024-04-16T13:05:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f4947400640 1 -- 172.21.15.67:0/2211866737 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493002fa60 con 0x7f494815bb60 2024-04-16T13:05:59.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f4947400640 1 -- 172.21.15.67:0/2211866737 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493002fe30 con 0x7f494815bb60 2024-04-16T13:05:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 -- 172.21.15.67:0/2211866737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 msgr2=0x7f49480ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 --2- 172.21.15.67:0/2211866737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f49300098a0 tx=0x7f493002db00 comp rx=0 tx=0).stop 2024-04-16T13:05:59.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 -- 172.21.15.67:0/2211866737 shutdown_connections 2024-04-16T13:05:59.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 --2- 172.21.15.67:0/2211866737 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815bb60 0x7f49480ccd40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 --2- 172.21.15.67:0/2211866737 >> v2:172.21.15.82:3300/0 conn(0x7f494815b3a0 0x7f494815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 -- 172.21.15.67:0/2211866737 >> 172.21.15.67:0/2211866737 conn(0x7f49480b2070 msgr2=0x7f49480b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:59.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.284+0000 7f494da00640 1 -- 172.21.15.67:0/2211866737 shutdown_connections 2024-04-16T13:05:59.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.285+0000 7f494da00640 1 -- 172.21.15.67:0/2211866737 wait complete. 2024-04-16T13:05:59.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.286+0000 7f494da00640 1 Processor -- start 2024-04-16T13:05:59.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.286+0000 7f494da00640 1 -- start start 2024-04-16T13:05:59.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 0x7f494806ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f494815bb60 0x7f49480ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f494815f6c0 con 0x7f49480cd280 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f494815f540 con 0x7f494815bb60 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.287+0000 7f494da00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f49480cafa0 con 0x7f494815b3a0 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41878/0 (socket says 172.21.15.67:41878) 2024-04-16T13:05:59.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 -- 172.21.15.67:0/373929673 learned_addr learned my addr 172.21.15.67:0/373929673 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f494d000640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f494815bb60 0x7f49480ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f493f400640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 0x7f494806ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 -- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 msgr2=0x7f494806ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 0x7f494806ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 -- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f494815bb60 msgr2=0x7f49480ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f494815bb60 0x7f49480ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f4947e00640 1 -- 172.21.15.67:0/373929673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494806f130 con 0x7f49480cd280 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.288+0000 7f493f400640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 0x7f494806ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f4947e00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f493800efc0 tx=0x7f493800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938018020 con 0x7f49480cd280 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4938014680 con 0x7f49480cd280 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49480c62c0 con 0x7f49480cd280 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938014a50 con 0x7f49480cd280 2024-04-16T13:05:59.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.289+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49480c6b60 con 0x7f49480cd280 2024-04-16T13:05:59.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.290+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4948075bd0 con 0x7f49480cd280 2024-04-16T13:05:59.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.291+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4938005d10 con 0x7f49480cd280 2024-04-16T13:05:59.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.293+0000 7f4944c00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 0x7f492406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.294+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f493808ce50 con 0x7f49480cd280 2024-04-16T13:05:59.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.294+0000 7f493f400640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 0x7f492406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.295+0000 7f493f400640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 0x7f492406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4930038000 tx=0x7f4930008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.300+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4938022030 con 0x7f49480cd280 2024-04-16T13:05:59.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.508+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49480b50d0 con 0x7f49480cd280 2024-04-16T13:05:59.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.511+0000 7f4944c00640 1 -- 172.21.15.67:0/373929673 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7f4938010040 con 0x7f49480cd280 2024-04-16T13:05:59.512 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:05:59.512 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 msgr2=0x7f492406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 0x7f492406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4930038000 tx=0x7f4930008030 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 msgr2=0x7f49480c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f493800efc0 tx=0x7f493800c490 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 shutdown_connections 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f492406c8f0 0x7f492406edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f494815bb60 0x7f49480ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f494815b3a0 0x7f494806ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 --2- 172.21.15.67:0/373929673 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49480cd280 0x7f49480c5bc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 >> 172.21.15.67:0/373929673 conn(0x7f49480b2070 msgr2=0x7f49480b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:59.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 shutdown_connections 2024-04-16T13:05:59.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.514+0000 7f494da00640 1 -- 172.21.15.67:0/373929673 wait complete. 2024-04-16T13:05:59.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:05:59.537 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:05:59.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.755+0000 7f837f200640 1 Processor -- start 2024-04-16T13:05:59.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.755+0000 7f837f200640 1 -- start start 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.756+0000 7f837f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8380160180 0x7f838015d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837f200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8380156ff0 con 0x7f838015d0a0 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837f200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8380160920 con 0x7f83800d04b0 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8380160c00 con 0x7f8380160180 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837de00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f838015d0a0 0x7f83800ca8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51456/0 (socket says 172.21.15.67:51456) 2024-04-16T13:05:59.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837de00640 1 -- 172.21.15.67:0/2952301519 learned_addr learned my addr 172.21.15.67:0/2952301519 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f8375400640 1 --2- 172.21.15.67:0/2952301519 >> v2:172.21.15.67:3300/0 conn(0x7f8380160180 0x7f838015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.757+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546589528 0 0) 0x7f8380156ff0 con 0x7f838015d0a0 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8364003520 con 0x7f838015d0a0 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960510187 0 0) 0x7f8364003520 con 0x7f838015d0a0 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 >> v2:172.21.15.67:3300/0 conn(0x7f8380160180 msgr2=0x7f838015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 --2- 172.21.15.67:0/2952301519 >> v2:172.21.15.67:3300/0 conn(0x7f8380160180 0x7f838015d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 >> v1:172.21.15.82:6789/0 conn(0x7f83800d04b0 legacy=0x7f838006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380160ee0 con 0x7f838015d0a0 2024-04-16T13:05:59.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f8370001670 con 0x7f838015d0a0 2024-04-16T13:05:59.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 >> v1:172.21.15.67:6789/0 conn(0x7f838015d0a0 legacy=0x7f83800ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 0x7f8364003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364004800 0x7f8364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83640052e0 0x7f836400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8380160c00 con 0x7f8364003ae0 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f836400c190 con 0x7f83640052e0 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.758+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f836400c390 con 0x7f8364004800 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 0x7f8364003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837e800640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83640052e0 0x7f836400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 -- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364004800 msgr2=0x7f8364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364004800 0x7f8364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 -- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83640052e0 msgr2=0x7f836400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83640052e0 0x7f836400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837de00640 1 -- 172.21.15.67:0/2952301519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8364003520 con 0x7f8364003ae0 2024-04-16T13:05:59.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.759+0000 7f837e800640 1 -- 172.21.15.67:0/2952301519 reap_dead start 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.760+0000 7f837de00640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 0x7f8364003f00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f837000c160 tx=0x7f8364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d32f4bca3ff972 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.760+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370007c60 con 0x7f8364003ae0 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370030070 con 0x7f8364003ae0 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837d400640 1 -- 172.21.15.67:0/2952301519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370005d90 con 0x7f8364003ae0 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837f200640 1 -- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 msgr2=0x7f8364003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837f200640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 0x7f8364003f00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f837000c160 tx=0x7f8364005830 comp rx=0 tx=0).stop 2024-04-16T13:05:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837f200640 1 -- 172.21.15.67:0/2952301519 shutdown_connections 2024-04-16T13:05:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837f200640 1 --2- 172.21.15.67:0/2952301519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8364003ae0 0x7f8364003f00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.761+0000 7f837f200640 1 -- 172.21.15.67:0/2952301519 >> 172.21.15.67:0/2952301519 conn(0x7f838006bc00 msgr2=0x7f838006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.762+0000 7f837f200640 1 -- 172.21.15.67:0/2952301519 shutdown_connections 2024-04-16T13:05:59.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.762+0000 7f837f200640 1 -- 172.21.15.67:0/2952301519 wait complete. 2024-04-16T13:05:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.764+0000 7f837f200640 1 Processor -- start 2024-04-16T13:05:59.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.764+0000 7f837f200640 1 -- start start 2024-04-16T13:05:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364003ae0 0x7f838009a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 0x7f83800b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f838006ec60 con 0x7f838009cf90 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8380160600 con 0x7f83800b45d0 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f837f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f83800d0940 con 0x7f8364003ae0 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f8375400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f8375400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41896/0 (socket says 172.21.15.67:41896) 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.765+0000 7f8375400640 1 -- 172.21.15.67:0/2510886129 learned_addr learned my addr 172.21.15.67:0/2510886129 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f837e800640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 0x7f83800b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f837de00640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364003ae0 0x7f838009a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 -- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364003ae0 msgr2=0x7f838009a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364003ae0 0x7f838009a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 -- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 msgr2=0x7f83800b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 0x7f83800b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 -- 172.21.15.67:0/2510886129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838009bb10 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f837e800640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 0x7f83800b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.766+0000 7f8375400640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f836800e7d0 tx=0x7f836800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.767+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368017070 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.767+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836800ee80 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.767+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836800cb80 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.767+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838009d450 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.767+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838009da10 con 0x7f838009cf90 2024-04-16T13:05:59.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.768+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380075bd0 con 0x7f838009cf90 2024-04-16T13:05:59.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.769+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f836801a070 con 0x7f838009cf90 2024-04-16T13:05:59.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.770+0000 7f8376a00640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 0x7f835c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:05:59.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.770+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f836808bcc0 con 0x7f838009cf90 2024-04-16T13:05:59.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.771+0000 7f837de00640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 0x7f835c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:05:59.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.772+0000 7f837de00640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 0x7f835c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83640057e0 tx=0x7f8370039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:05:59.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.775+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8368059cf0 con 0x7f838009cf90 2024-04-16T13:05:59.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.981+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f83800ada20 con 0x7f838009cf90 2024-04-16T13:05:59.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.982+0000 7f8376a00640 1 -- 172.21.15.67:0/2510886129 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f83680595f0 con 0x7f838009cf90 2024-04-16T13:05:59.983 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:05:59.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 msgr2=0x7f835c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 0x7f835c06edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83640057e0 tx=0x7f8370039040 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 msgr2=0x7f838009b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f836800e7d0 tx=0x7f836800ec90 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 shutdown_connections 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f835c06c8f0 0x7f835c06edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83800b45d0 0x7f83800b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838009cf90 0x7f838009b5d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 --2- 172.21.15.67:0/2510886129 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8364003ae0 0x7f838009a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 >> 172.21.15.67:0/2510886129 conn(0x7f838006bc00 msgr2=0x7f838015ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 shutdown_connections 2024-04-16T13:05:59.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:05:59.985+0000 7f837f200640 1 -- 172.21.15.67:0/2510886129 wait complete. 2024-04-16T13:06:00.007 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:06:00.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.237+0000 7f9a9e800640 1 Processor -- start 2024-04-16T13:06:00.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.237+0000 7f9a9e800640 1 -- start start 2024-04-16T13:06:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a9e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a9815eb80 0x7f9a980ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a9e800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9815ef60 con 0x7f9a9815fcb0 2024-04-16T13:06:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a9e800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a980cee90 con 0x7f9a980725b0 2024-04-16T13:06:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a9e800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9a980cf170 con 0x7f9a9815eb80 2024-04-16T13:06:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a97400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a9815eb80 0x7f9a980ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.239+0000 7f9a97400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a9815eb80 0x7f9a980ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41906/0 (socket says 172.21.15.67:41906) 2024-04-16T13:06:00.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.240+0000 7f9a97400640 1 -- 172.21.15.67:0/3186581131 learned_addr learned my addr 172.21.15.67:0/3186581131 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:00.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.240+0000 7f9a97400640 1 -- 172.21.15.67:0/3186581131 >> v1:172.21.15.82:6789/0 conn(0x7f9a980725b0 legacy=0x7f9a980ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:00.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.240+0000 7f9a97400640 1 -- 172.21.15.67:0/3186581131 >> v1:172.21.15.67:6789/0 conn(0x7f9a9815fcb0 legacy=0x7f9a98071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.240+0000 7f9a97400640 1 -- 172.21.15.67:0/3186581131 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9815f1d0 con 0x7f9a9815eb80 2024-04-16T13:06:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.241+0000 7f9a97400640 1 --2- 172.21.15.67:0/3186581131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a980ce410 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009870 tx=0x7f9a8802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe68886e880c142f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a96000640 1 -- 172.21.15.67:0/3186581131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8802f850 con 0x7f9a9815eb80 2024-04-16T13:06:00.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a96000640 1 -- 172.21.15.67:0/3186581131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8802f9f0 con 0x7f9a9815eb80 2024-04-16T13:06:00.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a96000640 1 -- 172.21.15.67:0/3186581131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8802fdc0 con 0x7f9a9815eb80 2024-04-16T13:06:00.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 -- 172.21.15.67:0/3186581131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 msgr2=0x7f9a980ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3186581131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a980ce410 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009870 tx=0x7f9a8802ba30 comp rx=0 tx=0).stop 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 -- 172.21.15.67:0/3186581131 shutdown_connections 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3186581131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a980ce410 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 -- 172.21.15.67:0/3186581131 >> 172.21.15.67:0/3186581131 conn(0x7f9a9806c050 msgr2=0x7f9a980b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.242+0000 7f9a9e800640 1 -- 172.21.15.67:0/3186581131 shutdown_connections 2024-04-16T13:06:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.243+0000 7f9a9e800640 1 -- 172.21.15.67:0/3186581131 wait complete. 2024-04-16T13:06:00.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.244+0000 7f9a9e800640 1 Processor -- start 2024-04-16T13:06:00.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.244+0000 7f9a9e800640 1 -- start start 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a980725b0 0x7f9a98154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9815fcb0 0x7f9a981f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9a980ccc80 con 0x7f9a9815eb80 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9815f820 con 0x7f9a9815fcb0 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.245+0000 7f9a9e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9a980ce950 con 0x7f9a980725b0 2024-04-16T13:06:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41920/0 (socket says 172.21.15.67:41920) 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 -- 172.21.15.67:0/3985275580 learned_addr learned my addr 172.21.15.67:0/3985275580 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a97400640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a980725b0 0x7f9a98154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a97e00640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9815fcb0 0x7f9a981f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 -- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a980725b0 msgr2=0x7f9a98154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a980725b0 0x7f9a98154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 -- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9815fcb0 msgr2=0x7f9a981f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9815fcb0 0x7f9a981f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.246+0000 7f9a96a00640 1 -- 172.21.15.67:0/3985275580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a981514c0 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a96a00640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c3c0 tx=0x7f9a8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840052d0 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84005490 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84007260 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a98152b30 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.247+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a98152850 con 0x7f9a9815eb80 2024-04-16T13:06:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.248+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a98152300 con 0x7f9a9815eb80 2024-04-16T13:06:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.249+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a84007400 con 0x7f9a9815eb80 2024-04-16T13:06:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.250+0000 7f9a8f400640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 0x7f9a7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.250+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9a8408b460 con 0x7f9a9815eb80 2024-04-16T13:06:00.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.251+0000 7f9a97400640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 0x7f9a7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.252+0000 7f9a97400640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 0x7f9a7806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a88036000 tx=0x7f9a88008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.255+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a84059480 con 0x7f9a9815eb80 2024-04-16T13:06:00.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.468+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9a980b28e0 con 0x7f9a9815eb80 2024-04-16T13:06:00.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.469+0000 7f9a8f400640 1 -- 172.21.15.67:0/3985275580 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f9a84058d80 con 0x7f9a9815eb80 2024-04-16T13:06:00.470 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.471+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 msgr2=0x7f9a7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.471+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 0x7f9a7806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a88036000 tx=0x7f9a88008030 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.471+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 msgr2=0x7f9a98150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.471+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c3c0 tx=0x7f9a8400c880 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 shutdown_connections 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9a7806c920 0x7f9a7806ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9815fcb0 0x7f9a981f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a9815eb80 0x7f9a98150f80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 --2- 172.21.15.67:0/3985275580 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9a980725b0 0x7f9a98154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 >> 172.21.15.67:0/3985275580 conn(0x7f9a9806c050 msgr2=0x7f9a980b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:00.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 shutdown_connections 2024-04-16T13:06:00.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.472+0000 7f9a9e800640 1 -- 172.21.15.67:0/3985275580 wait complete. 2024-04-16T13:06:00.493 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:06:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.726+0000 7fa601600640 1 Processor -- start 2024-04-16T13:06:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.726+0000 7fa601600640 1 -- start start 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa601600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa601600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa601600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc0d2b10 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa601600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0d2df0 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa601600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d30d0 con 0x7fa5fc0d17f0 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa5fbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa5fbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41936/0 (socket says 172.21.15.67:41936) 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa5fbe00640 1 -- 172.21.15.67:0/327750565 learned_addr learned my addr 172.21.15.67:0/327750565 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa5fb400640 1 --1- 172.21.15.67:0/327750565 >> v1:172.21.15.67:6789/0 conn(0x7fa5fc0d22c0 0x7fa5fc0d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51472/0 (socket says 172.21.15.67:51472) 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.728+0000 7fa600c00640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa5fbe00640 1 -- 172.21.15.67:0/327750565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 msgr2=0x7fa5fc06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa5fbe00640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa5fbe00640 1 -- 172.21.15.67:0/327750565 >> v1:172.21.15.67:6789/0 conn(0x7fa5fc0d22c0 legacy=0x7fa5fc0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa5fbe00640 1 -- 172.21.15.67:0/327750565 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0d33b0 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa600c00640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc06d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.729+0000 7fa5faa00640 1 -- 172.21.15.67:0/327750565 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207799478 0 0) 0x7fa5fc0d2b10 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.730+0000 7fa5fbe00640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009850 tx=0x7fa5ec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9f55490cb45a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.730+0000 7fa5faa00640 1 -- 172.21.15.67:0/327750565 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec004230 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.730+0000 7fa5faa00640 1 -- 172.21.15.67:0/327750565 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0043d0 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.730+0000 7fa5faa00640 1 -- 172.21.15.67:0/327750565 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec003810 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 -- 172.21.15.67:0/327750565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15e7e0 msgr2=0x7fa5fc0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009850 tx=0x7fa5ec02b960 comp rx=0 tx=0).stop 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 -- 172.21.15.67:0/327750565 shutdown_connections 2024-04-16T13:06:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc06d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 --2- 172.21.15.67:0/327750565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc0d0240 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 -- 172.21.15.67:0/327750565 >> 172.21.15.67:0/327750565 conn(0x7fa5fc09da60 msgr2=0x7fa5fc08c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 -- 172.21.15.67:0/327750565 shutdown_connections 2024-04-16T13:06:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.731+0000 7fa601600640 1 -- 172.21.15.67:0/327750565 wait complete. 2024-04-16T13:06:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.733+0000 7fa601600640 1 Processor -- start 2024-04-16T13:06:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.733+0000 7fa601600640 1 -- start start 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc1f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d28d0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d2750 con 0x7fa5fc15e7e0 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa601600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc15ebc0 con 0x7fa5fc0d17f0 2024-04-16T13:06:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa5fb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa5fb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41940/0 (socket says 172.21.15.67:41940) 2024-04-16T13:06:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.734+0000 7fa5fb400640 1 -- 172.21.15.67:0/3769303106 learned_addr learned my addr 172.21.15.67:0/3769303106 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa600c00640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc1f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 -- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 msgr2=0x7fa5fc161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 -- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 msgr2=0x7fa5fc1f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc1f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 -- 172.21.15.67:0/3769303106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0ce560 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa600c00640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc1f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5fb400640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c500 tx=0x7fa5e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4018070 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e4007580 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4004a20 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc0c95d0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.735+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc0cdd60 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.737+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5fc075bd0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.738+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5e4004bc0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.739+0000 7fa5f3e00640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:00.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.739+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa5e408b180 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.739+0000 7fa5fbe00640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:00.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.740+0000 7fa5fbe00640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec035000 tx=0x7fa5ec030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:00.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.743+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5e40591a0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.947+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa5fc08c250 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.948+0000 7fa5f3e00640 1 -- 172.21.15.67:0/3769303106 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa5e4058aa0 con 0x7fa5fc0d22c0 2024-04-16T13:06:00.949 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.950+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 msgr2=0x7fa5d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.950+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec035000 tx=0x7fa5ec030000 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.950+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 msgr2=0x7fa5fc158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.950+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400c500 tx=0x7fa5e400c9c0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 shutdown_connections 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa5d806c8f0 0x7fa5d806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5fc15e7e0 0x7fa5fc1f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5fc0d22c0 0x7fa5fc158f80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 --2- 172.21.15.67:0/3769303106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5fc0d17f0 0x7fa5fc161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 >> 172.21.15.67:0/3769303106 conn(0x7fa5fc09da60 msgr2=0x7fa5fc0698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:00.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 shutdown_connections 2024-04-16T13:06:00.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:00.951+0000 7fa601600640 1 -- 172.21.15.67:0/3769303106 wait complete. 2024-04-16T13:06:00.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:06:01.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.201+0000 7fd97b200640 1 Processor -- start 2024-04-16T13:06:01.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.201+0000 7fd97b200640 1 -- start start 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd97b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd97409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd97b200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd97409afb0 0x7fd97415e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd97b200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9740d1220 con 0x7fd9740b3ab0 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd97b200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9740cdd10 con 0x7fd97409afb0 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd97b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9740d1500 con 0x7fd97406dc60 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd973e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd9740b3ab0 0x7fd9740d0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51482/0 (socket says 172.21.15.67:51482) 2024-04-16T13:06:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd973e00640 1 -- 172.21.15.67:0/2000521314 learned_addr learned my addr 172.21.15.67:0/2000521314 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:01.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd979200640 1 --2- 172.21.15.67:0/2000521314 >> v2:172.21.15.82:3300/0 conn(0x7fd97409afb0 0x7fd97415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.203+0000 7fd973400640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd97409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492448526 0 0) 0x7fd9740d1220 con 0x7fd9740b3ab0 2024-04-16T13:06:01.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd954003520 con 0x7fd9740b3ab0 2024-04-16T13:06:01.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1917165911 0 0) 0x7fd954003520 con 0x7fd9740b3ab0 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 msgr2=0x7fd97409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd97409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 >> v2:172.21.15.82:3300/0 conn(0x7fd97409afb0 msgr2=0x7fd97415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 --2- 172.21.15.67:0/2000521314 >> v2:172.21.15.82:3300/0 conn(0x7fd97409afb0 0x7fd97415e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9740d17e0 con 0x7fd9740b3ab0 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fd964001670 con 0x7fd9740b3ab0 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 >> v1:172.21.15.67:6789/0 conn(0x7fd9740b3ab0 legacy=0x7fd9740d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd9540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd954003f80 0x7fd954004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954004d40 0x7fd9540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740cdd10 con 0x7fd954003f80 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740d1500 con 0x7fd954004d40 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.204+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd95400b9c0 con 0x7fd97406dc60 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd954003f80 0x7fd954004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973e00640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd9540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd979200640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954004d40 0x7fd9540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 -- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 msgr2=0x7fd9540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd97406dc60 0x7fd9540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 -- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954004d40 msgr2=0x7fd9540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954004d40 0x7fd9540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd973400640 1 -- 172.21.15.67:0/2000521314 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd954003520 con 0x7fd954003f80 2024-04-16T13:06:01.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.205+0000 7fd979200640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954004d40 0x7fd9540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.206+0000 7fd973400640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd954003f80 0x7fd954004800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00e170 tx=0x7fd954005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49eff6832ab663c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.206+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c039070 con 0x7fd954003f80 2024-04-16T13:06:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.206+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95c02cbf0 con 0x7fd954003f80 2024-04-16T13:06:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.206+0000 7fd972a00640 1 -- 172.21.15.67:0/2000521314 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c009c10 con 0x7fd954003f80 2024-04-16T13:06:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 -- 172.21.15.67:0/2000521314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd954003f80 msgr2=0x7fd954004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 --2- 172.21.15.67:0/2000521314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd954003f80 0x7fd954004800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00e170 tx=0x7fd954005830 comp rx=0 tx=0).stop 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd979200640 1 -- 172.21.15.67:0/2000521314 reap_dead start 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 -- 172.21.15.67:0/2000521314 shutdown_connections 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 -- 172.21.15.67:0/2000521314 >> 172.21.15.67:0/2000521314 conn(0x7fd9740b41a0 msgr2=0x7fd9740b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 -- 172.21.15.67:0/2000521314 shutdown_connections 2024-04-16T13:06:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.207+0000 7fd97b200640 1 -- 172.21.15.67:0/2000521314 wait complete. 2024-04-16T13:06:01.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.210+0000 7fd97b200640 1 Processor -- start 2024-04-16T13:06:01.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.210+0000 7fd97b200640 1 -- start start 2024-04-16T13:06:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954003f80 0x7fd9741f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9741592d0 0x7fd9740c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740d22c0 con 0x7fd974159730 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740d1da0 con 0x7fd954003f80 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd97b200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9740b3e90 con 0x7fd9741592d0 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd979200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd979200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41956/0 (socket says 172.21.15.67:41956) 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd979200640 1 -- 172.21.15.67:0/1479447450 learned_addr learned my addr 172.21.15.67:0/1479447450 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd973e00640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954003f80 0x7fd9741f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.212+0000 7fd973400640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9741592d0 0x7fd9740c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 -- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9741592d0 msgr2=0x7fd9740c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9741592d0 0x7fd9740c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 -- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954003f80 msgr2=0x7fd9741f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954003f80 0x7fd9741f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 -- 172.21.15.67:0/1479447450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97415a9f0 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd979200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd9740734a0 tx=0x7fd96c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00f040 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c01c070 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00ea90 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.213+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97415acd0 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.214+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97415b290 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.215+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd974075380 con 0x7fd974159730 2024-04-16T13:06:01.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.216+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd96c00ec30 con 0x7fd974159730 2024-04-16T13:06:01.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.217+0000 7fd96be00640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 0x7fd95006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.217+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd96c08bca0 con 0x7fd974159730 2024-04-16T13:06:01.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.217+0000 7fd973e00640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 0x7fd95006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.219+0000 7fd973e00640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 0x7fd95006edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd964005a30 tx=0x7fd964009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.221+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd974075380 con 0x7fd974159730 2024-04-16T13:06:01.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.422+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd974069f20 con 0x7fd974159730 2024-04-16T13:06:01.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.423+0000 7fd96be00640 1 -- 172.21.15.67:0/1479447450 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fd96c026020 con 0x7fd974159730 2024-04-16T13:06:01.424 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 msgr2=0x7fd95006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 0x7fd95006edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd964005a30 tx=0x7fd964009040 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 msgr2=0x7fd9740b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd9740734a0 tx=0x7fd96c010c20 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 shutdown_connections 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd95006c8f0 0x7fd95006edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd974159730 0x7fd9740b69a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9741592d0 0x7fd9740c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 --2- 172.21.15.67:0/1479447450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd954003f80 0x7fd9741f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 >> 172.21.15.67:0/1479447450 conn(0x7fd9740b41a0 msgr2=0x7fd97406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 shutdown_connections 2024-04-16T13:06:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.426+0000 7fd97b200640 1 -- 172.21.15.67:0/1479447450 wait complete. 2024-04-16T13:06:01.446 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:06:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.648+0000 7f7e90c00640 1 Processor -- start 2024-04-16T13:06:01.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.648+0000 7f7e90c00640 1 -- start start 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e90c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e8c15eca0 0x7f7e8c0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e90c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e90c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8c0d04d0 con 0x7f7e8c0d4270 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e90c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7e8c0b6e10 con 0x7f7e8c15eca0 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e90c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b6200 con 0x7f7e8c0b7e70 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e8be00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7e8c0d4270 0x7f7e8c0d2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:51488/0 (socket says 172.21.15.67:51488) 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e8be00640 1 -- 172.21.15.67:0/991364100 learned_addr learned my addr 172.21.15.67:0/991364100 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e8b400640 1 --2- 172.21.15.67:0/991364100 >> v2:172.21.15.67:3300/0 conn(0x7f7e8c15eca0 0x7f7e8c0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.650+0000 7f7e8aa00640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8a000640 1 -- 172.21.15.67:0/991364100 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631661727 0 0) 0x7f7e8c0d04d0 con 0x7f7e8c0d4270 2024-04-16T13:06:01.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8a000640 1 -- 172.21.15.67:0/991364100 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e70003520 con 0x7f7e8c0d4270 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8b400640 1 -- 172.21.15.67:0/991364100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 msgr2=0x7f7e8c0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8b400640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8b400640 1 -- 172.21.15.67:0/991364100 >> v1:172.21.15.67:6789/0 conn(0x7f7e8c0d4270 legacy=0x7f7e8c0d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8b400640 1 -- 172.21.15.67:0/991364100 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c0b64e0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.651+0000 7f7e8aa00640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:01.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.652+0000 7f7e8b400640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c0cedd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0b6f90 tx=0x7f7e7c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0beb28f2c818cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.653+0000 7f7e8a000640 1 -- 172.21.15.67:0/991364100 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c035020 con 0x7f7e8c15eca0 2024-04-16T13:06:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.653+0000 7f7e8a000640 1 -- 172.21.15.67:0/991364100 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c031800 con 0x7f7e8c15eca0 2024-04-16T13:06:01.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.653+0000 7f7e8a000640 1 -- 172.21.15.67:0/991364100 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c031bb0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 -- 172.21.15.67:0/991364100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 msgr2=0x7f7e8c0cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c0cedd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0b6f90 tx=0x7f7e7c02b8a0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 -- 172.21.15.67:0/991364100 shutdown_connections 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 --2- 172.21.15.67:0/991364100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c0cedd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 -- 172.21.15.67:0/991364100 >> 172.21.15.67:0/991364100 conn(0x7f7e8c06ccc0 msgr2=0x7f7e8c06d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 -- 172.21.15.67:0/991364100 shutdown_connections 2024-04-16T13:06:01.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.654+0000 7f7e90c00640 1 -- 172.21.15.67:0/991364100 wait complete. 2024-04-16T13:06:01.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.656+0000 7f7e90c00640 1 Processor -- start 2024-04-16T13:06:01.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.656+0000 7f7e90c00640 1 -- start start 2024-04-16T13:06:01.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 0x7f7e8c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c15f080 con 0x7f7e8c15eca0 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0b6aa0 con 0x7f7e8c0d4270 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e90c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c15f200 con 0x7f7e8c0b7e70 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e8be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e8be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41980/0 (socket says 172.21.15.67:41980) 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e8be00640 1 -- 172.21.15.67:0/939489357 learned_addr learned my addr 172.21.15.67:0/939489357 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e8b400640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.657+0000 7f7e8aa00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 0x7f7e8c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 -- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 msgr2=0x7f7e8c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 -- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 msgr2=0x7f7e8c15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 0x7f7e8c15ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 -- 172.21.15.67:0/939489357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c15dce0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8aa00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 0x7f7e8c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e8be00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400caa0 tx=0x7f7e8400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84017070 con 0x7f7e8c15eca0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8400ac00 con 0x7f7e8c15eca0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84012400 con 0x7f7e8c15eca0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c15dfc0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.658+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c0cabe0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.659+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c075bd0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.660+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e8401a070 con 0x7f7e8c15eca0 2024-04-16T13:06:01.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.661+0000 7f7e83400640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 0x7f7e6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:01.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.661+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7e8408bd60 con 0x7f7e8c15eca0 2024-04-16T13:06:01.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.662+0000 7f7e8b400640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 0x7f7e6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:01.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.663+0000 7f7e8b400640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 0x7f7e6c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c036000 tx=0x7f7e7c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:01.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.666+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e84059cf0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.886+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e8c0d02b0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.887+0000 7f7e83400640 1 -- 172.21.15.67:0/939489357 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f7e840595f0 con 0x7f7e8c15eca0 2024-04-16T13:06:01.889 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:06:01.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 msgr2=0x7f7e6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 0x7f7e6c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c036000 tx=0x7f7e7c008030 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 msgr2=0x7f7e8c15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400caa0 tx=0x7f7e8400cf60 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 shutdown_connections 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7e6c06c8f0 0x7f7e6c06edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e8c15eca0 0x7f7e8c15b2e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c0d4270 0x7f7e8c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 --2- 172.21.15.67:0/939489357 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7e8c0b7e70 0x7f7e8c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.890+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 >> 172.21.15.67:0/939489357 conn(0x7f7e8c06ccc0 msgr2=0x7f7e8c0cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.891+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 shutdown_connections 2024-04-16T13:06:01.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:01.891+0000 7f7e90c00640 1 -- 172.21.15.67:0/939489357 wait complete. 2024-04-16T13:06:01.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-16T13:06:01.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:01.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-16T13:06:02.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:06:02.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:02.015 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-16T13:06:02.068 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:06:02.068 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:02.125 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:06:02.125 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:02.182 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:06:02.182 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:02.232 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:02.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.464+0000 7fda16c00640 1 Processor -- start 2024-04-16T13:06:02.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.464+0000 7fda16c00640 1 -- start start 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.466+0000 7fda16c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fda1015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.466+0000 7fda16c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1006dd50 con 0x7fda10071e50 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda16c00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1015d4e0 con 0x7fda10146150 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda16c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda1015d7c0 con 0x7fda100cec90 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda14c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fda10071e50 0x7fda1006e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36316/0 (socket says 172.21.15.67:36316) 2024-04-16T13:06:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda14c00640 1 -- 172.21.15.67:0/3204298171 learned_addr learned my addr 172.21.15.67:0/3204298171 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda07400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fda1015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.467+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305324446 0 0) 0x7fda1006dd50 con 0x7fda10071e50 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f4003520 con 0x7fda10071e50 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619312829 0 0) 0x7fd9f4003520 con 0x7fda10071e50 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 msgr2=0x7fda1015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fda1015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 >> v1:172.21.15.82:6789/0 conn(0x7fda10146150 legacy=0x7fda1015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1015daa0 con 0x7fda10071e50 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fda08001670 con 0x7fda10071e50 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 >> v1:172.21.15.67:6789/0 conn(0x7fda10071e50 legacy=0x7fda1006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9f40039e0 0x7fd9f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f4004800 0x7fd9f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fd9f4005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fda1015d7c0 con 0x7fd9f40039e0 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f400bb80 con 0x7fd9f4004800 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f400bd80 con 0x7fda100cec90 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.468+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9f40039e0 0x7fd9f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda07400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f4004800 0x7fd9f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda14c00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fd9f4005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda0fe00640 1 -- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 msgr2=0x7fd9f4005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda100cec90 0x7fd9f4005290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda0fe00640 1 -- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f4004800 msgr2=0x7fd9f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f4004800 0x7fd9f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda0fe00640 1 -- 172.21.15.67:0/3204298171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f4003520 con 0x7fd9f40039e0 2024-04-16T13:06:02.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.469+0000 7fda07400640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f4004800 0x7fd9f4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.470+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9f40039e0 0x7fd9f4003e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda00001750 tx=0x7fd9f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8b75df53a2d59b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.470+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00001370 con 0x7fd9f40039e0 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.470+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda000052d0 con 0x7fd9f40039e0 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.470+0000 7fda0f400640 1 -- 172.21.15.67:0/3204298171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00003830 con 0x7fd9f40039e0 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 -- 172.21.15.67:0/3204298171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9f40039e0 msgr2=0x7fd9f4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 --2- 172.21.15.67:0/3204298171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9f40039e0 0x7fd9f4003e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda00001750 tx=0x7fd9f4005830 comp rx=0 tx=0).stop 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda14c00640 1 -- 172.21.15.67:0/3204298171 reap_dead start 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 -- 172.21.15.67:0/3204298171 shutdown_connections 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 -- 172.21.15.67:0/3204298171 >> 172.21.15.67:0/3204298171 conn(0x7fda100b2210 msgr2=0x7fda100b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 -- 172.21.15.67:0/3204298171 shutdown_connections 2024-04-16T13:06:02.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.471+0000 7fda16c00640 1 -- 172.21.15.67:0/3204298171 wait complete. 2024-04-16T13:06:02.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.473+0000 7fda16c00640 1 Processor -- start 2024-04-16T13:06:02.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.473+0000 7fda16c00640 1 -- start start 2024-04-16T13:06:02.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40039e0 0x7fda101f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 0x7fda101e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fda100722e0 con 0x7fda1015c660 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda1006eb70 con 0x7fd9f40039e0 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.474+0000 7fda16c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fda10072460 con 0x7fda1015c200 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50596/0 (socket says 172.21.15.67:50596) 2024-04-16T13:06:02.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 -- 172.21.15.67:0/3887449836 learned_addr learned my addr 172.21.15.67:0/3887449836 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40039e0 0x7fda101f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda07400640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 0x7fda101e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 -- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 msgr2=0x7fda101e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 0x7fda101e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 -- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40039e0 msgr2=0x7fda101f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40039e0 0x7fda101f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 -- 172.21.15.67:0/3887449836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda101e5e00 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda07400640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 0x7fda101e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.475+0000 7fda14c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda080010e0 tx=0x7fda0800d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.476+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08007440 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.476+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda080075e0 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.476+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08004a20 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.476+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda101e60e0 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.476+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda101e66a0 con 0x7fda1015c660 2024-04-16T13:06:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.477+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda10075bd0 con 0x7fda1015c660 2024-04-16T13:06:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.478+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda08004bc0 con 0x7fda1015c660 2024-04-16T13:06:02.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.479+0000 7fda0cc00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 0x7fd9ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.480+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fda0808bb60 con 0x7fda1015c660 2024-04-16T13:06:02.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.480+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 0x7fd9ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.481+0000 7fda0fe00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 0x7fd9ec06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda00033000 tx=0x7fda00009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.484+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fda0801a060 con 0x7fda1015c660 2024-04-16T13:06:02.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.693+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda100d0240 con 0x7fda1015c660 2024-04-16T13:06:02.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.697+0000 7fda0cc00640 1 -- 172.21.15.67:0/3887449836 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7fda08059b00 con 0x7fda1015c660 2024-04-16T13:06:02.699 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:02.699 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.700+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 msgr2=0x7fd9ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.700+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 0x7fd9ec06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda00033000 tx=0x7fda00009030 comp rx=0 tx=0).stop 2024-04-16T13:06:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.700+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 msgr2=0x7fda101e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.700+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda080010e0 tx=0x7fda0800d900 comp rx=0 tx=0).stop 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 shutdown_connections 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd9ec06c8f0 0x7fd9ec06edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda1015c660 0x7fda101e7d30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fda1015c200 0x7fda101e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 --2- 172.21.15.67:0/3887449836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9f40039e0 0x7fda101f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 >> 172.21.15.67:0/3887449836 conn(0x7fda100b2210 msgr2=0x7fda100cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 shutdown_connections 2024-04-16T13:06:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.701+0000 7fda16c00640 1 -- 172.21.15.67:0/3887449836 wait complete. 2024-04-16T13:06:02.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:06:02.724 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:06:02.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.945+0000 7f8393000640 1 Processor -- start 2024-04-16T13:06:02.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.945+0000 7f8393000640 1 -- start start 2024-04-16T13:06:02.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.946+0000 7f8393000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 0x7f838c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.946+0000 7f8393000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f838c0cfdb0 con 0x7f838c0cf070 2024-04-16T13:06:02.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.946+0000 7f8393000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f838c15fe90 con 0x7f838c0d04b0 2024-04-16T13:06:02.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.946+0000 7f8393000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f838c0b3650 con 0x7f838c0cf9d0 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.947+0000 7f8392600640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f838c0cf070 0x7f838c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36320/0 (socket says 172.21.15.67:36320) 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.947+0000 7f8392600640 1 -- 172.21.15.67:0/4123986623 learned_addr learned my addr 172.21.15.67:0/4123986623 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.947+0000 7f8391c00640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 0x7f838c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.947+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626138318 0 0) 0x7f838c0cfdb0 con 0x7f838c0cf070 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.947+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8374005730 con 0x7f838c0cf070 2024-04-16T13:06:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007769173 0 0) 0x7f8374005730 con 0x7f838c0cf070 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 msgr2=0x7f838c15c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 0x7f838c15c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 >> v1:172.21.15.82:6789/0 conn(0x7f838c0d04b0 legacy=0x7f838c15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c0b3930 con 0x7f838c0cf070 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f83840019f0 con 0x7f838c0cf070 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 >> v1:172.21.15.67:6789/0 conn(0x7f838c0cf070 legacy=0x7f838c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 0x7f8374005cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8374006250 0x7f8374006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8374006f50 0x7f83740073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f838c0b3650 con 0x7f8374006f50 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f837400ddc0 con 0x7f8374006250 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f837400dfc0 con 0x7f838c0cf9d0 2024-04-16T13:06:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.948+0000 7f8392600640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8374006f50 0x7f83740073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8391200640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8374006250 0x7f8374006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8392600640 1 -- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 msgr2=0x7f8374005cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8392600640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c0cf9d0 0x7f8374005cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8392600640 1 -- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8374006250 msgr2=0x7f8374006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8392600640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8374006250 0x7f8374006a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.949+0000 7f8392600640 1 -- 172.21.15.67:0/4123986623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8374005730 con 0x7f8374006f50 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.950+0000 7f8392600640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8374006f50 0x7f83740073d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f838400a830 tx=0x7f8374007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8cae1e3bc66fee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.950+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838400a480 con 0x7f8374006f50 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.950+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8384034630 con 0x7f8374006f50 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.950+0000 7f838be00640 1 -- 172.21.15.67:0/4123986623 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384034a80 con 0x7f8374006f50 2024-04-16T13:06:02.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 -- 172.21.15.67:0/4123986623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8374006f50 msgr2=0x7f83740073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 --2- 172.21.15.67:0/4123986623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8374006f50 0x7f83740073d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f838400a830 tx=0x7f8374007a40 comp rx=0 tx=0).stop 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8392600640 1 -- 172.21.15.67:0/4123986623 reap_dead start 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 -- 172.21.15.67:0/4123986623 shutdown_connections 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 -- 172.21.15.67:0/4123986623 >> 172.21.15.67:0/4123986623 conn(0x7f838c06bc00 msgr2=0x7f838c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 -- 172.21.15.67:0/4123986623 shutdown_connections 2024-04-16T13:06:02.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.951+0000 7f8393000640 1 -- 172.21.15.67:0/4123986623 wait complete. 2024-04-16T13:06:02.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.953+0000 7f8393000640 1 Processor -- start 2024-04-16T13:06:02.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.953+0000 7f8393000640 1 -- start start 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c1f3fa0 0x7f838c1f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c09a670 0x7f838c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f838c0b41d0 con 0x7f838c0b2420 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f838c0b3ef0 con 0x7f838c09a670 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8393000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f838c0cab50 con 0x7f838c1f3fa0 2024-04-16T13:06:02.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.954+0000 7f8392600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50612/0 (socket says 172.21.15.67:50612) 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 -- 172.21.15.67:0/4198501148 learned_addr learned my addr 172.21.15.67:0/4198501148 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8391c00640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c1f3fa0 0x7f838c1f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8391200640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c09a670 0x7f838c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 -- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c1f3fa0 msgr2=0x7f838c1f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c1f3fa0 0x7f838c1f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 -- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c09a670 msgr2=0x7f838c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c09a670 0x7f838c0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 -- 172.21.15.67:0/4198501148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c1f81b0 con 0x7f838c0b2420 2024-04-16T13:06:02.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.955+0000 7f8392600640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8384001cf0 tx=0x7f838c0b3b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.956+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838400a480 con 0x7f838c0b2420 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.956+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8384045070 con 0x7f838c0b2420 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.956+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384034bf0 con 0x7f838c0b2420 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.956+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c1f8490 con 0x7f838c0b2420 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.956+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c1f8a50 con 0x7f838c0b2420 2024-04-16T13:06:02.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.957+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c075bd0 con 0x7f838c0b2420 2024-04-16T13:06:02.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.958+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f838404a460 con 0x7f838c0b2420 2024-04-16T13:06:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.959+0000 7f8389600640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 0x7f836c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:02.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.959+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f83840ae550 con 0x7f838c0b2420 2024-04-16T13:06:02.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.960+0000 7f8391c00640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 0x7f836c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:02.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.961+0000 7f8391c00640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 0x7f836c06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8380004770 tx=0x7f8380008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:02.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:02.964+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8384032380 con 0x7f838c0b2420 2024-04-16T13:06:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.167+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f838c1f8c50 con 0x7f838c0b2420 2024-04-16T13:06:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.167+0000 7f8389600640 1 -- 172.21.15.67:0/4198501148 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f838407c570 con 0x7f838c0b2420 2024-04-16T13:06:03.168 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:06:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 msgr2=0x7f836c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 0x7f836c06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8380004770 tx=0x7f8380008040 comp rx=0 tx=0).stop 2024-04-16T13:06:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 msgr2=0x7f838c0990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8384001cf0 tx=0x7f838c0b3b00 comp rx=0 tx=0).stop 2024-04-16T13:06:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 shutdown_connections 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f836c06c920 0x7f836c06ede0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f838c0b2420 0x7f838c0990d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c09a670 0x7f838c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 --2- 172.21.15.67:0/4198501148 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f838c1f3fa0 0x7f838c1f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 >> 172.21.15.67:0/4198501148 conn(0x7f838c06bc00 msgr2=0x7f838c0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 shutdown_connections 2024-04-16T13:06:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.170+0000 7f8393000640 1 -- 172.21.15.67:0/4198501148 wait complete. 2024-04-16T13:06:03.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:06:03.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.420+0000 7f646d600640 1 Processor -- start 2024-04-16T13:06:03.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.420+0000 7f646d600640 1 -- start start 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646d600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f646815e7e0 0x7f64680d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646d600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f64680d22c0 0x7f64680d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646d600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64680d2b10 con 0x7f64680d1620 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646d600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f64680d1a80 con 0x7f64680d22c0 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646d600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f64680d2df0 con 0x7f646815e7e0 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f6467400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f64680d22c0 0x7f64680d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646cc00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f64680d1620 0x7f64680d4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36332/0 (socket says 172.21.15.67:36332) 2024-04-16T13:06:03.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.422+0000 7f646cc00640 1 -- 172.21.15.67:0/3459040550 learned_addr learned my addr 172.21.15.67:0/3459040550 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:03.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6467e00640 1 --2- 172.21.15.67:0/3459040550 >> v2:172.21.15.82:3300/0 conn(0x7f646815e7e0 0x7f64680d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6467400640 1 -- 172.21.15.67:0/3459040550 >> v2:172.21.15.82:3300/0 conn(0x7f646815e7e0 msgr2=0x7f64680d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:03.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6467400640 1 --2- 172.21.15.67:0/3459040550 >> v2:172.21.15.82:3300/0 conn(0x7f646815e7e0 0x7f64680d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6467400640 1 -- 172.21.15.67:0/3459040550 >> v1:172.21.15.67:6789/0 conn(0x7f64680d1620 legacy=0x7f64680d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6467400640 1 -- 172.21.15.67:0/3459040550 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64680d30d0 con 0x7f64680d22c0 2024-04-16T13:06:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.423+0000 7f6466a00640 1 -- 172.21.15.67:0/3459040550 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710526158 0 0) 0x7f64680d2b10 con 0x7f64680d1620 2024-04-16T13:06:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.424+0000 7f6467400640 1 --2- 172.21.15.67:0/3459040550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64680d22c0 0x7f64680d10e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f646808e7d0 tx=0x7f645402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dcfaf2144e18be server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.424+0000 7f6466a00640 1 -- 172.21.15.67:0/3459040550 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454035020 con 0x7f64680d22c0 2024-04-16T13:06:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.424+0000 7f6466a00640 1 -- 172.21.15.67:0/3459040550 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454031830 con 0x7f64680d22c0 2024-04-16T13:06:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.424+0000 7f6466a00640 1 -- 172.21.15.67:0/3459040550 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454031c00 con 0x7f64680d22c0 2024-04-16T13:06:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 -- 172.21.15.67:0/3459040550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64680d22c0 msgr2=0x7f64680d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 --2- 172.21.15.67:0/3459040550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64680d22c0 0x7f64680d10e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f646808e7d0 tx=0x7f645402b8d0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 -- 172.21.15.67:0/3459040550 shutdown_connections 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 --2- 172.21.15.67:0/3459040550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64680d22c0 0x7f64680d10e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 --2- 172.21.15.67:0/3459040550 >> v2:172.21.15.82:3300/0 conn(0x7f646815e7e0 0x7f64680d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 -- 172.21.15.67:0/3459040550 >> 172.21.15.67:0/3459040550 conn(0x7f646809da60 msgr2=0x7f646808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 -- 172.21.15.67:0/3459040550 shutdown_connections 2024-04-16T13:06:03.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.425+0000 7f646d600640 1 -- 172.21.15.67:0/3459040550 wait complete. 2024-04-16T13:06:03.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.427+0000 7f646d600640 1 Processor -- start 2024-04-16T13:06:03.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.427+0000 7f646d600640 1 -- start start 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64680d1620 0x7f64680cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64680d22c0 0x7f64680b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64680d2750 con 0x7f646815e7e0 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64680d36d0 con 0x7f64680d1620 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646d600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f64680d28d0 con 0x7f64680d22c0 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.428+0000 7f646cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50628/0 (socket says 172.21.15.67:50628) 2024-04-16T13:06:03.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 -- 172.21.15.67:0/1694582469 learned_addr learned my addr 172.21.15.67:0/1694582469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f6467e00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64680d1620 0x7f64680cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f6467400640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64680d22c0 0x7f64680b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 -- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64680d22c0 msgr2=0x7f64680b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64680d22c0 0x7f64680b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 -- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64680d1620 msgr2=0x7f64680cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64680d1620 0x7f64680cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 -- 172.21.15.67:0/1694582469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64680ce130 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.429+0000 7f646cc00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f646000c480 tx=0x7f646000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.430+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460018070 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.430+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6460007500 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.430+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460004a20 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.430+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64680cd890 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.430+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64680cde50 con 0x7f646815e7e0 2024-04-16T13:06:03.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.431+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6468075bd0 con 0x7f646815e7e0 2024-04-16T13:06:03.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.433+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f646001b070 con 0x7f646815e7e0 2024-04-16T13:06:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.434+0000 7f645fe00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 0x7f644806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.434+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f646008b230 con 0x7f646815e7e0 2024-04-16T13:06:03.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.434+0000 7f6467e00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 0x7f644806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.435+0000 7f6467e00640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 0x7f644806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6458009fb0 tx=0x7f645800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.438+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6460059290 con 0x7f646815e7e0 2024-04-16T13:06:03.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.652+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f64680b7c20 con 0x7f646815e7e0 2024-04-16T13:06:03.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.652+0000 7f645fe00640 1 -- 172.21.15.67:0/1694582469 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6460058b90 con 0x7f646815e7e0 2024-04-16T13:06:03.653 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:03.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 msgr2=0x7f644806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 0x7f644806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6458009fb0 tx=0x7f645800b040 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 msgr2=0x7f64680b90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f646000c480 tx=0x7f646000c940 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 shutdown_connections 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f644806c8f0 0x7f644806edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f646815e7e0 0x7f64680b90e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f64680d22c0 0x7f64680b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 --2- 172.21.15.67:0/1694582469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64680d1620 0x7f64680cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.655+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 >> 172.21.15.67:0/1694582469 conn(0x7f646809da60 msgr2=0x7f646815ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.656+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 shutdown_connections 2024-04-16T13:06:03.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.656+0000 7f646d600640 1 -- 172.21.15.67:0/1694582469 wait complete. 2024-04-16T13:06:03.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:06:03.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.890+0000 7f0163000640 1 Processor -- start 2024-04-16T13:06:03.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.890+0000 7f0163000640 1 -- start start 2024-04-16T13:06:03.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.892+0000 7f0163000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f015c144c40 0x7f015c0af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.892+0000 7f0163000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.892+0000 7f0163000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015c1633e0 con 0x7f015c071de0 2024-04-16T13:06:03.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.892+0000 7f0163000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f015c072780 con 0x7f015c144c40 2024-04-16T13:06:03.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.892+0000 7f0163000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f015c163100 con 0x7f015c162b90 2024-04-16T13:06:03.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.893+0000 7f0161c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f015c144c40 0x7f015c0af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.893+0000 7f0161c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f015c144c40 0x7f015c0af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.67:58040/0 (socket says 172.21.15.67:58040) 2024-04-16T13:06:03.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.893+0000 7f0161c00640 1 -- 172.21.15.67:0/1797622172 learned_addr learned my addr 172.21.15.67:0/1797622172 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:03.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.893+0000 7f0161200640 1 --1- 172.21.15.67:0/1797622172 >> v1:172.21.15.82:6789/0 conn(0x7f015c071de0 0x7f015c162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:37682/0 (socket says 172.21.15.67:37682) 2024-04-16T13:06:03.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.893+0000 7f0162600640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.894+0000 7f0161c00640 1 -- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 msgr2=0x7f015c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.894+0000 7f0161c00640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.894+0000 7f0161c00640 1 -- 172.21.15.67:0/1797622172 >> v1:172.21.15.82:6789/0 conn(0x7f015c071de0 legacy=0x7f015c162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.894+0000 7f0161c00640 1 -- 172.21.15.67:0/1797622172 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c0aece0 con 0x7f015c144c40 2024-04-16T13:06:03.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.895+0000 7f0161c00640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c144c40 0x7f015c0af7c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0150009870 tx=0x7f015002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6603ab095d990b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.896+0000 7f015be00640 1 -- 172.21.15.67:0/1797622172 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150034070 con 0x7f015c144c40 2024-04-16T13:06:03.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.896+0000 7f015be00640 1 -- 172.21.15.67:0/1797622172 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0150030840 con 0x7f015c144c40 2024-04-16T13:06:03.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.896+0000 7f015be00640 1 -- 172.21.15.67:0/1797622172 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150030c10 con 0x7f015c144c40 2024-04-16T13:06:03.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 -- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c144c40 msgr2=0x7f015c0af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c144c40 0x7f015c0af7c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0150009870 tx=0x7f015002b980 comp rx=0 tx=0).stop 2024-04-16T13:06:03.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 -- 172.21.15.67:0/1797622172 shutdown_connections 2024-04-16T13:06:03.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 --2- 172.21.15.67:0/1797622172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c144c40 0x7f015c0af7c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 -- 172.21.15.67:0/1797622172 >> 172.21.15.67:0/1797622172 conn(0x7f015c067d90 msgr2=0x7f015c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:03.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 -- 172.21.15.67:0/1797622172 shutdown_connections 2024-04-16T13:06:03.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.897+0000 7f0163000640 1 -- 172.21.15.67:0/1797622172 wait complete. 2024-04-16T13:06:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.899+0000 7f0163000640 1 Processor -- start 2024-04-16T13:06:03.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.899+0000 7f0163000640 1 -- start start 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c071de0 0x7f015c15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0afd00 con 0x7f015c144c40 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f015c0af2a0 con 0x7f015c071de0 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0163000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f015c0afe80 con 0x7f015c162b90 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0161200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0161200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50644/0 (socket says 172.21.15.67:50644) 2024-04-16T13:06:03.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0161200640 1 -- 172.21.15.67:0/342804802 learned_addr learned my addr 172.21.15.67:0/342804802 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.900+0000 7f0161c00640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c071de0 0x7f015c15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 -- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 msgr2=0x7f015c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 -- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c071de0 msgr2=0x7f015c15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c071de0 0x7f015c15e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 -- 172.21.15.67:0/342804802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c0b3e50 con 0x7f015c144c40 2024-04-16T13:06:03.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0161200640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f014800c400 tx=0x7f014800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01480074e0 con 0x7f015c144c40 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0148007680 con 0x7f015c144c40 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c0b4130 con 0x7f015c144c40 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.901+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148004a00 con 0x7f015c144c40 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.902+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c0b46f0 con 0x7f015c144c40 2024-04-16T13:06:03.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.903+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015c06bf50 con 0x7f015c144c40 2024-04-16T13:06:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.904+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f014801a020 con 0x7f015c144c40 2024-04-16T13:06:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.905+0000 7f0159600640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:03.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.905+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f014808b750 con 0x7f015c144c40 2024-04-16T13:06:03.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.905+0000 7f0161c00640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:03.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.906+0000 7f0161c00640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 0x7f013c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0150036000 tx=0x7f015003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:03.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:03.909+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f015c06bf50 con 0x7f015c144c40 2024-04-16T13:06:04.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.114+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f015c075bd0 con 0x7f015c144c40 2024-04-16T13:06:04.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.114+0000 7f0159600640 1 -- 172.21.15.67:0/342804802 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f0148010300 con 0x7f015c144c40 2024-04-16T13:06:04.116 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:06:04.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 msgr2=0x7f013c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 0x7f013c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0150036000 tx=0x7f015003b040 comp rx=0 tx=0).stop 2024-04-16T13:06:04.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 msgr2=0x7f015c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f014800c400 tx=0x7f014800c8c0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 shutdown_connections 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f015c162b90 0x7f015c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f015c144c40 0x7f015c0ce270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 --2- 172.21.15.67:0/342804802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f015c071de0 0x7f015c15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 >> 172.21.15.67:0/342804802 conn(0x7f015c067d90 msgr2=0x7f015c143c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 shutdown_connections 2024-04-16T13:06:04.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.117+0000 7f0163000640 1 -- 172.21.15.67:0/342804802 wait complete. 2024-04-16T13:06:04.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:06:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.365+0000 7f9403200640 1 Processor -- start 2024-04-16T13:06:04.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.365+0000 7f9403200640 1 -- start start 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.366+0000 7f9403200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f940415e7e0 0x7f94040d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.366+0000 7f9403200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 0x7f940406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.366+0000 7f9403200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94040d2b10 con 0x7f94040d22c0 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.366+0000 7f9403200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f94040d2df0 con 0x7f940415e7e0 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.366+0000 7f9403200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f94040d30d0 con 0x7f94040d17f0 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9401400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f94040d22c0 0x7f94040d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36340/0 (socket says 172.21.15.67:36340) 2024-04-16T13:06:04.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9401400640 1 -- 172.21.15.67:0/1283494437 learned_addr learned my addr 172.21.15.67:0/1283494437 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9402800640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 0x7f940406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9401e00640 1 --2- 172.21.15.67:0/1283494437 >> v2:172.21.15.82:3300/0 conn(0x7f940415e7e0 0x7f94040d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438629039 0 0) 0x7f94040d2b10 con 0x7f94040d22c0 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.367+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e8003520 con 0x7f94040d22c0 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354492986 0 0) 0x7f93e8003520 con 0x7f94040d22c0 2024-04-16T13:06:04.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 msgr2=0x7f940406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 0x7f940406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 >> v2:172.21.15.82:3300/0 conn(0x7f940415e7e0 msgr2=0x7f94040d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 --2- 172.21.15.67:0/1283494437 >> v2:172.21.15.82:3300/0 conn(0x7f940415e7e0 0x7f94040d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94040d33b0 con 0x7f94040d22c0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f93ec001670 con 0x7f94040d22c0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 >> v1:172.21.15.67:6789/0 conn(0x7f94040d22c0 legacy=0x7f94040d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e80039b0 0x7f93e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e8004800 0x7f93e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 0x7f93e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d2df0 con 0x7f93e80039b0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d30d0 con 0x7f93e8004800 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f93e800b9c0 con 0x7f94040d17f0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.368+0000 7f9401e00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e80039b0 0x7f93e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401400640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e8004800 0x7f93e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401e00640 1 -- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 msgr2=0x7f93e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401e00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040d17f0 0x7f93e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401e00640 1 -- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e8004800 msgr2=0x7f93e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401e00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e8004800 0x7f93e8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.369+0000 7f9401e00640 1 -- 172.21.15.67:0/1283494437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e8003520 con 0x7f93e80039b0 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.370+0000 7f9401e00640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e80039b0 0x7f93e8003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ab0 tx=0x7f93e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b9df80471c212a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.370+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4009680 con 0x7f93e80039b0 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.370+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4005990 con 0x7f93e80039b0 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.370+0000 7f9400a00640 1 -- 172.21.15.67:0/1283494437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4005d80 con 0x7f93e80039b0 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 -- 172.21.15.67:0/1283494437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e80039b0 msgr2=0x7f93e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 --2- 172.21.15.67:0/1283494437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e80039b0 0x7f93e8003dd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ab0 tx=0x7f93e8005830 comp rx=0 tx=0).stop 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9402800640 1 -- 172.21.15.67:0/1283494437 reap_dead start 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 -- 172.21.15.67:0/1283494437 shutdown_connections 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 -- 172.21.15.67:0/1283494437 >> 172.21.15.67:0/1283494437 conn(0x7f940409da60 msgr2=0x7f940408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 -- 172.21.15.67:0/1283494437 shutdown_connections 2024-04-16T13:06:04.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.371+0000 7f9403200640 1 -- 172.21.15.67:0/1283494437 wait complete. 2024-04-16T13:06:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.373+0000 7f9403200640 1 Processor -- start 2024-04-16T13:06:04.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.373+0000 7f9403200640 1 -- start start 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 0x7f94040cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040ce0b0 0x7f94040d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d28d0 con 0x7f9404153730 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d2750 con 0x7f93e80039b0 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9403200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f940415ebc0 con 0x7f94040ce0b0 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9402800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9402800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50652/0 (socket says 172.21.15.67:50652) 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.374+0000 7f9402800640 1 -- 172.21.15.67:0/104935832 learned_addr learned my addr 172.21.15.67:0/104935832 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9401400640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040ce0b0 0x7f94040d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9401e00640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 0x7f94040cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 -- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040ce0b0 msgr2=0x7f94040d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040ce0b0 0x7f94040d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 -- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 msgr2=0x7f94040cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 0x7f94040cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 -- 172.21.15.67:0/104935832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9404160040 con 0x7f9404153730 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9401e00640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 0x7f94040cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9402800640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94040cecc0 tx=0x7f93fc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00bd10 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc01a070 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc014640 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.375+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9404160320 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.376+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041608e0 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.377+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9404075bd0 con 0x7f9404153730 2024-04-16T13:06:04.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.377+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93fc005d10 con 0x7f9404153730 2024-04-16T13:06:04.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.378+0000 7f93fa000640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.378+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f93fc08c1c0 con 0x7f9404153730 2024-04-16T13:06:04.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.379+0000 7f9401e00640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.380+0000 7f9401e00640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 0x7f93e006edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93f4035000 tx=0x7f93f4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.383+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93fc05a150 con 0x7f9404153730 2024-04-16T13:06:04.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.587+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f94040c7f40 con 0x7f9404153730 2024-04-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.588+0000 7f93fa000640 1 -- 172.21.15.67:0/104935832 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f93fc059a50 con 0x7f9404153730 2024-04-16T13:06:04.589 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 msgr2=0x7f93e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 0x7f93e006edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93f4035000 tx=0x7f93f4030000 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 msgr2=0x7f94040d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94040cecc0 tx=0x7f93fc00b480 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 shutdown_connections 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9404153730 0x7f94040d0780 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f94040ce0b0 0x7f94040d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 --2- 172.21.15.67:0/104935832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80039b0 0x7f94040cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.590+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 >> 172.21.15.67:0/104935832 conn(0x7f940409da60 msgr2=0x7f94040b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.591+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 shutdown_connections 2024-04-16T13:06:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.591+0000 7f9403200640 1 -- 172.21.15.67:0/104935832 wait complete. 2024-04-16T13:06:04.611 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T13:06:04.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.839+0000 7f33e2a00640 1 Processor -- start 2024-04-16T13:06:04.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.839+0000 7f33e2a00640 1 -- start start 2024-04-16T13:06:04.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f33dc0724f0 0x7f33dc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33dc06dec0 con 0x7f33dc15cdc0 2024-04-16T13:06:04.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33dc06e1a0 con 0x7f33dc0ce990 2024-04-16T13:06:04.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f33dc06e7f0 con 0x7f33dc0724f0 2024-04-16T13:06:04.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f33dc15cdc0 0x7f33dc15d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36342/0 (socket says 172.21.15.67:36342) 2024-04-16T13:06:04.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.841+0000 7f33e2000640 1 -- 172.21.15.67:0/2687433402 learned_addr learned my addr 172.21.15.67:0/2687433402 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:04.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33e0c00640 1 --2- 172.21.15.67:0/2687433402 >> v2:172.21.15.82:3300/0 conn(0x7f33dc0724f0 0x7f33dc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254493922 0 0) 0x7f33dc06dec0 con 0x7f33dc15cdc0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33c0003520 con 0x7f33dc15cdc0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1448878075 0 0) 0x7f33c0003520 con 0x7f33dc15cdc0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 >> v2:172.21.15.82:3300/0 conn(0x7f33dc0724f0 msgr2=0x7f33dc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 --2- 172.21.15.67:0/2687433402 >> v2:172.21.15.82:3300/0 conn(0x7f33dc0724f0 0x7f33dc06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 >> v1:172.21.15.82:6789/0 conn(0x7f33dc0ce990 legacy=0x7f33dc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc06e480 con 0x7f33dc15cdc0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f33d4001670 con 0x7f33dc15cdc0 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 >> v1:172.21.15.67:6789/0 conn(0x7f33dc15cdc0 legacy=0x7f33dc15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33c00039b0 0x7f33c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c00051c0 0x7f33c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc06e7f0 con 0x7f33c0004800 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33c000c160 con 0x7f33c00051c0 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.842+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f33c000c360 con 0x7f33c00039b0 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e2000640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c00051c0 0x7f33c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e1600640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33c00039b0 0x7f33c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 -- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33c00039b0 msgr2=0x7f33c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33c00039b0 0x7f33c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 -- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c00051c0 msgr2=0x7f33c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c00051c0 0x7f33c000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e0c00640 1 -- 172.21.15.67:0/2687433402 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c0003520 con 0x7f33c0004800 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e2000640 1 -- 172.21.15.67:0/2687433402 reap_dead start 2024-04-16T13:06:04.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.843+0000 7f33e1600640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33c00039b0 0x7f33c0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.844+0000 7f33e0c00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33c0004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ac0 tx=0x7f33c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82ac1f83da1577f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8039070 con 0x7f33c0004800 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c802c6b0 con 0x7f33c0004800 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33dbe00640 1 -- 172.21.15.67:0/2687433402 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009690 con 0x7f33c0004800 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 -- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 msgr2=0x7f33c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33c0004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ac0 tx=0x7f33c0005830 comp rx=0 tx=0).stop 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 -- 172.21.15.67:0/2687433402 shutdown_connections 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 --2- 172.21.15.67:0/2687433402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33c0004c80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 -- 172.21.15.67:0/2687433402 >> 172.21.15.67:0/2687433402 conn(0x7f33dc067d90 msgr2=0x7f33dc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 -- 172.21.15.67:0/2687433402 shutdown_connections 2024-04-16T13:06:04.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.845+0000 7f33e2a00640 1 -- 172.21.15.67:0/2687433402 wait complete. 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.847+0000 7f33e2a00640 1 Processor -- start 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.847+0000 7f33e2a00640 1 -- start start 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc14a6c0 0x7f33dc14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33dc1e5b10 0x7f33dc1e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc06ec80 con 0x7f33c0004800 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc15db10 con 0x7f33dc14a6c0 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e2a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f33dc06ee00 con 0x7f33dc1e5b10 2024-04-16T13:06:04.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.848+0000 7f33e1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50682/0 (socket says 172.21.15.67:50682) 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 -- 172.21.15.67:0/658562373 learned_addr learned my addr 172.21.15.67:0/658562373 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e0c00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc14a6c0 0x7f33dc14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 -- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33dc1e5b10 msgr2=0x7f33dc1e5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33dc1e5b10 0x7f33dc1e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 -- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc14a6c0 msgr2=0x7f33dc14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc14a6c0 0x7f33dc14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 -- 172.21.15.67:0/658562373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc1591b0 con 0x7f33c0004800 2024-04-16T13:06:04.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33e1600640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00d800 tx=0x7f33cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.849+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003da0 con 0x7f33c0004800 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.850+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc017070 con 0x7f33c0004800 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.850+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc00b8f0 con 0x7f33c0004800 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.850+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc15a1f0 con 0x7f33c0004800 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.850+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc159730 con 0x7f33c0004800 2024-04-16T13:06:04.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.851+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33dc075bd0 con 0x7f33c0004800 2024-04-16T13:06:04.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.852+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33cc00ba90 con 0x7f33c0004800 2024-04-16T13:06:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.853+0000 7f33d9600640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 0x7f33bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.853+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f33cc08bfe0 con 0x7f33c0004800 2024-04-16T13:06:04.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.853+0000 7f33e0c00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 0x7f33bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:04.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.855+0000 7f33e0c00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 0x7f33bc06ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036000 tx=0x7f33c8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:04.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:04.857+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33cc05a0c0 con 0x7f33c0004800 2024-04-16T13:06:05.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.076+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33dc0b1c80 con 0x7f33c0004800 2024-04-16T13:06:05.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.077+0000 7f33d9600640 1 -- 172.21.15.67:0/658562373 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f33cc0599c0 con 0x7f33c0004800 2024-04-16T13:06:05.078 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-04-16T13:06:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 msgr2=0x7f33bc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 0x7f33bc06ee00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036000 tx=0x7f33c8030000 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 msgr2=0x7f33dc0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00d800 tx=0x7f33cc00dcc0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 shutdown_connections 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f33bc06c940 0x7f33bc06ee00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f33dc1e5b10 0x7f33dc1e5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33dc14a6c0 0x7f33dc14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 --2- 172.21.15.67:0/658562373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33c0004800 0x7f33dc0b3f80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 >> 172.21.15.67:0/658562373 conn(0x7f33dc067d90 msgr2=0x7f33dc15f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 shutdown_connections 2024-04-16T13:06:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.080+0000 7f33e2a00640 1 -- 172.21.15.67:0/658562373 wait complete. 2024-04-16T13:06:05.099 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-16T13:06:05.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:05.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-16T13:06:05.205 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:06:05.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:05.206 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-16T13:06:05.256 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-16T13:06:05.256 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:05.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.488+0000 7faf35a00640 1 Processor -- start 2024-04-16T13:06:05.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.488+0000 7faf35a00640 1 -- start start 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.489+0000 7faf35a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf30146150 0x7faf3015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.489+0000 7faf35a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf3015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf35a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3006dd50 con 0x7faf30071e50 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf35a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7faf3015d4e0 con 0x7faf30146150 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf35a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faf3015d7c0 con 0x7faf300cec90 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2f400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faf30071e50 0x7faf3006e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36348/0 (socket says 172.21.15.67:36348) 2024-04-16T13:06:05.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2f400640 1 -- 172.21.15.67:0/2168285181 learned_addr learned my addr 172.21.15.67:0/2168285181 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2ea00640 1 --2- 172.21.15.67:0/2168285181 >> v2:172.21.15.82:3300/0 conn(0x7faf30146150 0x7faf3015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2e000640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf3015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355491875 0 0) 0x7faf3006dd50 con 0x7faf30071e50 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.490+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf14003520 con 0x7faf30071e50 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929033356 0 0) 0x7faf14003520 con 0x7faf30071e50 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 msgr2=0x7faf3015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf3015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 >> v2:172.21.15.82:3300/0 conn(0x7faf30146150 msgr2=0x7faf3015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 --2- 172.21.15.67:0/2168285181 >> v2:172.21.15.82:3300/0 conn(0x7faf30146150 0x7faf3015cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3015daa0 con 0x7faf30071e50 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7faf28001670 con 0x7faf30071e50 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 >> v1:172.21.15.67:6789/0 conn(0x7faf30071e50 legacy=0x7faf3006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf140039b0 0x7faf14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf14004d40 0x7faf140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faf3015d4e0 con 0x7faf140039b0 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf3015d7c0 con 0x7faf14004d40 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faf1400ba40 con 0x7faf300cec90 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.491+0000 7faf2ea00640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf140039b0 0x7faf14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2f400640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf14004d40 0x7faf140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2e000640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2ea00640 1 -- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 msgr2=0x7faf14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:05.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2ea00640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf300cec90 0x7faf14004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2ea00640 1 -- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf14004d40 msgr2=0x7faf140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:05.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2ea00640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf14004d40 0x7faf140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2ea00640 1 -- 172.21.15.67:0/2168285181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf14003520 con 0x7faf140039b0 2024-04-16T13:06:05.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.492+0000 7faf2f400640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf14004d40 0x7faf140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.493+0000 7faf2ea00640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf140039b0 0x7faf14003dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf20009fc0 tx=0x7faf14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f957a13c6ada62e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.493+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20039070 con 0x7faf140039b0 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.493+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2002cc60 con 0x7faf140039b0 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.493+0000 7faf2d600640 1 -- 172.21.15.67:0/2168285181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20009c10 con 0x7faf140039b0 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 -- 172.21.15.67:0/2168285181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf140039b0 msgr2=0x7faf14003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 --2- 172.21.15.67:0/2168285181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf140039b0 0x7faf14003dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf20009fc0 tx=0x7faf14005830 comp rx=0 tx=0).stop 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf2f400640 1 -- 172.21.15.67:0/2168285181 reap_dead start 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 -- 172.21.15.67:0/2168285181 shutdown_connections 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 -- 172.21.15.67:0/2168285181 >> 172.21.15.67:0/2168285181 conn(0x7faf300b2210 msgr2=0x7faf300b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 -- 172.21.15.67:0/2168285181 shutdown_connections 2024-04-16T13:06:05.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.494+0000 7faf35a00640 1 -- 172.21.15.67:0/2168285181 wait complete. 2024-04-16T13:06:05.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.496+0000 7faf35a00640 1 Processor -- start 2024-04-16T13:06:05.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.496+0000 7faf35a00640 1 -- start start 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf140039b0 0x7faf301f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf30145570 0x7faf300aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7faf3006eae0 con 0x7faf300af010 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf3006e960 con 0x7faf140039b0 2024-04-16T13:06:05.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.497+0000 7faf35a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7faf3006ec60 con 0x7faf30145570 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50700/0 (socket says 172.21.15.67:50700) 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 -- 172.21.15.67:0/524346180 learned_addr learned my addr 172.21.15.67:0/524346180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2ea00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf140039b0 0x7faf301f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2e000640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf30145570 0x7faf300aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 -- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf30145570 msgr2=0x7faf300aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf30145570 0x7faf300aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 -- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf140039b0 msgr2=0x7faf301f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf140039b0 0x7faf301f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 -- 172.21.15.67:0/524346180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf301f4ce0 con 0x7faf300af010 2024-04-16T13:06:05.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.498+0000 7faf2f400640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf300b5880 tx=0x7faf2800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.499+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf280074e0 con 0x7faf300af010 2024-04-16T13:06:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.499+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf280047e0 con 0x7faf300af010 2024-04-16T13:06:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.499+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf301f4fc0 con 0x7faf300af010 2024-04-16T13:06:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.499+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28004bd0 con 0x7faf300af010 2024-04-16T13:06:05.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.499+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf301f7d70 con 0x7faf300af010 2024-04-16T13:06:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.500+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf30075bd0 con 0x7faf300af010 2024-04-16T13:06:05.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.501+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf28014430 con 0x7faf300af010 2024-04-16T13:06:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.502+0000 7faf26a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 0x7faf0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.502+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faf2808b7e0 con 0x7faf300af010 2024-04-16T13:06:05.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.503+0000 7faf2ea00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 0x7faf0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:05.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.504+0000 7faf2ea00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 0x7faf0c06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faf20036000 tx=0x7faf2002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:05.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.506+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf280598a0 con 0x7faf300af010 2024-04-16T13:06:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.750+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf300d0240 con 0x7faf300af010 2024-04-16T13:06:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.751+0000 7faf26a00640 1 -- 172.21.15.67:0/524346180 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7faf28001d00 con 0x7faf300af010 2024-04-16T13:06:05.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:05.752 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:06:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 msgr2=0x7faf0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 0x7faf0c06ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faf20036000 tx=0x7faf2002e000 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 msgr2=0x7faf30131610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf300b5880 tx=0x7faf2800d950 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 shutdown_connections 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7faf0c06c920 0x7faf0c06ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf300af010 0x7faf30131610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7faf30145570 0x7faf300aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 --2- 172.21.15.67:0/524346180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf140039b0 0x7faf301f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.753+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 >> 172.21.15.67:0/524346180 conn(0x7faf300b2210 msgr2=0x7faf300b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.754+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 shutdown_connections 2024-04-16T13:06:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:05.754+0000 7faf35a00640 1 -- 172.21.15.67:0/524346180 wait complete. 2024-04-16T13:06:05.777 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:06.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.004+0000 7fd59cc00640 1 Processor -- start 2024-04-16T13:06:06.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.004+0000 7fd59cc00640 1 -- start start 2024-04-16T13:06:06.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.006+0000 7fd59cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 0x7fd5980cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.006+0000 7fd59cc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59806f9a0 con 0x7fd59815fc00 2024-04-16T13:06:06.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.006+0000 7fd59cc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59815d120 con 0x7fd59806f510 2024-04-16T13:06:06.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.006+0000 7fd59cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd59815d400 con 0x7fd598072560 2024-04-16T13:06:06.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.007+0000 7fd595e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd59815fc00 0x7fd598071e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36350/0 (socket says 172.21.15.67:36350) 2024-04-16T13:06:06.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.007+0000 7fd595e00640 1 -- 172.21.15.67:0/905614551 learned_addr learned my addr 172.21.15.67:0/905614551 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:06.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.007+0000 7fd595400640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 0x7fd5980cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82061455 0 0) 0x7fd59806f9a0 con 0x7fd59815fc00 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd57c003520 con 0x7fd59815fc00 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181410434 0 0) 0x7fd59815d120 con 0x7fd59806f510 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd59806f9a0 con 0x7fd59806f510 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4097128944 0 0) 0x7fd57c003520 con 0x7fd59815fc00 2024-04-16T13:06:06.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 msgr2=0x7fd5980cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 0x7fd5980cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 >> v1:172.21.15.82:6789/0 conn(0x7fd59806f510 legacy=0x7fd59815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59815d6e0 con 0x7fd59815fc00 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fd588001670 con 0x7fd59815fc00 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 >> v1:172.21.15.67:6789/0 conn(0x7fd59815fc00 legacy=0x7fd598071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd57c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 0x7fd57c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd57c004d40 0x7fd57c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd59815d400 con 0x7fd57c003b70 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c00baa0 con 0x7fd57c004d40 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.008+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd57c00bca0 con 0x7fd598072560 2024-04-16T13:06:06.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd57c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 -- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 msgr2=0x7fd57c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd598072560 0x7fd57c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 -- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd57c004d40 msgr2=0x7fd57c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd57c004d40 0x7fd57c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.009+0000 7fd595e00640 1 -- 172.21.15.67:0/905614551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c003520 con 0x7fd57c003b70 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.010+0000 7fd595e00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd57c003f70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd588007fc0 tx=0x7fd57c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56195ab9dcc2c6ae server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588007be0 con 0x7fd57c003b70 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588030070 con 0x7fd57c003b70 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd594a00640 1 -- 172.21.15.67:0/905614551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588005d30 con 0x7fd57c003b70 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd59cc00640 1 -- 172.21.15.67:0/905614551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 msgr2=0x7fd57c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd59cc00640 1 --2- 172.21.15.67:0/905614551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd57c003f70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd588007fc0 tx=0x7fd57c005830 comp rx=0 tx=0).stop 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd596800640 1 -- 172.21.15.67:0/905614551 reap_dead start 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd59cc00640 1 -- 172.21.15.67:0/905614551 shutdown_connections 2024-04-16T13:06:06.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.011+0000 7fd59cc00640 1 -- 172.21.15.67:0/905614551 >> 172.21.15.67:0/905614551 conn(0x7fd598067d90 msgr2=0x7fd59806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.012+0000 7fd59cc00640 1 -- 172.21.15.67:0/905614551 shutdown_connections 2024-04-16T13:06:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.012+0000 7fd59cc00640 1 -- 172.21.15.67:0/905614551 wait complete. 2024-04-16T13:06:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.013+0000 7fd59cc00640 1 Processor -- start 2024-04-16T13:06:06.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.014+0000 7fd59cc00640 1 -- start start 2024-04-16T13:06:06.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5980ab5b0 0x7fd5980aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 0x7fd5980aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd59815ffe0 con 0x7fd57c003b70 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd59815cdf0 con 0x7fd5980ae9a0 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd59cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd598160160 con 0x7fd5980ab5b0 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50704/0 (socket says 172.21.15.67:50704) 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 -- 172.21.15.67:0/2799520028 learned_addr learned my addr 172.21.15.67:0/2799520028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595400640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5980ab5b0 0x7fd5980aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd596800640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 0x7fd5980aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 -- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5980ab5b0 msgr2=0x7fd5980aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5980ab5b0 0x7fd5980aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 -- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 msgr2=0x7fd5980aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.015+0000 7fd595e00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 0x7fd5980aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd595e00640 1 -- 172.21.15.67:0/2799520028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980ac390 con 0x7fd57c003b70 2024-04-16T13:06:06.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd596800640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 0x7fd5980aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd595e00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd58802c430 tx=0x7fd59815d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588045070 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58802cbd0 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588001b20 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5980ac670 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.016+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5980acc30 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.018+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd598075bd0 con 0x7fd57c003b70 2024-04-16T13:06:06.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.019+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd588007070 con 0x7fd57c003b70 2024-04-16T13:06:06.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.020+0000 7fd58e000640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 0x7fd57806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.020+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd5880ad1a0 con 0x7fd57c003b70 2024-04-16T13:06:06.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.020+0000 7fd595400640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 0x7fd57806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.021+0000 7fd595400640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 0x7fd57806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd584009a50 tx=0x7fd584008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.024+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd58807ab80 con 0x7fd57c003b70 2024-04-16T13:06:06.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.230+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5980cddc0 con 0x7fd57c003b70 2024-04-16T13:06:06.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.233+0000 7fd58e000640 1 -- 172.21.15.67:0/2799520028 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7fd58807ee80 con 0x7fd57c003b70 2024-04-16T13:06:06.234 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:06.235 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 msgr2=0x7fd57806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 0x7fd57806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd584009a50 tx=0x7fd584008040 comp rx=0 tx=0).stop 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 msgr2=0x7fd598136d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd58802c430 tx=0x7fd59815d2f0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 shutdown_connections 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd57806c8f0 0x7fd57806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5980ae9a0 0x7fd5980aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd5980ab5b0 0x7fd5980aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 --2- 172.21.15.67:0/2799520028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd57c003b70 0x7fd598136d20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 >> 172.21.15.67:0/2799520028 conn(0x7fd598067d90 msgr2=0x7fd5980b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 shutdown_connections 2024-04-16T13:06:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.235+0000 7fd59cc00640 1 -- 172.21.15.67:0/2799520028 wait complete. 2024-04-16T13:06:06.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-16T13:04:43.795486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-16T13:04:44.442505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-16T13:04:48.121313+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T13:06:06.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:06:06.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.482+0000 7fe01f600640 1 Processor -- start 2024-04-16T13:06:06.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.482+0000 7fe01f600640 1 -- start start 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.483+0000 7fe01f600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fe0180d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0180d0f50 con 0x7fe01815ed40 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01f600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0180d1230 con 0x7fe01806dc50 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01f600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0180d1510 con 0x7fe0180d0990 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01cc00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe01815ed40 0x7fe01806d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36358/0 (socket says 172.21.15.67:36358) 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01cc00640 1 -- 172.21.15.67:0/4270928057 learned_addr learned my addr 172.21.15.67:0/4270928057 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe01d600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fe0180d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735463576 0 0) 0x7fe0180d0f50 con 0x7fe01815ed40 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.484+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdffc003520 con 0x7fe01815ed40 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 690808251 0 0) 0x7fdffc003520 con 0x7fe01815ed40 2024-04-16T13:06:06.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 msgr2=0x7fe0180d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fe0180d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 >> v1:172.21.15.82:6789/0 conn(0x7fe01806dc50 legacy=0x7fe0180ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0180d17f0 con 0x7fe01815ed40 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fe008001a10 con 0x7fe01815ed40 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 >> v1:172.21.15.67:6789/0 conn(0x7fe01815ed40 legacy=0x7fe01806d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc0039e0 0x7fdffc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fdffc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc004d40 0x7fdffc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180d1510 con 0x7fdffc004d40 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdffc00baa0 con 0x7fdffc0039e0 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fdffc00bca0 con 0x7fe0180d0990 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.485+0000 7fe01d600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc004d40 0x7fdffc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe017e00640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fdffc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01cc00640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc0039e0 0x7fdffc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01d600640 1 -- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 msgr2=0x7fdffc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01d600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180d0990 0x7fdffc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01d600640 1 -- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc0039e0 msgr2=0x7fdffc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01d600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc0039e0 0x7fdffc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01d600640 1 -- 172.21.15.67:0/4270928057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdffc003520 con 0x7fdffc004d40 2024-04-16T13:06:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.486+0000 7fe01cc00640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc0039e0 0x7fdffc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.487+0000 7fe01d600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc004d40 0x7fdffc0051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe010009a90 tx=0x7fdffc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2fdc5eb79dc4dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.487+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010039070 con 0x7fdffc004d40 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.487+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01002c680 con 0x7fdffc004d40 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.487+0000 7fe017400640 1 -- 172.21.15.67:0/4270928057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010009690 con 0x7fdffc004d40 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 -- 172.21.15.67:0/4270928057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc004d40 msgr2=0x7fdffc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 --2- 172.21.15.67:0/4270928057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc004d40 0x7fdffc0051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe010009a90 tx=0x7fdffc005830 comp rx=0 tx=0).stop 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01d600640 1 -- 172.21.15.67:0/4270928057 reap_dead start 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 -- 172.21.15.67:0/4270928057 shutdown_connections 2024-04-16T13:06:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 -- 172.21.15.67:0/4270928057 >> 172.21.15.67:0/4270928057 conn(0x7fe0180b4240 msgr2=0x7fe0180b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 -- 172.21.15.67:0/4270928057 shutdown_connections 2024-04-16T13:06:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.488+0000 7fe01f600640 1 -- 172.21.15.67:0/4270928057 wait complete. 2024-04-16T13:06:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.490+0000 7fe01f600640 1 Processor -- start 2024-04-16T13:06:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.490+0000 7fe01f600640 1 -- start start 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc004d40 0x7fe0181f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180ca230 0x7fe0181ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180d1ff0 con 0x7fe0180cbd20 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe01806cf60 con 0x7fdffc004d40 2024-04-16T13:06:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.491+0000 7fe01f600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fe0180d2170 con 0x7fe0180ca230 2024-04-16T13:06:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50712/0 (socket says 172.21.15.67:50712) 2024-04-16T13:06:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 -- 172.21.15.67:0/2678368242 learned_addr learned my addr 172.21.15.67:0/2678368242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01cc00640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc004d40 0x7fe0181f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe017e00640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180ca230 0x7fe0181ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 -- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180ca230 msgr2=0x7fe0181ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180ca230 0x7fe0181ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 -- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc004d40 msgr2=0x7fe0181f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc004d40 0x7fe0181f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.492+0000 7fe01d600640 1 -- 172.21.15.67:0/2678368242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0181f56d0 con 0x7fe0180cbd20 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe01d600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe010037040 tx=0x7fe010004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010044070 con 0x7fe0180cbd20 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01003a040 con 0x7fe0180cbd20 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0180c98c0 con 0x7fe0180cbd20 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010039070 con 0x7fe0180cbd20 2024-04-16T13:06:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.493+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0180c9e80 con 0x7fe0180cbd20 2024-04-16T13:06:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.494+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe018068a70 con 0x7fe0180cbd20 2024-04-16T13:06:06.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.495+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe010047070 con 0x7fe0180cbd20 2024-04-16T13:06:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.497+0000 7fe014c00640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 0x7fdff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.497+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe0100ac990 con 0x7fe0180cbd20 2024-04-16T13:06:06.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.497+0000 7fe01cc00640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 0x7fdff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.499+0000 7fe01cc00640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 0x7fdff406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe008001b80 tx=0x7fe008009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.502+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0181f56d0 con 0x7fe0180cbd20 2024-04-16T13:06:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.715+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe0180b4f60 con 0x7fe0180cbd20 2024-04-16T13:06:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.716+0000 7fe014c00640 1 -- 172.21.15.67:0/2678368242 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fe01007a2d0 con 0x7fe0180cbd20 2024-04-16T13:06:06.717 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 msgr2=0x7fdff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 0x7fdff406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe008001b80 tx=0x7fe008009040 comp rx=0 tx=0).stop 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 msgr2=0x7fe0180cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe010037040 tx=0x7fe010004730 comp rx=0 tx=0).stop 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 shutdown_connections 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fdff406c8f0 0x7fdff406edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0180cbd20 0x7fe0180cc1a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fe0180ca230 0x7fe0181ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 --2- 172.21.15.67:0/2678368242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdffc004d40 0x7fe0181f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 >> 172.21.15.67:0/2678368242 conn(0x7fe0180b4240 msgr2=0x7fe01809b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 shutdown_connections 2024-04-16T13:06:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.719+0000 7fe01f600640 1 -- 172.21.15.67:0/2678368242 wait complete. 2024-04-16T13:06:06.740 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-16T13:06:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.966+0000 7f1e4cc00640 1 Processor -- start 2024-04-16T13:06:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.966+0000 7f1e4cc00640 1 -- start start 2024-04-16T13:06:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.967+0000 7f1e4cc00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 0x7f1e480d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.967+0000 7f1e4cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e480d17f0 0x7f1e4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.967+0000 7f1e4cc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e480d2b10 con 0x7f1e480d22c0 2024-04-16T13:06:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.967+0000 7f1e4cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1e480d2df0 con 0x7f1e480d17f0 2024-04-16T13:06:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.967+0000 7f1e4cc00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1e480d30d0 con 0x7f1e4815e7e0 2024-04-16T13:06:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e480d17f0 0x7f1e4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e480d17f0 0x7f1e4806d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50726/0 (socket says 172.21.15.67:50726) 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 -- 172.21.15.67:0/1806413574 learned_addr learned my addr 172.21.15.67:0/1806413574 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47400640 1 --2- 172.21.15.67:0/1806413574 >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 0x7f1e480d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 -- 172.21.15.67:0/1806413574 >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 msgr2=0x7f1e480d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 --2- 172.21.15.67:0/1806413574 >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 0x7f1e480d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 -- 172.21.15.67:0/1806413574 >> v1:172.21.15.82:6789/0 conn(0x7f1e480d22c0 legacy=0x7f1e480d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:06.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47e00640 1 -- 172.21.15.67:0/1806413574 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e480d33b0 con 0x7f1e480d17f0 2024-04-16T13:06:06.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.968+0000 7f1e47400640 1 --2- 172.21.15.67:0/1806413574 >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 0x7f1e480d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:06.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e47e00640 1 --2- 172.21.15.67:0/1806413574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d17f0 0x7f1e4806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e4808e7d0 tx=0x7f1e4002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e8d6961b1d738b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e46000640 1 -- 172.21.15.67:0/1806413574 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4002ca80 con 0x7f1e480d17f0 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e46000640 1 -- 172.21.15.67:0/1806413574 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4002cc20 con 0x7f1e480d17f0 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e46000640 1 -- 172.21.15.67:0/1806413574 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e400343f0 con 0x7f1e480d17f0 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e4cc00640 1 -- 172.21.15.67:0/1806413574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d17f0 msgr2=0x7f1e4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.970+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/1806413574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d17f0 0x7f1e4806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e4808e7d0 tx=0x7f1e4002bee0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 -- 172.21.15.67:0/1806413574 shutdown_connections 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/1806413574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d17f0 0x7f1e4806d330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/1806413574 >> v2:172.21.15.82:3300/0 conn(0x7f1e4815e7e0 0x7f1e480d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 -- 172.21.15.67:0/1806413574 >> 172.21.15.67:0/1806413574 conn(0x7f1e4809da60 msgr2=0x7f1e4808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 -- 172.21.15.67:0/1806413574 shutdown_connections 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.971+0000 7f1e4cc00640 1 -- 172.21.15.67:0/1806413574 wait complete. 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.972+0000 7f1e4cc00640 1 Processor -- start 2024-04-16T13:06:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.973+0000 7f1e4cc00640 1 -- start start 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.973+0000 7f1e4cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e480d17f0 0x7f1e4815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.973+0000 7f1e4cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e4cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 0x7f1e480b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e4cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1e480d28d0 con 0x7f1e480d22c0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e4cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e480d2750 con 0x7f1e4815e7e0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e4cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4815ebc0 con 0x7f1e480d17f0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50736/0 (socket says 172.21.15.67:50736) 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 -- 172.21.15.67:0/249431826 learned_addr learned my addr 172.21.15.67:0/249431826 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e47e00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 0x7f1e480b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e47400640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e480d17f0 0x7f1e4815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 -- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e480d17f0 msgr2=0x7f1e4815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e480d17f0 0x7f1e4815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 -- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 msgr2=0x7f1e480b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 0x7f1e480b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e46a00640 1 -- 172.21.15.67:0/249431826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e48161c80 con 0x7f1e480d22c0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.974+0000 7f1e47e00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 0x7f1e480b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e46a00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c410 tx=0x7f1e3000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30017070 con 0x7f1e480d22c0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300035f0 con 0x7f1e480d22c0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30003a20 con 0x7f1e480d22c0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e481f47a0 con 0x7f1e480d22c0 2024-04-16T13:06:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.975+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e480c84b0 con 0x7f1e480d22c0 2024-04-16T13:06:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.976+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e48075bd0 con 0x7f1e480d22c0 2024-04-16T13:06:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.977+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e3001a070 con 0x7f1e480d22c0 2024-04-16T13:06:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.979+0000 7f1e3f400640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 0x7f1e2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.979+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1e3008b4a0 con 0x7f1e480d22c0 2024-04-16T13:06:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.979+0000 7f1e47400640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 0x7f1e2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.981+0000 7f1e47400640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 0x7f1e2406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006fd0 tx=0x7f1e38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:06.984+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e30059430 con 0x7f1e480d22c0 2024-04-16T13:06:07.168 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:06:07.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:06:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.187+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e480d15d0 con 0x7f1e480d22c0 2024-04-16T13:06:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.188+0000 7f1e3f400640 1 -- 172.21.15.67:0/249431826 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f1e30058d30 con 0x7f1e480d22c0 2024-04-16T13:06:07.189 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 msgr2=0x7f1e2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 0x7f1e2406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006fd0 tx=0x7f1e38008040 comp rx=0 tx=0).stop 2024-04-16T13:06:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 msgr2=0x7f1e481611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c410 tx=0x7f1e3000c8d0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 shutdown_connections 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1e2406c8f0 0x7f1e2406edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e4815e7e0 0x7f1e480b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e480d22c0 0x7f1e481611c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 --2- 172.21.15.67:0/249431826 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1e480d17f0 0x7f1e4815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 >> 172.21.15.67:0/249431826 conn(0x7f1e4809da60 msgr2=0x7f1e4806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 shutdown_connections 2024-04-16T13:06:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.191+0000 7f1e4cc00640 1 -- 172.21.15.67:0/249431826 wait complete. 2024-04-16T13:06:07.213 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-16T13:06:07.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.457+0000 7f026be00640 1 Processor -- start 2024-04-16T13:06:07.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.457+0000 7f026be00640 1 -- start start 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.458+0000 7f026be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 0x7f026c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.458+0000 7f026be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f026c0cff40 0x7f026c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.458+0000 7f026be00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 0x7f026c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026be00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f026c15bc40 con 0x7f026c0cff40 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026be00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f026c15bf20 con 0x7f026c13ebb0 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f026c15c200 con 0x7f026c13e5d0 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f026c0cff40 0x7f026c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f026c0cff40 0x7f026c06ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50738/0 (socket says 172.21.15.67:50738) 2024-04-16T13:06:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 -- 172.21.15.67:0/1836181808 learned_addr learned my addr 172.21.15.67:0/1836181808 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026b400640 1 --2- 172.21.15.67:0/1836181808 >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 0x7f026c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026aa00640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 0x7f026c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 -- 172.21.15.67:0/1836181808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 msgr2=0x7f026c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 0x7f026c0cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 -- 172.21.15.67:0/1836181808 >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 msgr2=0x7f026c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 --2- 172.21.15.67:0/1836181808 >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 0x7f026c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026a000640 1 -- 172.21.15.67:0/1836181808 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c15c4e0 con 0x7f026c0cff40 2024-04-16T13:06:07.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026aa00640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 0x7f026c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:07.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.459+0000 7f026b400640 1 --2- 172.21.15.67:0/1836181808 >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 0x7f026c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.461+0000 7f026a000640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c0cff40 0x7f026c06ef30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f026c15c130 tx=0x7f025402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a60e62835d3dfe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.461+0000 7f0269600640 1 -- 172.21.15.67:0/1836181808 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254035020 con 0x7f026c0cff40 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.461+0000 7f0269600640 1 -- 172.21.15.67:0/1836181808 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0254031640 con 0x7f026c0cff40 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.461+0000 7f0269600640 1 -- 172.21.15.67:0/1836181808 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025402d040 con 0x7f026c0cff40 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 -- 172.21.15.67:0/1836181808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c0cff40 msgr2=0x7f026c06ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c0cff40 0x7f026c06ef30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f026c15c130 tx=0x7f025402b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 -- 172.21.15.67:0/1836181808 shutdown_connections 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 --2- 172.21.15.67:0/1836181808 >> v2:172.21.15.82:3300/0 conn(0x7f026c13ebb0 0x7f026c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c0cff40 0x7f026c06ef30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 --2- 172.21.15.67:0/1836181808 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c13e5d0 0x7f026c0cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 -- 172.21.15.67:0/1836181808 >> 172.21.15.67:0/1836181808 conn(0x7f026c067d90 msgr2=0x7f026c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 -- 172.21.15.67:0/1836181808 shutdown_connections 2024-04-16T13:06:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.462+0000 7f026be00640 1 -- 172.21.15.67:0/1836181808 wait complete. 2024-04-16T13:06:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.464+0000 7f026be00640 1 Processor -- start 2024-04-16T13:06:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.464+0000 7f026be00640 1 -- start start 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 0x7f026c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c13e5d0 0x7f026c15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f026c0afea0 con 0x7f026c13ebb0 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f026c0afd20 con 0x7f026c13e5d0 2024-04-16T13:06:07.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026be00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f026c071de0 con 0x7f026c0cff40 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50754/0 (socket says 172.21.15.67:50754) 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026b400640 1 -- 172.21.15.67:0/3514014275 learned_addr learned my addr 172.21.15.67:0/3514014275 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026a000640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c13e5d0 0x7f026c15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026aa00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 0x7f026c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026b400640 1 -- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 msgr2=0x7f026c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.465+0000 7f026b400640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 0x7f026c1386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026b400640 1 -- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c13e5d0 msgr2=0x7f026c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026b400640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c13e5d0 0x7f026c15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026b400640 1 -- 172.21.15.67:0/3514014275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c138f30 con 0x7f026c13ebb0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026aa00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 0x7f026c1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026b400640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f026400cd50 tx=0x7f026400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400f680 con 0x7f026c13ebb0 2024-04-16T13:06:07.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026400f840 con 0x7f026c13ebb0 2024-04-16T13:06:07.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400fc30 con 0x7f026c13ebb0 2024-04-16T13:06:07.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c139210 con 0x7f026c13ebb0 2024-04-16T13:06:07.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.466+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c138c20 con 0x7f026c13ebb0 2024-04-16T13:06:07.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.467+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c13d0b0 con 0x7f026c13ebb0 2024-04-16T13:06:07.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.468+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f026400e3e0 con 0x7f026c13ebb0 2024-04-16T13:06:07.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.469+0000 7f0262a00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 0x7f024806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.469+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f026408ccb0 con 0x7f026c13ebb0 2024-04-16T13:06:07.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.470+0000 7f026aa00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 0x7f024806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.471+0000 7f026aa00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 0x7f024806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f026c1374f0 tx=0x7f025c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.474+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0264014030 con 0x7f026c13ebb0 2024-04-16T13:06:07.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.683+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f026c075bd0 con 0x7f026c13ebb0 2024-04-16T13:06:07.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.684+0000 7f0262a00640 1 -- 172.21.15.67:0/3514014275 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f026405ace0 con 0x7f026c13ebb0 2024-04-16T13:06:07.686 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-04-16T13:06:07.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 msgr2=0x7f024806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 0x7f024806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f026c1374f0 tx=0x7f025c008040 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 msgr2=0x7f026c1431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f026400cd50 tx=0x7f026400a650 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 shutdown_connections 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f024806c8f0 0x7f024806edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f026c13ebb0 0x7f026c1431e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f026c13e5d0 0x7f026c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 --2- 172.21.15.67:0/3514014275 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f026c0cff40 0x7f026c1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 >> 172.21.15.67:0/3514014275 conn(0x7f026c067d90 msgr2=0x7f026c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 shutdown_connections 2024-04-16T13:06:07.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.687+0000 7f026be00640 1 -- 172.21.15.67:0/3514014275 wait complete. 2024-04-16T13:06:07.708 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-16T13:06:07.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.938+0000 7f3065c00640 1 Processor -- start 2024-04-16T13:06:07.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.938+0000 7f3065c00640 1 -- start start 2024-04-16T13:06:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.939+0000 7f3065c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30600d0240 0x7f30600d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.939+0000 7f3065c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 0x7f306006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.939+0000 7f3065c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30600d2b10 con 0x7f306015e7e0 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.939+0000 7f3065c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f30600d1a80 con 0x7f30600d0240 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.939+0000 7f3065c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f30600d2df0 con 0x7f30600d1620 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f305fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f306015e7e0 0x7f30600d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36366/0 (socket says 172.21.15.67:36366) 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f305fe00640 1 -- 172.21.15.67:0/3649491057 learned_addr learned my addr 172.21.15.67:0/3649491057 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f3065200640 1 --2- 172.21.15.67:0/3649491057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 0x7f306006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f3057e00640 1 --2- 172.21.15.67:0/3649491057 >> v2:172.21.15.82:3300/0 conn(0x7f30600d0240 0x7f30600d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f305f400640 1 -- 172.21.15.67:0/3649491057 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717727802 0 0) 0x7f30600d2b10 con 0x7f306015e7e0 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.940+0000 7f305f400640 1 -- 172.21.15.67:0/3649491057 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3044003520 con 0x7f306015e7e0 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.941+0000 7f3065200640 1 -- 172.21.15.67:0/3649491057 >> v2:172.21.15.82:3300/0 conn(0x7f30600d0240 msgr2=0x7f30600d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.941+0000 7f3065200640 1 --2- 172.21.15.67:0/3649491057 >> v2:172.21.15.82:3300/0 conn(0x7f30600d0240 0x7f30600d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.941+0000 7f3065200640 1 -- 172.21.15.67:0/3649491057 >> v1:172.21.15.67:6789/0 conn(0x7f306015e7e0 legacy=0x7f30600d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.941+0000 7f3065200640 1 -- 172.21.15.67:0/3649491057 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600d30d0 con 0x7f30600d1620 2024-04-16T13:06:07.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.942+0000 7f3065200640 1 --2- 172.21.15.67:0/3649491057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 0x7f306006d330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3058009d90 tx=0x7f305802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a40a455aace48b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.942+0000 7f305f400640 1 -- 172.21.15.67:0/3649491057 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058039070 con 0x7f30600d1620 2024-04-16T13:06:07.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.942+0000 7f305f400640 1 -- 172.21.15.67:0/3649491057 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305802cc50 con 0x7f30600d1620 2024-04-16T13:06:07.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.942+0000 7f305f400640 1 -- 172.21.15.67:0/3649491057 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058034440 con 0x7f30600d1620 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 -- 172.21.15.67:0/3649491057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 msgr2=0x7f306006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 --2- 172.21.15.67:0/3649491057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 0x7f306006d330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3058009d90 tx=0x7f305802bea0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 -- 172.21.15.67:0/3649491057 shutdown_connections 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 --2- 172.21.15.67:0/3649491057 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d1620 0x7f306006d330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 --2- 172.21.15.67:0/3649491057 >> v2:172.21.15.82:3300/0 conn(0x7f30600d0240 0x7f30600d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 -- 172.21.15.67:0/3649491057 >> 172.21.15.67:0/3649491057 conn(0x7f306009da60 msgr2=0x7f306008c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 -- 172.21.15.67:0/3649491057 shutdown_connections 2024-04-16T13:06:07.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.943+0000 7f3065c00640 1 -- 172.21.15.67:0/3649491057 wait complete. 2024-04-16T13:06:07.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.945+0000 7f3065c00640 1 Processor -- start 2024-04-16T13:06:07.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.945+0000 7f3065c00640 1 -- start start 2024-04-16T13:06:07.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 0x7f30600b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 0x7f306014fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f306015ebc0 con 0x7f306015e7e0 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f30600d3690 con 0x7f30600d1620 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f306015ed40 con 0x7f30600d0240 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50770/0 (socket says 172.21.15.67:50770) 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.946+0000 7f3065200640 1 -- 172.21.15.67:0/1515181595 learned_addr learned my addr 172.21.15.67:0/1515181595 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:07.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f305fe00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 0x7f30600b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 -- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 msgr2=0x7f30600b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 0x7f30600b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 -- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 msgr2=0x7f306014fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:07.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3057e00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 0x7f306014fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 0x7f306014fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 -- 172.21.15.67:0/1515181595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600b9a90 con 0x7f306015e7e0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f305fe00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 0x7f30600b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3057e00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 0x7f306014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.947+0000 7f3065200640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3058037040 tx=0x7f3058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.948+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058042030 con 0x7f306015e7e0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.948+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305803a040 con 0x7f306015e7e0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.948+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30600b9d70 con 0x7f306015e7e0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.948+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058039070 con 0x7f306015e7e0 2024-04-16T13:06:07.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.948+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30600ce560 con 0x7f306015e7e0 2024-04-16T13:06:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.949+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3060075bd0 con 0x7f306015e7e0 2024-04-16T13:06:07.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.950+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3058045070 con 0x7f306015e7e0 2024-04-16T13:06:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.951+0000 7f305cc00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 0x7f303c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.951+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f30580adcb0 con 0x7f306015e7e0 2024-04-16T13:06:07.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.951+0000 7f305fe00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 0x7f303c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:07.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.953+0000 7f305fe00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 0x7f303c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3050001360 tx=0x7f3050009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:07.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:07.955+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f305804c070 con 0x7f306015e7e0 2024-04-16T13:06:08.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.159+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f306015b1f0 con 0x7f306015e7e0 2024-04-16T13:06:08.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.160+0000 7f305cc00640 1 -- 172.21.15.67:0/1515181595 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f305807bd00 con 0x7f306015e7e0 2024-04-16T13:06:08.161 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 msgr2=0x7f303c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 0x7f303c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3050001360 tx=0x7f3050009040 comp rx=0 tx=0).stop 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 msgr2=0x7f306015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3058037040 tx=0x7f3058004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 shutdown_connections 2024-04-16T13:06:08.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f303c06c8f0 0x7f303c06edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f306015e7e0 0x7f306015bd40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30600d1620 0x7f306014fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 --2- 172.21.15.67:0/1515181595 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f30600d0240 0x7f30600b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 >> 172.21.15.67:0/1515181595 conn(0x7f306009da60 msgr2=0x7f30600b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 shutdown_connections 2024-04-16T13:06:08.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.163+0000 7f3065c00640 1 -- 172.21.15.67:0/1515181595 wait complete. 2024-04-16T13:06:08.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.408+0000 7f7457200640 1 Processor -- start 2024-04-16T13:06:08.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.408+0000 7f7457200640 1 -- start start 2024-04-16T13:06:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7457200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f745815c6f0 0x7f74581600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7457200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74580ad880 0x7f745806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7457200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7458160ad0 con 0x7f7458160630 2024-04-16T13:06:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7457200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7458161090 con 0x7f745815c6f0 2024-04-16T13:06:08.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7457200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f745806e110 con 0x7f74580ad880 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7455e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f745815c6f0 0x7f74581600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7455e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f745815c6f0 0x7f74581600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50776/0 (socket says 172.21.15.67:50776) 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.410+0000 7f7455e00640 1 -- 172.21.15.67:0/1489895814 learned_addr learned my addr 172.21.15.67:0/1489895814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.411+0000 7f7456800640 1 --2- 172.21.15.67:0/1489895814 >> v2:172.21.15.82:3300/0 conn(0x7f74580ad880 0x7f745806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.411+0000 7f7455e00640 1 -- 172.21.15.67:0/1489895814 >> v2:172.21.15.82:3300/0 conn(0x7f74580ad880 msgr2=0x7f745806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.411+0000 7f7455e00640 1 --2- 172.21.15.67:0/1489895814 >> v2:172.21.15.82:3300/0 conn(0x7f74580ad880 0x7f745806e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.411+0000 7f7455e00640 1 -- 172.21.15.67:0/1489895814 >> v1:172.21.15.82:6789/0 conn(0x7f7458160630 legacy=0x7f74580ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.411+0000 7f7455e00640 1 -- 172.21.15.67:0/1489895814 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7458160db0 con 0x7f745815c6f0 2024-04-16T13:06:08.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.412+0000 7f7455e00640 1 --2- 172.21.15.67:0/1489895814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f745815c6f0 0x7f74581600f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f745806d4f0 tx=0x7f744802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d32c00aa8f2ecd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7454a00640 1 -- 172.21.15.67:0/1489895814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448034070 con 0x7f745815c6f0 2024-04-16T13:06:08.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7454a00640 1 -- 172.21.15.67:0/1489895814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448030860 con 0x7f745815c6f0 2024-04-16T13:06:08.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7454a00640 1 -- 172.21.15.67:0/1489895814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448030c30 con 0x7f745815c6f0 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 -- 172.21.15.67:0/1489895814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f745815c6f0 msgr2=0x7f74581600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 --2- 172.21.15.67:0/1489895814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f745815c6f0 0x7f74581600f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f745806d4f0 tx=0x7f744802b9a0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 -- 172.21.15.67:0/1489895814 shutdown_connections 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 --2- 172.21.15.67:0/1489895814 >> v2:172.21.15.82:3300/0 conn(0x7f74580ad880 0x7f745806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 --2- 172.21.15.67:0/1489895814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f745815c6f0 0x7f74581600f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 -- 172.21.15.67:0/1489895814 >> 172.21.15.67:0/1489895814 conn(0x7f74580d0220 msgr2=0x7f74580d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 -- 172.21.15.67:0/1489895814 shutdown_connections 2024-04-16T13:06:08.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.413+0000 7f7457200640 1 -- 172.21.15.67:0/1489895814 wait complete. 2024-04-16T13:06:08.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.415+0000 7f7457200640 1 Processor -- start 2024-04-16T13:06:08.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.415+0000 7f7457200640 1 -- start start 2024-04-16T13:06:08.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f74580ad880 0x7f745815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745815c6f0 0x7f7458099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f74580af380 con 0x7f7458160630 2024-04-16T13:06:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74580af200 con 0x7f745815c6f0 2024-04-16T13:06:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.416+0000 7f7457200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f745806eae0 con 0x7f74580ad880 2024-04-16T13:06:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50784/0 (socket says 172.21.15.67:50784) 2024-04-16T13:06:08.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 -- 172.21.15.67:0/660749230 learned_addr learned my addr 172.21.15.67:0/660749230 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7455400640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745815c6f0 0x7f7458099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7455e00640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f74580ad880 0x7f745815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 -- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f74580ad880 msgr2=0x7f745815ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f74580ad880 0x7f745815ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 -- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745815c6f0 msgr2=0x7f7458099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745815c6f0 0x7f7458099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 -- 172.21.15.67:0/660749230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74580ce2e0 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.417+0000 7f7456800640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f745000efc0 tx=0x7f745000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.418+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450018020 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.418+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7450009b10 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.418+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74500146c0 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.418+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74581455a0 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.418+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7458145b60 con 0x7f7458160630 2024-04-16T13:06:08.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.419+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7458075bd0 con 0x7f7458160630 2024-04-16T13:06:08.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.420+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7450005d10 con 0x7f7458160630 2024-04-16T13:06:08.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.421+0000 7f744e000640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 0x7f743806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.421+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f745008cd80 con 0x7f7458160630 2024-04-16T13:06:08.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.421+0000 7f7455e00640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 0x7f743806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.422+0000 7f7455e00640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 0x7f743806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7448036000 tx=0x7f744803b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.426+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7450022030 con 0x7f7458160630 2024-04-16T13:06:08.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.668+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74581461b0 con 0x7f7458160630 2024-04-16T13:06:08.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.670+0000 7f744e000640 1 -- 172.21.15.67:0/660749230 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f74580ce2e0 con 0x7f7458160630 2024-04-16T13:06:08.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:08.671 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:06:08.671 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 msgr2=0x7f743806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 0x7f743806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7448036000 tx=0x7f744803b040 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 msgr2=0x7f74580cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f745000efc0 tx=0x7f745000c490 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 shutdown_connections 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f743806c8f0 0x7f743806edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7458160630 0x7f74580cdda0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745815c6f0 0x7f7458099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.672+0000 7f7457200640 1 --2- 172.21.15.67:0/660749230 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f74580ad880 0x7f745815ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.673+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 >> 172.21.15.67:0/660749230 conn(0x7f74580d0220 msgr2=0x7f745806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:08.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.673+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 shutdown_connections 2024-04-16T13:06:08.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.673+0000 7f7457200640 1 -- 172.21.15.67:0/660749230 wait complete. 2024-04-16T13:06:08.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:08.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.911+0000 7fb3ac000640 1 Processor -- start 2024-04-16T13:06:08.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.911+0000 7fb3ac000640 1 -- start start 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a4146150 0x7fb3a415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3a40cec90 0x7fb3a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a40722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a406dd50 con 0x7fb3a4146150 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a415d4e0 con 0x7fb3a40cec90 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3ac000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a415d7c0 con 0x7fb3a4071e50 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3a9600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a4146150 0x7fb3a415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3a9600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb3a4146150 0x7fb3a415cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50794/0 (socket says 172.21.15.67:50794) 2024-04-16T13:06:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.913+0000 7fb3a9600640 1 -- 172.21.15.67:0/3253291532 learned_addr learned my addr 172.21.15.67:0/3253291532 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.914+0000 7fb3a9600640 1 -- 172.21.15.67:0/3253291532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 msgr2=0x7fb3a40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.914+0000 7fb3a9600640 1 --2- 172.21.15.67:0/3253291532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a40722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.914+0000 7fb3a9600640 1 -- 172.21.15.67:0/3253291532 >> v2:172.21.15.82:3300/0 conn(0x7fb3a40cec90 msgr2=0x7fb3a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.914+0000 7fb3a9600640 1 --2- 172.21.15.67:0/3253291532 >> v2:172.21.15.82:3300/0 conn(0x7fb3a40cec90 0x7fb3a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.914+0000 7fb3a9600640 1 -- 172.21.15.67:0/3253291532 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a415daa0 con 0x7fb3a4146150 2024-04-16T13:06:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.915+0000 7fb3a9600640 1 --2- 172.21.15.67:0/3253291532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a415cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b2f30 tx=0x7fb39802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf294999629ba425 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.915+0000 7fb3a3e00640 1 -- 172.21.15.67:0/3253291532 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398038070 con 0x7fb3a4146150 2024-04-16T13:06:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.915+0000 7fb3a3e00640 1 -- 172.21.15.67:0/3253291532 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb398031740 con 0x7fb3a4146150 2024-04-16T13:06:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.915+0000 7fb3a3e00640 1 -- 172.21.15.67:0/3253291532 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39802f050 con 0x7fb3a4146150 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 -- 172.21.15.67:0/3253291532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 msgr2=0x7fb3a415cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 --2- 172.21.15.67:0/3253291532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a415cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b2f30 tx=0x7fb39802b7e0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 -- 172.21.15.67:0/3253291532 shutdown_connections 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 --2- 172.21.15.67:0/3253291532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a40722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 --2- 172.21.15.67:0/3253291532 >> v2:172.21.15.82:3300/0 conn(0x7fb3a40cec90 0x7fb3a415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 --2- 172.21.15.67:0/3253291532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a415cca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 -- 172.21.15.67:0/3253291532 >> 172.21.15.67:0/3253291532 conn(0x7fb3a40b2210 msgr2=0x7fb3a40b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:08.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 -- 172.21.15.67:0/3253291532 shutdown_connections 2024-04-16T13:06:08.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.916+0000 7fb3ac000640 1 -- 172.21.15.67:0/3253291532 wait complete. 2024-04-16T13:06:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.918+0000 7fb3ac000640 1 Processor -- start 2024-04-16T13:06:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.918+0000 7fb3ac000640 1 -- start start 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 0x7fb3a4150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415e580 con 0x7fb3a4146150 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415e400 con 0x7fb3a40cec90 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3ac000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a406e250 con 0x7fb3a4071e50 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50800/0 (socket says 172.21.15.67:50800) 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3aa000640 1 -- 172.21.15.67:0/4218553996 learned_addr learned my addr 172.21.15.67:0/4218553996 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3a9600640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.919+0000 7fb3a8c00640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 0x7fb3a4150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 -- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 msgr2=0x7fb3a413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 -- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 msgr2=0x7fb3a4150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 0x7fb3a4150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 -- 172.21.15.67:0/4218553996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a40b37e0 con 0x7fb3a4146150 2024-04-16T13:06:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3a8c00640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 0x7fb3a4150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3aa000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00b970 tx=0x7fb39c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c019070 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c00cb60 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.920+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c014440 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.921+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a40b3ac0 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.921+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a40b4080 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.922+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a413bea0 con 0x7fb3a4146150 2024-04-16T13:06:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.923+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb39c01c070 con 0x7fb3a4146150 2024-04-16T13:06:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.924+0000 7fb3a1600640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 0x7fb38406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:08.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.924+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb39c08bcd0 con 0x7fb3a4146150 2024-04-16T13:06:08.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.924+0000 7fb3a9600640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 0x7fb38406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:08.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.926+0000 7fb3a9600640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 0x7fb38406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb398035000 tx=0x7fb398008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:08.928+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb3a413bea0 con 0x7fb3a4146150 2024-04-16T13:06:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.136+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3a4075bd0 con 0x7fb3a4146150 2024-04-16T13:06:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.138+0000 7fb3a1600640 1 -- 172.21.15.67:0/4218553996 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7fb39c059cf0 con 0x7fb3a4146150 2024-04-16T13:06:09.140 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:09.140 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 msgr2=0x7fb38406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 0x7fb38406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb398035000 tx=0x7fb398008030 comp rx=0 tx=0).stop 2024-04-16T13:06:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 msgr2=0x7fb3a40b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00b970 tx=0x7fb39c00be30 comp rx=0 tx=0).stop 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 shutdown_connections 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb38406c8f0 0x7fb38406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb3a4146150 0x7fb3a40b4880 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3a40cec90 0x7fb3a4150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 --2- 172.21.15.67:0/4218553996 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb3a4071e50 0x7fb3a413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 >> 172.21.15.67:0/4218553996 conn(0x7fb3a40b2210 msgr2=0x7fb3a415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 shutdown_connections 2024-04-16T13:06:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.141+0000 7fb3ac000640 1 -- 172.21.15.67:0/4218553996 wait complete. 2024-04-16T13:06:09.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T13:06:09.163 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:09.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.393+0000 7ff931c00640 1 Processor -- start 2024-04-16T13:06:09.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.393+0000 7ff931c00640 1 -- start start 2024-04-16T13:06:09.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 0x7ff92c1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 0x7ff92c0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff92c0c5100 0x7ff92c0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7ff92c161110 con 0x7ff92c0c5100 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7ff92c160870 con 0x7ff92c15c420 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c160b50 con 0x7ff92c15c800 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff92c0c5100 0x7ff92c0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff92c0c5100 0x7ff92c0c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50804/0 (socket says 172.21.15.67:50804) 2024-04-16T13:06:09.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.395+0000 7ff931200640 1 -- 172.21.15.67:0/3090497732 learned_addr learned my addr 172.21.15.67:0/3090497732 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff92be00640 1 --2- 172.21.15.67:0/3090497732 >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 0x7ff92c1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff923e00640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 0x7ff92c0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff931200640 1 -- 172.21.15.67:0/3090497732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 msgr2=0x7ff92c0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff931200640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 0x7ff92c0c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff931200640 1 -- 172.21.15.67:0/3090497732 >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 msgr2=0x7ff92c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff931200640 1 --2- 172.21.15.67:0/3090497732 >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 0x7ff92c1601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff931200640 1 -- 172.21.15.67:0/3090497732 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c160e30 con 0x7ff92c0c5100 2024-04-16T13:06:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff92be00640 1 --2- 172.21.15.67:0/3090497732 >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 0x7ff92c1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.396+0000 7ff923e00640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 0x7ff92c0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:09.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.397+0000 7ff931200640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c0c5100 0x7ff92c0c6760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0cd9a0 tx=0x7ff92402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3aac89f940dd86 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff92b400640 1 -- 172.21.15.67:0/3090497732 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92402c960 con 0x7ff92c0c5100 2024-04-16T13:06:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff92b400640 1 -- 172.21.15.67:0/3090497732 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92402cb00 con 0x7ff92c0c5100 2024-04-16T13:06:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff92b400640 1 -- 172.21.15.67:0/3090497732 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9240343f0 con 0x7ff92c0c5100 2024-04-16T13:06:09.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 -- 172.21.15.67:0/3090497732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c0c5100 msgr2=0x7ff92c0c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c0c5100 0x7ff92c0c6760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0cd9a0 tx=0x7ff92402bdc0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 -- 172.21.15.67:0/3090497732 shutdown_connections 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c0c5100 0x7ff92c0c6760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 --2- 172.21.15.67:0/3090497732 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c800 0x7ff92c0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 --2- 172.21.15.67:0/3090497732 >> v2:172.21.15.82:3300/0 conn(0x7ff92c15c420 0x7ff92c1601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.398+0000 7ff931c00640 1 -- 172.21.15.67:0/3090497732 >> 172.21.15.67:0/3090497732 conn(0x7ff92c0b2070 msgr2=0x7ff92c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.399+0000 7ff931c00640 1 -- 172.21.15.67:0/3090497732 shutdown_connections 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.399+0000 7ff931c00640 1 -- 172.21.15.67:0/3090497732 wait complete. 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.400+0000 7ff931c00640 1 Processor -- start 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.400+0000 7ff931c00640 1 -- start start 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92c0c5100 0x7ff92c0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c420 0x7ff92c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c06bba0 con 0x7ff92c15c800 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c06ba20 con 0x7ff92c0c5100 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.401+0000 7ff931c00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c06bd20 con 0x7ff92c15c420 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50816/0 (socket says 172.21.15.67:50816) 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 -- 172.21.15.67:0/1964316106 learned_addr learned my addr 172.21.15.67:0/1964316106 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff92be00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92c0c5100 0x7ff92c0ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff923e00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c420 0x7ff92c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 -- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c420 msgr2=0x7ff92c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c420 0x7ff92c14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 -- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92c0c5100 msgr2=0x7ff92c0ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92c0c5100 0x7ff92c0ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.402+0000 7ff931200640 1 -- 172.21.15.67:0/1964316106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c0ad4f0 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff931200640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f40 tx=0x7ff924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924043020 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92403e450 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92403e840 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c0ad7d0 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.403+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c0add90 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.405+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c075bd0 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.405+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff924046020 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.406+0000 7ff928c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 0x7ff90806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.406+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff9240ae9c0 con 0x7ff92c15c800 2024-04-16T13:06:09.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.407+0000 7ff92be00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 0x7ff90806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.408+0000 7ff92be00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 0x7ff90806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff91c006b10 tx=0x7ff91c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.412+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9240b0e20 con 0x7ff92c15c800 2024-04-16T13:06:09.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.657+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff92c0b3dc0 con 0x7ff92c15c800 2024-04-16T13:06:09.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.658+0000 7ff928c00640 1 -- 172.21.15.67:0/1964316106 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7ff92404d030 con 0x7ff92c15c800 2024-04-16T13:06:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:09.660 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:06:09.660 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:06:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 msgr2=0x7ff90806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 0x7ff90806edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff91c006b10 tx=0x7ff91c008040 comp rx=0 tx=0).stop 2024-04-16T13:06:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 msgr2=0x7ff92c0aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f40 tx=0x7ff924004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:09.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 shutdown_connections 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7ff90806c8f0 0x7ff90806edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff92c15c800 0x7ff92c0aee80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7ff92c15c420 0x7ff92c14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 --2- 172.21.15.67:0/1964316106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff92c0c5100 0x7ff92c0ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 >> 172.21.15.67:0/1964316106 conn(0x7ff92c0b2070 msgr2=0x7ff92c0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 shutdown_connections 2024-04-16T13:06:09.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.661+0000 7ff931c00640 1 -- 172.21.15.67:0/1964316106 wait complete. 2024-04-16T13:06:09.683 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.890+0000 7fd88f600640 1 Processor -- start 2024-04-16T13:06:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.890+0000 7fd88f600640 1 -- start start 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.891+0000 7fd88f600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd8881620d0 0x7fd88806de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.891+0000 7fd88f600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8880d09f0 0x7fd88809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.891+0000 7fd88f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8880d1320 con 0x7fd8880d0e30 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.891+0000 7fd88f600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd8881624b0 con 0x7fd8881620d0 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.891+0000 7fd88f600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd8880d1600 con 0x7fd8880d09f0 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88d600640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd8880d0e30 0x7fd8881626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36378/0 (socket says 172.21.15.67:36378) 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88d600640 1 -- 172.21.15.67:0/1219404229 learned_addr learned my addr 172.21.15.67:0/1219404229 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:09.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1219404229 >> v2:172.21.15.67:3300/0 conn(0x7fd8881620d0 0x7fd88806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd887e00640 1 --2- 172.21.15.67:0/1219404229 >> v2:172.21.15.82:3300/0 conn(0x7fd8880d09f0 0x7fd88809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88cc00640 1 -- 172.21.15.67:0/1219404229 >> v2:172.21.15.82:3300/0 conn(0x7fd8880d09f0 msgr2=0x7fd88809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1219404229 >> v2:172.21.15.82:3300/0 conn(0x7fd8880d09f0 0x7fd88809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88cc00640 1 -- 172.21.15.67:0/1219404229 >> v1:172.21.15.67:6789/0 conn(0x7fd8880d0e30 legacy=0x7fd8881626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd88cc00640 1 -- 172.21.15.67:0/1219404229 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8880d18e0 con 0x7fd8881620d0 2024-04-16T13:06:09.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.892+0000 7fd887400640 1 -- 172.21.15.67:0/1219404229 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700194490 0 0) 0x7fd8880d1320 con 0x7fd8880d0e30 2024-04-16T13:06:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1219404229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88806de90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd888069720 tx=0x7fd87802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3957e3430cb3b87c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd887400640 1 -- 172.21.15.67:0/1219404229 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878034070 con 0x7fd8881620d0 2024-04-16T13:06:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd887400640 1 -- 172.21.15.67:0/1219404229 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd878030610 con 0x7fd8881620d0 2024-04-16T13:06:09.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd887400640 1 -- 172.21.15.67:0/1219404229 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8780309e0 con 0x7fd8881620d0 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd88f600640 1 -- 172.21.15.67:0/1219404229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 msgr2=0x7fd88806de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.894+0000 7fd88f600640 1 --2- 172.21.15.67:0/1219404229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88806de90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd888069720 tx=0x7fd87802b960 comp rx=0 tx=0).stop 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 -- 172.21.15.67:0/1219404229 shutdown_connections 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 --2- 172.21.15.67:0/1219404229 >> v2:172.21.15.82:3300/0 conn(0x7fd8880d09f0 0x7fd88809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 --2- 172.21.15.67:0/1219404229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88806de90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 -- 172.21.15.67:0/1219404229 >> 172.21.15.67:0/1219404229 conn(0x7fd8880b40e0 msgr2=0x7fd8880b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:09.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 -- 172.21.15.67:0/1219404229 shutdown_connections 2024-04-16T13:06:09.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.895+0000 7fd88f600640 1 -- 172.21.15.67:0/1219404229 wait complete. 2024-04-16T13:06:09.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.896+0000 7fd88f600640 1 Processor -- start 2024-04-16T13:06:09.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.897+0000 7fd88f600640 1 -- start start 2024-04-16T13:06:09.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8880d09f0 0x7fd888153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8880d0e30 0x7fd8880c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8880cdc50 con 0x7fd8881620d0 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8880d1ea0 con 0x7fd8880d0e30 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88f600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd8880cddd0 con 0x7fd8880d09f0 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50830/0 (socket says 172.21.15.67:50830) 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 -- 172.21.15.67:0/1634356539 learned_addr learned my addr 172.21.15.67:0/1634356539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8880d09f0 0x7fd888153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd887e00640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8880d0e30 0x7fd8880c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 -- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8880d09f0 msgr2=0x7fd888153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8880d09f0 0x7fd888153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 -- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8880d0e30 msgr2=0x7fd8880c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8880d0e30 0x7fd8880c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:09.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.898+0000 7fd88d600640 1 -- 172.21.15.67:0/1634356539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8880c81e0 con 0x7fd8881620d0 2024-04-16T13:06:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd88d600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c7a0 tx=0x7fd88000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880018070 con 0x7fd8881620d0 2024-04-16T13:06:09.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88000a5e0 con 0x7fd8881620d0 2024-04-16T13:06:09.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88000aa50 con 0x7fd8881620d0 2024-04-16T13:06:09.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8880c84c0 con 0x7fd8881620d0 2024-04-16T13:06:09.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.899+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8880c8a80 con 0x7fd8881620d0 2024-04-16T13:06:09.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.901+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd888075bd0 con 0x7fd8881620d0 2024-04-16T13:06:09.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.902+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88000abf0 con 0x7fd8881620d0 2024-04-16T13:06:09.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.902+0000 7fd884c00640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:09.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.902+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd88008b580 con 0x7fd8881620d0 2024-04-16T13:06:09.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.903+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:09.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.904+0000 7fd88cc00640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 0x7fd86806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd878036000 tx=0x7fd878008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:09.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:09.907+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd880059590 con 0x7fd8881620d0 2024-04-16T13:06:10.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.152+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd888071b00 con 0x7fd8881620d0 2024-04-16T13:06:10.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.153+0000 7fd884c00640 1 -- 172.21.15.67:0/1634356539 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fd880058e90 con 0x7fd8881620d0 2024-04-16T13:06:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:10.154 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3243444583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3243444583},{"type":"v1","addr":"172.21.15.82:6837","nonce":3243444583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/4172684565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":4172684565},{"type":"v1","addr":"172.21.15.67:6833","nonce":4172684565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/56179884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":56179884},{"type":"v1","addr":"172.21.15.82:6836","nonce":56179884}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:04:45.468405+0000","modified":"2024-04-16T13:05:07.747289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6835/427491398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":427491398},{"type":"v1","addr":"172.21.15.67:6835","nonce":427491398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-04-16T13:06:10.155 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-04-16T13:06:10.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 msgr2=0x7fd86806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 0x7fd86806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd878036000 tx=0x7fd878008030 comp rx=0 tx=0).stop 2024-04-16T13:06:10.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 msgr2=0x7fd88815a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c7a0 tx=0x7fd88000cc60 comp rx=0 tx=0).stop 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 shutdown_connections 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8881620d0 0x7fd88815a210 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8880d0e30 0x7fd8880c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 --2- 172.21.15.67:0/1634356539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8880d09f0 0x7fd888153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 >> 172.21.15.67:0/1634356539 conn(0x7fd8880b40e0 msgr2=0x7fd8880ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 shutdown_connections 2024-04-16T13:06:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.156+0000 7fd88f600640 1 -- 172.21.15.67:0/1634356539 wait complete. 2024-04-16T13:06:10.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.394+0000 7fecad600640 1 Processor -- start 2024-04-16T13:06:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.394+0000 7fecad600640 1 -- start start 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feca815c420 0x7feca81601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feca815c800 0x7feca80c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca80c5100 0x7feca80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7feca8161110 con 0x7feca815c800 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7feca8160870 con 0x7feca815c420 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.395+0000 7fecad600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feca8160b50 con 0x7feca80c5100 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feca815c800 0x7feca80c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feca815c800 0x7feca80c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50834/0 (socket says 172.21.15.67:50834) 2024-04-16T13:06:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7400640 1 -- 172.21.15.67:0/274053548 learned_addr learned my addr 172.21.15.67:0/274053548 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7fecacc00640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca80c5100 0x7feca80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7e00640 1 --2- 172.21.15.67:0/274053548 >> v2:172.21.15.82:3300/0 conn(0x7feca815c420 0x7feca81601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7400640 1 -- 172.21.15.67:0/274053548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca80c5100 msgr2=0x7feca80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.396+0000 7feca7400640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca80c5100 0x7feca80c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.397+0000 7feca7400640 1 -- 172.21.15.67:0/274053548 >> v2:172.21.15.82:3300/0 conn(0x7feca815c420 msgr2=0x7feca81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.397+0000 7feca7400640 1 --2- 172.21.15.67:0/274053548 >> v2:172.21.15.82:3300/0 conn(0x7feca815c420 0x7feca81601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.397+0000 7feca7400640 1 -- 172.21.15.67:0/274053548 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca8160e30 con 0x7feca815c800 2024-04-16T13:06:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.398+0000 7feca7400640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca815c800 0x7feca80c6220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feca8160a80 tx=0x7fec9402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1377791fc7b99 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.398+0000 7feca6a00640 1 -- 172.21.15.67:0/274053548 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940317c0 con 0x7feca815c800 2024-04-16T13:06:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7feca6a00640 1 -- 172.21.15.67:0/274053548 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec94037070 con 0x7feca815c800 2024-04-16T13:06:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7feca6a00640 1 -- 172.21.15.67:0/274053548 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94031b80 con 0x7feca815c800 2024-04-16T13:06:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 -- 172.21.15.67:0/274053548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca815c800 msgr2=0x7feca80c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca815c800 0x7feca80c6220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feca8160a80 tx=0x7fec9402b860 comp rx=0 tx=0).stop 2024-04-16T13:06:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 -- 172.21.15.67:0/274053548 shutdown_connections 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca80c5100 0x7feca80c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 --2- 172.21.15.67:0/274053548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca815c800 0x7feca80c6220 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 --2- 172.21.15.67:0/274053548 >> v2:172.21.15.82:3300/0 conn(0x7feca815c420 0x7feca81601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 -- 172.21.15.67:0/274053548 >> 172.21.15.67:0/274053548 conn(0x7feca80b2070 msgr2=0x7feca80b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 -- 172.21.15.67:0/274053548 shutdown_connections 2024-04-16T13:06:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.399+0000 7fecad600640 1 -- 172.21.15.67:0/274053548 wait complete. 2024-04-16T13:06:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.401+0000 7fecad600640 1 Processor -- start 2024-04-16T13:06:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.401+0000 7fecad600640 1 -- start start 2024-04-16T13:06:10.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca815c420 0x7feca815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca815c800 0x7feca806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7feca806bba0 con 0x7feca80c5100 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feca806ba20 con 0x7feca815c420 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7fecad600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7feca806bd20 con 0x7feca815c800 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7feca7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7feca7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50842/0 (socket says 172.21.15.67:50842) 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.402+0000 7feca7e00640 1 -- 172.21.15.67:0/1411337843 learned_addr learned my addr 172.21.15.67:0/1411337843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 -- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca815c800 msgr2=0x7feca806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca815c800 0x7feca806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 -- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca815c420 msgr2=0x7feca815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca815c420 0x7feca815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 -- 172.21.15.67:0/1411337843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca81e6380 con 0x7feca80c5100 2024-04-16T13:06:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7feca7e00640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fec98007ef0 tx=0x7fec9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98014620 con 0x7feca80c5100 2024-04-16T13:06:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec98019070 con 0x7feca80c5100 2024-04-16T13:06:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98014a00 con 0x7feca80c5100 2024-04-16T13:06:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.403+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca81e6660 con 0x7feca80c5100 2024-04-16T13:06:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.404+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca81e6c20 con 0x7feca80c5100 2024-04-16T13:06:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.405+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca8075bd0 con 0x7feca80c5100 2024-04-16T13:06:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.406+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec98014ba0 con 0x7feca80c5100 2024-04-16T13:06:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.407+0000 7fec9fe00640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 0x7fec8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.407+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fec9808c910 con 0x7feca80c5100 2024-04-16T13:06:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.407+0000 7feca7400640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 0x7fec8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.409+0000 7feca7400640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 0x7fec8806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec94036000 tx=0x7fec94030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.412+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec9805a8a0 con 0x7feca80c5100 2024-04-16T13:06:10.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.617+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feca815fc60 con 0x7feca80c5100 2024-04-16T13:06:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.618+0000 7fec9fe00640 1 -- 172.21.15.67:0/1411337843 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18752 (secure 0 0 0) 0x7fec9805a1a0 con 0x7feca80c5100 2024-04-16T13:06:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:10.620 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:05:27.574888+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:04:43.795486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-16T13:04:44.442505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-16T13:04:48.121313+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 msgr2=0x7fec8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 0x7fec8806edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec94036000 tx=0x7fec94030000 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 msgr2=0x7feca814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fec98007ef0 tx=0x7fec9800e4b0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 shutdown_connections 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fec8806c8f0 0x7fec8806edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7feca815c800 0x7feca806ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca815c420 0x7feca815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 --2- 172.21.15.67:0/1411337843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feca80c5100 0x7feca814a750 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.621+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 >> 172.21.15.67:0/1411337843 conn(0x7feca80b2070 msgr2=0x7feca80c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.622+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 shutdown_connections 2024-04-16T13:06:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.622+0000 7fecad600640 1 -- 172.21.15.67:0/1411337843 wait complete. 2024-04-16T13:06:10.645 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-16T13:06:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.871+0000 7fd7b3e00640 1 Processor -- start 2024-04-16T13:06:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.871+0000 7fd7b3e00640 1 -- start start 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.873+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f040 0x7fd7b40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.873+0000 7fd7b3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd7b406f9d0 0x7fd7b406e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.873+0000 7fd7b3e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b41641f0 con 0x7fd7b4072050 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.873+0000 7fd7b3e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40b3970 con 0x7fd7b406f9d0 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.873+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b41635e0 con 0x7fd7b406f040 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b2a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd7b4072050 0x7fd7b406e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36392/0 (socket says 172.21.15.67:36392) 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b2a00640 1 -- 172.21.15.67:0/3573846368 learned_addr learned my addr 172.21.15.67:0/3573846368 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3573846368 >> v2:172.21.15.67:3300/0 conn(0x7fd7b406f9d0 0x7fd7b406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b2000640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f040 0x7fd7b40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b3400640 1 -- 172.21.15.67:0/3573846368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f040 msgr2=0x7fd7b40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f040 0x7fd7b40b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b1600640 1 -- 172.21.15.67:0/3573846368 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530677 0 0) 0x7fd7b41641f0 con 0x7fd7b4072050 2024-04-16T13:06:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b3400640 1 -- 172.21.15.67:0/3573846368 >> v1:172.21.15.67:6789/0 conn(0x7fd7b4072050 legacy=0x7fd7b406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.874+0000 7fd7b3400640 1 -- 172.21.15.67:0/3573846368 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b406ed50 con 0x7fd7b406f9d0 2024-04-16T13:06:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.875+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b406f9d0 0x7fd7b406e810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009dc0 tx=0x7fd7ac02be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5634b195e21c767 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b1600640 1 -- 172.21.15.67:0/3573846368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac039070 con 0x7fd7b406f9d0 2024-04-16T13:06:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b1600640 1 -- 172.21.15.67:0/3573846368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac02cc30 con 0x7fd7b406f9d0 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b1600640 1 -- 172.21.15.67:0/3573846368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac034440 con 0x7fd7b406f9d0 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3573846368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b406f9d0 msgr2=0x7fd7b406e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b406f9d0 0x7fd7b406e810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009dc0 tx=0x7fd7ac02be80 comp rx=0 tx=0).stop 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3573846368 shutdown_connections 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b406f9d0 0x7fd7b406e810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3573846368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f040 0x7fd7b40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3573846368 >> 172.21.15.67:0/3573846368 conn(0x7fd7b4067d90 msgr2=0x7fd7b406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.876+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3573846368 shutdown_connections 2024-04-16T13:06:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.877+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3573846368 wait complete. 2024-04-16T13:06:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.878+0000 7fd7b3e00640 1 Processor -- start 2024-04-16T13:06:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.878+0000 7fd7b3e00640 1 -- start start 2024-04-16T13:06:10.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 0x7fd7b4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 0x7fd7b415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4163e80 con 0x7fd7b4072050 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4163ba0 con 0x7fd7b406f040 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.879+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b4072430 con 0x7fd7b406f9d0 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50856/0 (socket says 172.21.15.67:50856) 2024-04-16T13:06:10.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 -- 172.21.15.67:0/3056655484 learned_addr learned my addr 172.21.15.67:0/3056655484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b2000640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 0x7fd7b415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b2a00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 0x7fd7b4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 -- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 msgr2=0x7fd7b415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 0x7fd7b415f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 -- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 msgr2=0x7fd7b4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 0x7fd7b4157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b3400640 1 -- 172.21.15.67:0/3056655484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b4161ee0 con 0x7fd7b4072050 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b2000640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 0x7fd7b415f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.880+0000 7fd7b2a00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 0x7fd7b4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7b3400640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac037040 tx=0x7fd7ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac039050 con 0x7fd7b4072050 2024-04-16T13:06:10.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac045070 con 0x7fd7b4072050 2024-04-16T13:06:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b4159430 con 0x7fd7b4072050 2024-04-16T13:06:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac03e830 con 0x7fd7b4072050 2024-04-16T13:06:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.881+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b41599f0 con 0x7fd7b4072050 2024-04-16T13:06:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.882+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b4075bd0 con 0x7fd7b4072050 2024-04-16T13:06:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.883+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7ac03e9d0 con 0x7fd7b4072050 2024-04-16T13:06:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.884+0000 7fd7aaa00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 0x7fd79406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:10.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.884+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd7ac0aee30 con 0x7fd7b4072050 2024-04-16T13:06:10.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.885+0000 7fd7b2a00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 0x7fd79406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:10.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.886+0000 7fd7b2a00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 0x7fd79406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4000f60 tx=0x7fd7a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:10.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:10.889+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7ac07cee0 con 0x7fd7b4072050 2024-04-16T13:06:11.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.133+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd7b4167380 con 0x7fd7b4072050 2024-04-16T13:06:11.135 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-04-16T13:06:11.135+0000 7fd6fc800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T13:06:11.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.138+0000 7fd7aaa00640 1 -- 172.21.15.67:0/3056655484 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fd7ac07c7e0 con 0x7fd7b4072050 2024-04-16T13:06:11.139 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-16T13:06:11.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.141+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 msgr2=0x7fd79406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:11.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.141+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 0x7fd79406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4000f60 tx=0x7fd7a4009040 comp rx=0 tx=0).stop 2024-04-16T13:06:11.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 msgr2=0x7fd7b41615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:11.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac037040 tx=0x7fd7ac004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:11.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 shutdown_connections 2024-04-16T13:06:11.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd79406c8f0 0x7fd79406edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7b4072050 0x7fd7b41615e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd7b406f9d0 0x7fd7b415f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 --2- 172.21.15.67:0/3056655484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b406f040 0x7fd7b4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 >> 172.21.15.67:0/3056655484 conn(0x7fd7b4067d90 msgr2=0x7fd7b40b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.142+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 shutdown_connections 2024-04-16T13:06:11.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.143+0000 7fd7b3e00640 1 -- 172.21.15.67:0/3056655484 wait complete. 2024-04-16T13:06:11.163 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-16T13:06:11.171 INFO:tasks.ceph.mds.c.smithi067.stderr: -6752> 2024-04-16T13:04:46.721+0000 7f9df4000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T13:06:11.242 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-04-16T13:06:11.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.362+0000 7fc267e00640 1 Processor -- start 2024-04-16T13:06:11.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.363+0000 7fc267e00640 1 -- start start 2024-04-16T13:06:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc267e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 0x7fc2680d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc267e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2680d22c0 0x7fc2680d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc267e00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2680d2b10 con 0x7fc2680d1620 2024-04-16T13:06:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc267e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc2680d1a80 con 0x7fc2680d22c0 2024-04-16T13:06:11.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc267e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc2680d2df0 con 0x7fc26815e7e0 2024-04-16T13:06:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc266000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2680d22c0 0x7fc2680d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc266000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc2680d22c0 0x7fc2680d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50884/0 (socket says 172.21.15.67:50884) 2024-04-16T13:06:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.364+0000 7fc266000640 1 -- 172.21.15.67:0/2328269042 learned_addr learned my addr 172.21.15.67:0/2328269042 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:11.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266000640 1 -- 172.21.15.67:0/2328269042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 msgr2=0x7fc2680d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266a00640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 0x7fc2680d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266000640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 0x7fc2680d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266000640 1 -- 172.21.15.67:0/2328269042 >> v1:172.21.15.82:6789/0 conn(0x7fc2680d1620 legacy=0x7fc2680d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266000640 1 -- 172.21.15.67:0/2328269042 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680d30d0 con 0x7fc2680d22c0 2024-04-16T13:06:11.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.365+0000 7fc266a00640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 0x7fc2680d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.366+0000 7fc266000640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680d10e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc250009870 tx=0x7fc25002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb292f86ad60446 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.366+0000 7fc265600640 1 -- 172.21.15.67:0/2328269042 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250035020 con 0x7fc2680d22c0 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc265600640 1 -- 172.21.15.67:0/2328269042 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc250031640 con 0x7fc2680d22c0 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc265600640 1 -- 172.21.15.67:0/2328269042 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25002d040 con 0x7fc2680d22c0 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 -- 172.21.15.67:0/2328269042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 msgr2=0x7fc2680d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:11.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680d10e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc250009870 tx=0x7fc25002b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 -- 172.21.15.67:0/2328269042 shutdown_connections 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680d10e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 --2- 172.21.15.67:0/2328269042 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc26815e7e0 0x7fc2680d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 -- 172.21.15.67:0/2328269042 >> 172.21.15.67:0/2328269042 conn(0x7fc26809da60 msgr2=0x7fc26808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 -- 172.21.15.67:0/2328269042 shutdown_connections 2024-04-16T13:06:11.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.367+0000 7fc267e00640 1 -- 172.21.15.67:0/2328269042 wait complete. 2024-04-16T13:06:11.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.369+0000 7fc267e00640 1 Processor -- start 2024-04-16T13:06:11.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.369+0000 7fc267e00640 1 -- start start 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2680d1620 0x7fc2680cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 0x7fc26815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680d2720 con 0x7fc2680d22c0 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680d3690 con 0x7fc26815e7e0 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc267e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc2680d28a0 con 0x7fc2680d1620 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc266000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.370+0000 7fc266000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50894/0 (socket says 172.21.15.67:50894) 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 -- 172.21.15.67:0/3150593093 learned_addr learned my addr 172.21.15.67:0/3150593093 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266a00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2680d1620 0x7fc2680cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc267400640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 0x7fc26815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 -- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2680d1620 msgr2=0x7fc2680cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2680d1620 0x7fc2680cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 -- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 msgr2=0x7fc26815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 0x7fc26815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 -- 172.21.15.67:0/3150593093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680ccea0 con 0x7fc2680d22c0 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc267400640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 0x7fc26815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.371+0000 7fc266000640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc25002b930 tx=0x7fc2500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.372+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250040070 con 0x7fc2680d22c0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.372+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc250039c10 con 0x7fc2680d22c0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.372+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250035040 con 0x7fc2680d22c0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.372+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2680cd170 con 0x7fc2680d22c0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.372+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2680cd730 con 0x7fc2680d22c0 2024-04-16T13:06:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.373+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc268075bd0 con 0x7fc2680d22c0 2024-04-16T13:06:11.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.374+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc25004b060 con 0x7fc2680d22c0 2024-04-16T13:06:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.375+0000 7fc25ea00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 0x7fc24406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.375+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fc2500adab0 con 0x7fc2680d22c0 2024-04-16T13:06:11.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.376+0000 7fc266a00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 0x7fc24406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:11.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.377+0000 7fc266a00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 0x7fc24406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc258006fd0 tx=0x7fc258008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.380+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc25002f300 con 0x7fc2680d22c0 2024-04-16T13:06:11.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:11.623+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc26808c250 con 0x7fc2680d22c0 2024-04-16T13:06:12.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.142+0000 7fc25ea00640 1 -- 172.21.15.67:0/3150593093 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fc25007ba70 con 0x7fc2680d22c0 2024-04-16T13:06:12.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 msgr2=0x7fc24406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 0x7fc24406ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc258006fd0 tx=0x7fc258008040 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 msgr2=0x7fc2680cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc25002b930 tx=0x7fc2500046c0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 shutdown_connections 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc24406c920 0x7fc24406ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc26815e7e0 0x7fc26815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2680d22c0 0x7fc2680cc960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 --2- 172.21.15.67:0/3150593093 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc2680d1620 0x7fc2680cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.146+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 >> 172.21.15.67:0/3150593093 conn(0x7fc26809da60 msgr2=0x7fc2680b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.147+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 shutdown_connections 2024-04-16T13:06:12.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.147+0000 7fc267e00640 1 -- 172.21.15.67:0/3150593093 wait complete. 2024-04-16T13:06:12.173 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-16T13:06:12.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.448+0000 7f9275200640 1 Processor -- start 2024-04-16T13:06:12.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.448+0000 7f9275200640 1 -- start start 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f9275200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92700c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f9275200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927015ec90 con 0x7f927015e8b0 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f9275200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92700b4770 con 0x7f9270099b70 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f9275200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f92700b5010 con 0x7f92700d0c20 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f926f400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f927015e8b0 0x7f927006f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41404/0 (socket says 172.21.15.67:41404) 2024-04-16T13:06:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f926f400640 1 -- 172.21.15.67:0/2039723680 learned_addr learned my addr 172.21.15.67:0/2039723680 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.450+0000 7f926fe00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92700c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718754395 0 0) 0x7f927015ec90 con 0x7f927015e8b0 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9254003520 con 0x7f927015e8b0 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 564250085 0 0) 0x7f9254003520 con 0x7f927015e8b0 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 msgr2=0x7f92700c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:12.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92700c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 >> v1:172.21.15.82:6789/0 conn(0x7f9270099b70 legacy=0x7f92700d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92700b4a50 con 0x7f927015e8b0 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f9260001670 con 0x7f927015e8b0 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 >> v1:172.21.15.67:6789/0 conn(0x7f927015e8b0 legacy=0x7f927006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92700b5010 con 0x7f9254004800 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f925400bad0 con 0x7f92540039e0 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.451+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f925400bcd0 con 0x7f92700d0c20 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926fe00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 -- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 msgr2=0x7f92540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926f400640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700d0c20 0x7f92540051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 -- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92540039e0 msgr2=0x7f9254003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92540039e0 0x7f9254003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.452+0000 7f926ea00640 1 -- 172.21.15.67:0/2039723680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9254003520 con 0x7f9254004800 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.453+0000 7f926ea00640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9254004c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f925c001720 tx=0x7f9254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe09f2e70630427d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c001370 con 0x7f9254004800 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c0052d0 con 0x7f9254004800 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f926e000640 1 -- 172.21.15.67:0/2039723680 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c003830 con 0x7f9254004800 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 -- 172.21.15.67:0/2039723680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 msgr2=0x7f9254004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 --2- 172.21.15.67:0/2039723680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9254004c80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f925c001720 tx=0x7f9254005830 comp rx=0 tx=0).stop 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f926fe00640 1 -- 172.21.15.67:0/2039723680 reap_dead start 2024-04-16T13:06:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 -- 172.21.15.67:0/2039723680 shutdown_connections 2024-04-16T13:06:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 -- 172.21.15.67:0/2039723680 >> 172.21.15.67:0/2039723680 conn(0x7f927006bc00 msgr2=0x7f927006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 -- 172.21.15.67:0/2039723680 shutdown_connections 2024-04-16T13:06:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.454+0000 7f9275200640 1 -- 172.21.15.67:0/2039723680 wait complete. 2024-04-16T13:06:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.456+0000 7f9275200640 1 Processor -- start 2024-04-16T13:06:12.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.456+0000 7f9275200640 1 -- start start 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f927015d680 0x7f9270150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700c93b0 0x7f92700c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f927006fb50 con 0x7f9254004800 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f927006efb0 con 0x7f927015d680 2024-04-16T13:06:12.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f9275200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f927006e8e0 con 0x7f92700c93b0 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37260/0 (socket says 172.21.15.67:37260) 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 -- 172.21.15.67:0/1845087092 learned_addr learned my addr 172.21.15.67:0/1845087092 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 -- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700c93b0 msgr2=0x7f92700c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700c93b0 0x7f92700c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 -- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f927015d680 msgr2=0x7f9270150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f927015d680 0x7f9270150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.458+0000 7f926f400640 1 -- 172.21.15.67:0/1845087092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9270160c80 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f926f400640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f926000d770 tx=0x7f926000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260019070 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92600074e0 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260004a20 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9270160f20 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.459+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92701614e0 con 0x7f9254004800 2024-04-16T13:06:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.460+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92700ca700 con 0x7f9254004800 2024-04-16T13:06:12.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.461+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f926001c070 con 0x7f9254004800 2024-04-16T13:06:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.462+0000 7f9267400640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 0x7f925006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.462+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f926008b900 con 0x7f9254004800 2024-04-16T13:06:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.463+0000 7f926ea00640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 0x7f925006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.464+0000 7f926ea00640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 0x7f925006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f925c033000 tx=0x7f925c02f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:12.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.467+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92700ca700 con 0x7f9254004800 2024-04-16T13:06:12.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:12.675+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9270075bd0 con 0x7f9254004800 2024-04-16T13:06:13.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.146+0000 7f9267400640 1 -- 172.21.15.67:0/1845087092 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f926000de20 con 0x7f9254004800 2024-04-16T13:06:13.148 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-04-16T13:06:13.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 msgr2=0x7f925006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 0x7f925006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f925c033000 tx=0x7f925c02f000 comp rx=0 tx=0).stop 2024-04-16T13:06:13.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 msgr2=0x7f9270160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f926000d770 tx=0x7f926000dc30 comp rx=0 tx=0).stop 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 shutdown_connections 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f925006c8f0 0x7f925006edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f92700c93b0 0x7f92700c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f927015d680 0x7f9270150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 --2- 172.21.15.67:0/1845087092 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9254004800 0x7f9270160740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.150+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 >> 172.21.15.67:0/1845087092 conn(0x7f927006bc00 msgr2=0x7f927006f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.151+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 shutdown_connections 2024-04-16T13:06:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.151+0000 7f9275200640 1 -- 172.21.15.67:0/1845087092 wait complete. 2024-04-16T13:06:13.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-16T13:06:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.389+0000 7fb552000640 1 Processor -- start 2024-04-16T13:06:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.389+0000 7fb552000640 1 -- start start 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb552000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb54c162b90 0x7fb54c072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb552000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54c1633e0 con 0x7fb54c071de0 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb552000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54c0afed0 con 0x7fb54c144c40 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb552000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c072780 con 0x7fb54c162b90 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb543e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb54c071de0 0x7fb54c162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41420/0 (socket says 172.21.15.67:41420) 2024-04-16T13:06:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.391+0000 7fb543e00640 1 -- 172.21.15.67:0/21845277 learned_addr learned my addr 172.21.15.67:0/21845277 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788819546 0 0) 0x7fb54c1633e0 con 0x7fb54c071de0 2024-04-16T13:06:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb530003520 con 0x7fb54c071de0 2024-04-16T13:06:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb551600640 1 --2- 172.21.15.67:0/21845277 >> v2:172.21.15.82:3300/0 conn(0x7fb54c162b90 0x7fb54c072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374137386 0 0) 0x7fb530003520 con 0x7fb54c071de0 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 >> v2:172.21.15.82:3300/0 conn(0x7fb54c162b90 msgr2=0x7fb54c072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 --2- 172.21.15.67:0/21845277 >> v2:172.21.15.82:3300/0 conn(0x7fb54c162b90 0x7fb54c072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 >> v1:172.21.15.82:6789/0 conn(0x7fb54c144c40 legacy=0x7fb54c0af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c163100 con 0x7fb54c071de0 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fb534001670 con 0x7fb54c071de0 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 >> v1:172.21.15.67:6789/0 conn(0x7fb54c071de0 legacy=0x7fb54c162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb530003a00 0x7fb530003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 0x7fb53000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb53000c130 con 0x7fb530005210 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb53000c2e0 con 0x7fb530003a00 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.392+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb53000c4e0 con 0x7fb530004800 2024-04-16T13:06:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 0x7fb53000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb550c00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb530003a00 0x7fb530003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb543e00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 -- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530004800 msgr2=0x7fb530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 -- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb530003a00 msgr2=0x7fb530003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb530003a00 0x7fb530003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb551600640 1 -- 172.21.15.67:0/21845277 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb530003520 con 0x7fb530005210 2024-04-16T13:06:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.393+0000 7fb550c00640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb530003a00 0x7fb530003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.394+0000 7fb551600640 1 -- 172.21.15.67:0/21845277 reap_dead start 2024-04-16T13:06:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb551600640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 0x7fb53000b9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb544007360 tx=0x7fb530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d337ed9cb00a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544009be0 con 0x7fb530005210 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54402ccf0 con 0x7fb530005210 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb54be00640 1 -- 172.21.15.67:0/21845277 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544003bd0 con 0x7fb530005210 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb552000640 1 -- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 msgr2=0x7fb53000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.395+0000 7fb552000640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 0x7fb53000b9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb544007360 tx=0x7fb530005830 comp rx=0 tx=0).stop 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.396+0000 7fb552000640 1 -- 172.21.15.67:0/21845277 shutdown_connections 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.396+0000 7fb552000640 1 --2- 172.21.15.67:0/21845277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb530005210 0x7fb53000b9c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.396+0000 7fb552000640 1 -- 172.21.15.67:0/21845277 >> 172.21.15.67:0/21845277 conn(0x7fb54c067d90 msgr2=0x7fb54c06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.396+0000 7fb552000640 1 -- 172.21.15.67:0/21845277 shutdown_connections 2024-04-16T13:06:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.396+0000 7fb552000640 1 -- 172.21.15.67:0/21845277 wait complete. 2024-04-16T13:06:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.398+0000 7fb552000640 1 Processor -- start 2024-04-16T13:06:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.398+0000 7fb552000640 1 -- start start 2024-04-16T13:06:13.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 0x7fb54c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb54c0cdcd0 0x7fb54c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0af2a0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0aefc0 con 0x7fb54c0cdcd0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb552000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c145020 con 0x7fb530005210 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37286/0 (socket says 172.21.15.67:37286) 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 -- 172.21.15.67:0/1740362476 learned_addr learned my addr 172.21.15.67:0/1740362476 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb550c00640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 0x7fb54c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb543e00640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb54c0cdcd0 0x7fb54c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 -- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 msgr2=0x7fb54c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 0x7fb54c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 -- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb54c0cdcd0 msgr2=0x7fb54c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb54c0cdcd0 0x7fb54c0ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb551600640 1 -- 172.21.15.67:0/1740362476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c1f52b0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.399+0000 7fb550c00640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 0x7fb54c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb551600640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb544007450 tx=0x7fb544004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544043070 con 0x7fb54c1f42b0 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54402caf0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544009be0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c1f4fd0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.400+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c130fa0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.402+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54c075bd0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.403+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb544046070 con 0x7fb54c1f42b0 2024-04-16T13:06:13.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.403+0000 7fb549600640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 0x7fb52806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:13.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.404+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7fb5440acf60 con 0x7fb54c1f42b0 2024-04-16T13:06:13.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.404+0000 7fb550c00640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 0x7fb52806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:13.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.405+0000 7fb550c00640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 0x7fb52806ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0015b0 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:13.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.408+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb54407b0e0 con 0x7fb54c1f42b0 2024-04-16T13:06:13.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:13.617+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb54c147950 con 0x7fb54c1f42b0 2024-04-16T13:06:14.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.161+0000 7fb549600640 1 -- 172.21.15.67:0/1740362476 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fb54407a9e0 con 0x7fb54c1f42b0 2024-04-16T13:06:14.163 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.164+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 msgr2=0x7fb52806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.164+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 0x7fb52806ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0015b0 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 msgr2=0x7fb54c1f4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb544007450 tx=0x7fb544004ab0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 shutdown_connections 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb52806c920 0x7fb52806ede0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb54c1f42b0 0x7fb54c1f4730 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb54c0cdcd0 0x7fb54c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 --2- 172.21.15.67:0/1740362476 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb530005210 0x7fb54c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 >> 172.21.15.67:0/1740362476 conn(0x7fb54c067d90 msgr2=0x7fb54c15fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 shutdown_connections 2024-04-16T13:06:14.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.165+0000 7fb552000640 1 -- 172.21.15.67:0/1740362476 wait complete. 2024-04-16T13:06:14.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-16T13:06:14.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.404+0000 7fde30600640 1 Processor -- start 2024-04-16T13:06:14.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.405+0000 7fde30600640 1 -- start start 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde30600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fde280b7020 0x7fde280d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde30600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde280d2a40 con 0x7fde2815e980 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde30600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde280d2d20 con 0x7fde280b8950 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde30600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fde280d3650 con 0x7fde280b7020 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde2dc00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fde2815e980 0x7fde280b6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41434/0 (socket says 172.21.15.67:41434) 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde2d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fde280b7020 0x7fde280d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.406+0000 7fde2dc00640 1 -- 172.21.15.67:0/527063706 learned_addr learned my addr 172.21.15.67:0/527063706 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:14.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.407+0000 7fde2d200640 1 -- 172.21.15.67:0/527063706 >> v1:172.21.15.82:6789/0 conn(0x7fde280b8950 legacy=0x7fde280d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:14.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.407+0000 7fde2d200640 1 -- 172.21.15.67:0/527063706 >> v1:172.21.15.67:6789/0 conn(0x7fde2815e980 legacy=0x7fde280b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.407+0000 7fde2d200640 1 -- 172.21.15.67:0/527063706 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde280d3000 con 0x7fde280b7020 2024-04-16T13:06:14.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.408+0000 7fde2d200640 1 --2- 172.21.15.67:0/527063706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde280d4080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fde280d37d0 tx=0x7fde1c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6b7147680b925 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:14.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.408+0000 7fde27e00640 1 -- 172.21.15.67:0/527063706 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c035020 con 0x7fde280b7020 2024-04-16T13:06:14.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.408+0000 7fde27e00640 1 -- 172.21.15.67:0/527063706 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c031810 con 0x7fde280b7020 2024-04-16T13:06:14.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.408+0000 7fde27e00640 1 -- 172.21.15.67:0/527063706 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c031be0 con 0x7fde280b7020 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 -- 172.21.15.67:0/527063706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 msgr2=0x7fde280d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 --2- 172.21.15.67:0/527063706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde280d4080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fde280d37d0 tx=0x7fde1c02b8b0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 -- 172.21.15.67:0/527063706 shutdown_connections 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 --2- 172.21.15.67:0/527063706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde280d4080 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 -- 172.21.15.67:0/527063706 >> 172.21.15.67:0/527063706 conn(0x7fde28067b80 msgr2=0x7fde28067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:14.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 -- 172.21.15.67:0/527063706 shutdown_connections 2024-04-16T13:06:14.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.409+0000 7fde30600640 1 -- 172.21.15.67:0/527063706 wait complete. 2024-04-16T13:06:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.411+0000 7fde30600640 1 Processor -- start 2024-04-16T13:06:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.411+0000 7fde30600640 1 -- start start 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde280b8950 0x7fde280cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 0x7fde280ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fde2815eee0 con 0x7fde280b7020 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde2815ed60 con 0x7fde2815e980 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde30600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fde280d2480 con 0x7fde280b8950 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde2dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde2dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37300/0 (socket says 172.21.15.67:37300) 2024-04-16T13:06:14.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.412+0000 7fde2dc00640 1 -- 172.21.15.67:0/1837830122 learned_addr learned my addr 172.21.15.67:0/1837830122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2d200640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde280b8950 0x7fde280cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 -- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde280b8950 msgr2=0x7fde280cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde280b8950 0x7fde280cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 -- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 msgr2=0x7fde280ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2e600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 0x7fde280ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 0x7fde280ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 -- 172.21.15.67:0/1837830122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde280c9290 con 0x7fde280b7020 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2e600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 0x7fde280ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:14.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde2dc00640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c3f0 tx=0x7fde1400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14017070 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14005ce0 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde140072f0 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.413+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde280c9570 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.414+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde280c9b30 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.415+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde28068a70 con 0x7fde280b7020 2024-04-16T13:06:14.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.416+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde1401a070 con 0x7fde280b7020 2024-04-16T13:06:14.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.417+0000 7fde25600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 0x7fde0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.417+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fde1408b070 con 0x7fde280b7020 2024-04-16T13:06:14.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.417+0000 7fde2d200640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 0x7fde0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:14.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.419+0000 7fde2d200640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 0x7fde0806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde1c036000 tx=0x7fde1c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:14.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.421+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde140592e0 con 0x7fde280b7020 2024-04-16T13:06:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:14.624+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde280b9a60 con 0x7fde280b7020 2024-04-16T13:06:15.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.171+0000 7fde25600640 1 -- 172.21.15.67:0/1837830122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fde14058be0 con 0x7fde280b7020 2024-04-16T13:06:15.173 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' removed 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 msgr2=0x7fde0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 0x7fde0806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde1c036000 tx=0x7fde1c008030 comp rx=0 tx=0).stop 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 msgr2=0x7fde2814c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c3f0 tx=0x7fde1400c8b0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 shutdown_connections 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fde0806c8f0 0x7fde0806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde2815e980 0x7fde280ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fde280b8950 0x7fde280cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 --2- 172.21.15.67:0/1837830122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde280b7020 0x7fde2814c0e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 >> 172.21.15.67:0/1837830122 conn(0x7fde28067b80 msgr2=0x7fde2806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 shutdown_connections 2024-04-16T13:06:15.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.178+0000 7fde30600640 1 -- 172.21.15.67:0/1837830122 wait complete. 2024-04-16T13:06:15.207 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-16T13:06:15.207 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-16T13:06:15.207 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T13:06:15.208 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:06:15.208 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-16T13:06:15.208 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-16T13:06:15.208 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T13:06:15.208 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:06:15.208 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-16T13:06:15.208 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-16T13:06:15.209 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T13:06:15.209 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:06:15.209 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-16T13:06:15.209 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-16T13:06:15.209 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T13:06:15.209 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:06:15.227 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T13:06:15.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-16T13:06:15.229 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T13:06:15.229 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-16T13:06:15.230 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T13:06:15.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-16T13:06:15.235 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T13:06:15.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-16T13:06:15.274 INFO:tasks.ceph.mds.c:Started 2024-04-16T13:06:15.275 DEBUG:teuthology.parallel:result is None 2024-04-16T13:06:15.279 INFO:tasks.ceph.mds.a:Started 2024-04-16T13:06:15.280 DEBUG:teuthology.parallel:result is None 2024-04-16T13:06:15.283 INFO:tasks.ceph.mds.b:Started 2024-04-16T13:06:15.284 DEBUG:teuthology.parallel:result is None 2024-04-16T13:06:15.290 INFO:tasks.ceph.mds.d:Started 2024-04-16T13:06:15.290 DEBUG:teuthology.parallel:result is None 2024-04-16T13:06:15.290 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-16T13:06:15.433 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-04-16T13:06:15.433 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-04-16T13:06:15.449 INFO:tasks.ceph.mds.b.smithi082.stdout:starting mds.b at 2024-04-16T13:06:15.451 INFO:tasks.ceph.mds.d.smithi082.stdout:starting mds.d at 2024-04-16T13:06:15.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.483+0000 7fd9ae400640 1 Processor -- start 2024-04-16T13:06:15.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.483+0000 7fd9ae400640 1 -- start start 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9a815e7e0 0x7fd9a80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9a80d22c0 0x7fd9a80d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d1620 0x7fd9a80d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a80d1a80 con 0x7fd9a815e7e0 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a80d2b10 con 0x7fd9a80d22c0 2024-04-16T13:06:15.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.484+0000 7fd9ae400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a80d2df0 con 0x7fd9a80d1620 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9a815e7e0 0x7fd9a80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd9a815e7e0 0x7fd9a80d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37332/0 (socket says 172.21.15.67:37332) 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 -- 172.21.15.67:0/557685852 learned_addr learned my addr 172.21.15.67:0/557685852 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9a7e00640 1 --2- 172.21.15.67:0/557685852 >> v2:172.21.15.82:3300/0 conn(0x7fd9a80d22c0 0x7fd9a80d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ada00640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d1620 0x7fd9a80d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 -- 172.21.15.67:0/557685852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d1620 msgr2=0x7fd9a80d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d1620 0x7fd9a80d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 -- 172.21.15.67:0/557685852 >> v2:172.21.15.82:3300/0 conn(0x7fd9a80d22c0 msgr2=0x7fd9a80d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 --2- 172.21.15.67:0/557685852 >> v2:172.21.15.82:3300/0 conn(0x7fd9a80d22c0 0x7fd9a80d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.485+0000 7fd9ad000640 1 -- 172.21.15.67:0/557685852 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a80d30d0 con 0x7fd9a815e7e0 2024-04-16T13:06:15.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.486+0000 7fd9ad000640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80d0240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806ec10 tx=0x7fd99c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7849fb82a1188080 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9a7400640 1 -- 172.21.15.67:0/557685852 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c02d040 con 0x7fd9a815e7e0 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9a7400640 1 -- 172.21.15.67:0/557685852 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c004230 con 0x7fd9a815e7e0 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9a7400640 1 -- 172.21.15.67:0/557685852 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c003610 con 0x7fd9a815e7e0 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 -- 172.21.15.67:0/557685852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 msgr2=0x7fd9a80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80d0240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd9a806ec10 tx=0x7fd99c02b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 -- 172.21.15.67:0/557685852 shutdown_connections 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d1620 0x7fd9a80d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 --2- 172.21.15.67:0/557685852 >> v2:172.21.15.82:3300/0 conn(0x7fd9a80d22c0 0x7fd9a80d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 --2- 172.21.15.67:0/557685852 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80d0240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 -- 172.21.15.67:0/557685852 >> 172.21.15.67:0/557685852 conn(0x7fd9a809da60 msgr2=0x7fd9a808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 -- 172.21.15.67:0/557685852 shutdown_connections 2024-04-16T13:06:15.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.487+0000 7fd9ae400640 1 -- 172.21.15.67:0/557685852 wait complete. 2024-04-16T13:06:15.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.489+0000 7fd9ae400640 1 Processor -- start 2024-04-16T13:06:15.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.489+0000 7fd9ae400640 1 -- start start 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 0x7fd9a80cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d22c0 0x7fd9a80cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a80d2750 con 0x7fd9a815e7e0 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a80d3690 con 0x7fd9a80d1620 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ae400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a80d28d0 con 0x7fd9a80d22c0 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.490+0000 7fd9ada00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37340/0 (socket says 172.21.15.67:37340) 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 -- 172.21.15.67:0/2948196488 learned_addr learned my addr 172.21.15.67:0/2948196488 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ad000640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 0x7fd9a80cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9a7e00640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d22c0 0x7fd9a80cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 -- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d22c0 msgr2=0x7fd9a80cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d22c0 0x7fd9a80cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 -- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 msgr2=0x7fd9a80cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 0x7fd9a80cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 -- 172.21.15.67:0/2948196488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a80cb070 con 0x7fd9a815e7e0 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ad000640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 0x7fd9a80cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:15.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.491+0000 7fd9ada00640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007d20 tx=0x7fd9a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.492+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0014420 con 0x7fd9a815e7e0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.492+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a0019070 con 0x7fd9a815e7e0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.492+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0014820 con 0x7fd9a815e7e0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.492+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a80ca4e0 con 0x7fd9a815e7e0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.492+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a80c8470 con 0x7fd9a815e7e0 2024-04-16T13:06:15.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.493+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a8075bd0 con 0x7fd9a815e7e0 2024-04-16T13:06:15.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.494+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9a00149c0 con 0x7fd9a815e7e0 2024-04-16T13:06:15.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.495+0000 7fd9a4c00640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 0x7fd98806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:15.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.496+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7fd9a008c1b0 con 0x7fd9a815e7e0 2024-04-16T13:06:15.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.496+0000 7fd9ad000640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 0x7fd98806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:15.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.497+0000 7fd9ad000640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 0x7fd98806ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd99c035000 tx=0x7fd99c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:15.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.500+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9a005a740 con 0x7fd9a815e7e0 2024-04-16T13:06:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:15.715+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd9a80c81a0 con 0x7fd9a815e7e0 2024-04-16T13:06:16.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.197+0000 7fd9a4c00640 1 -- 172.21.15.67:0/2948196488 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7fd9a005a040 con 0x7fd9a815e7e0 2024-04-16T13:06:16.198 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 msgr2=0x7fd98806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 0x7fd98806ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd99c035000 tx=0x7fd99c008030 comp rx=0 tx=0).stop 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 msgr2=0x7fd9a80cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007d20 tx=0x7fd9a000e4b0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 shutdown_connections 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd98806c920 0x7fd98806ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9a815e7e0 0x7fd9a80cbd00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9a80d22c0 0x7fd9a80cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 --2- 172.21.15.67:0/2948196488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9a80d1620 0x7fd9a80cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 >> 172.21.15.67:0/2948196488 conn(0x7fd9a809da60 msgr2=0x7fd9a806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:16.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 shutdown_connections 2024-04-16T13:06:16.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.202+0000 7fd9ae400640 1 -- 172.21.15.67:0/2948196488 wait complete. 2024-04-16T13:06:16.226 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-16T13:06:16.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.432+0000 7f5519800640 1 Processor -- start 2024-04-16T13:06:16.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.432+0000 7f5519800640 1 -- start start 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.433+0000 7f5519800640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f55140cc120 0x7f551415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.433+0000 7f5519800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55140cfd20 0x7f551406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.433+0000 7f5519800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55140cde10 con 0x7f55140cf890 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5519800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f55140c6b00 con 0x7f55140cfd20 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5519800640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f551415f630 con 0x7f55140cc120 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55140cfd20 0x7f551406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f55140cfd20 0x7f551406ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37352/0 (socket says 172.21.15.67:37352) 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 -- 172.21.15.67:0/1525572358 learned_addr learned my addr 172.21.15.67:0/1525572358 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5513400640 1 --1- 172.21.15.67:0/1525572358 >> v1:172.21.15.67:6789/0 conn(0x7f55140cf890 0x7f55140b3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41448/0 (socket says 172.21.15.67:41448) 2024-04-16T13:06:16.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5513e00640 1 --2- 172.21.15.67:0/1525572358 >> v2:172.21.15.82:3300/0 conn(0x7f55140cc120 0x7f551415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 -- 172.21.15.67:0/1525572358 >> v2:172.21.15.82:3300/0 conn(0x7f55140cc120 msgr2=0x7f551415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:16.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 --2- 172.21.15.67:0/1525572358 >> v2:172.21.15.82:3300/0 conn(0x7f55140cc120 0x7f551415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 -- 172.21.15.67:0/1525572358 >> v1:172.21.15.67:6789/0 conn(0x7f55140cf890 legacy=0x7f55140b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.434+0000 7f5518e00640 1 -- 172.21.15.67:0/1525572358 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55140ce0b0 con 0x7f55140cfd20 2024-04-16T13:06:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.436+0000 7f5518e00640 1 --2- 172.21.15.67:0/1525572358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f551406ba20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f55140d01a0 tx=0x7f550c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60f6d4865652cee server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.436+0000 7f5512a00640 1 -- 172.21.15.67:0/1525572358 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c02e070 con 0x7f55140cfd20 2024-04-16T13:06:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.436+0000 7f5512a00640 1 -- 172.21.15.67:0/1525572358 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c037070 con 0x7f55140cfd20 2024-04-16T13:06:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.436+0000 7f5512a00640 1 -- 172.21.15.67:0/1525572358 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c031a00 con 0x7f55140cfd20 2024-04-16T13:06:16.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.437+0000 7f5519800640 1 -- 172.21.15.67:0/1525572358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 msgr2=0x7f551406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.437+0000 7f5519800640 1 --2- 172.21.15.67:0/1525572358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f551406ba20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f55140d01a0 tx=0x7f550c02b880 comp rx=0 tx=0).stop 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 -- 172.21.15.67:0/1525572358 shutdown_connections 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 --2- 172.21.15.67:0/1525572358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f551406ba20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 --2- 172.21.15.67:0/1525572358 >> v2:172.21.15.82:3300/0 conn(0x7f55140cc120 0x7f551415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 -- 172.21.15.67:0/1525572358 >> 172.21.15.67:0/1525572358 conn(0x7f55140b2070 msgr2=0x7f55140b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 -- 172.21.15.67:0/1525572358 shutdown_connections 2024-04-16T13:06:16.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.438+0000 7f5519800640 1 -- 172.21.15.67:0/1525572358 wait complete. 2024-04-16T13:06:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.440+0000 7f5519800640 1 Processor -- start 2024-04-16T13:06:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.440+0000 7f5519800640 1 -- start start 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55140cc120 0x7f551406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55140cf890 0x7f551414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55140b38a0 con 0x7f55140cfd20 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55140b4e20 con 0x7f55140cc120 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.441+0000 7f5519800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f55140ce390 con 0x7f55140cf890 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37360/0 (socket says 172.21.15.67:37360) 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 -- 172.21.15.67:0/1116588564 learned_addr learned my addr 172.21.15.67:0/1116588564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5513400640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55140cf890 0x7f551414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5513e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55140cc120 0x7f551406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 -- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55140cf890 msgr2=0x7f551414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55140cf890 0x7f551414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 -- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55140cc120 msgr2=0x7f551406fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55140cc120 0x7f551406fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.442+0000 7f5518e00640 1 -- 172.21.15.67:0/1116588564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551406dd20 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f5518e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f550c02b8c0 tx=0x7f550c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c032880 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c032a20 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c032e10 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5514152c60 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.443+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551414c040 con 0x7f55140cfd20 2024-04-16T13:06:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.445+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5514075bd0 con 0x7f55140cfd20 2024-04-16T13:06:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.445+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f550c0453f0 con 0x7f55140cfd20 2024-04-16T13:06:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.446+0000 7f550be00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 0x7f54f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.446+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f550c0ad860 con 0x7f55140cfd20 2024-04-16T13:06:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.447+0000 7f5513e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 0x7f54f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.448+0000 7f5513e00640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 0x7f54f006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.451+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f550c040070 con 0x7f55140cfd20 2024-04-16T13:06:16.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.734+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f55141506b0 con 0x7f55140cfd20 2024-04-16T13:06:16.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.735+0000 7f550be00640 1 -- 172.21.15.67:0/1116588564 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v3) ==== 80+0+6645 (secure 0 0 0) 0x7f550c07be50 con 0x7f55140cfd20 2024-04-16T13:06:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:16.736 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2024-04-16T13:06:16.736 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAsdx5mKDiwKxAAB/2SqKXC6PinGTxmG1wjNw==", 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.737 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAtdx5m85CDExAAl9uft//pnRfoLRJAzjDJMw==", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAtdx5mJhUDAhAAAS1VD8kMRDpnuNfLyrP8MA==", 2024-04-16T13:06:16.738 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAtdx5mWZAUJBAAqu1bvA9kKNV3n1iQ/ebQ3Q==", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-16T13:06:16.739 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAydx5m/fVHARAAfogNjHicu/zxOIpsc9JGoQ==", 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.740 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQA1dx5mX24rEBAA3VdBo+Xd3MyAhBuJb8PksA==", 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.741 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQA4dx5mniK+HRAAkm/W4Le2u1LK7yAJ2UKjOg==", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQA7dx5mhlxdORAAVny2FQuxpEigVHELFyXh8A==", 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.742 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBCdx5m5tdsKBAAPz5WQ4UT4zexGadiaHW0ng==", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBFdx5muKJYMxAAoRYM0hhUoF3vnWyAedUKzA==", 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.744 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBJdx5mQBcmBBAA9SfW6lchF2KudqGNSxPXSw==", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBMdx5mIYuWDhAAQ385knJcu84tJi5H8/dtyw==", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2024-04-16T13:06:16.745 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAtdx5mZkj6MRAAjWl5YRoT0oxyKKPI86iZSw==", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-16T13:06:16.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAudx5mGO/NDBAAC9cDA/W+X930tJXedCMk7g==", 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.747 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAudx5msV+RARAAJ6bG7u19XN/Yacy6G3Elig==", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAudx5mAQtdFxAAZ5rjfolmqHEcIVoVey37Fw==", 2024-04-16T13:06:16.748 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQArdx5m9aazIRAAb+39brq9wflMrIb+fmXmAg==", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2024-04-16T13:06:16.749 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mds", 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5msBqsBhAAZdfHin9qOaPpewA7B4IjaQ==", 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mds" 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mgr", 2024-04-16T13:06:16.750 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5mlSasBhAAAqAqht2mtmNPSzvdmO+nBw==", 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-osd", 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5mqi+sBhAA84/62lazuxwNUt2vY1NBtg==", 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-osd" 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.751 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd", 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5mYTisBhAAeFegkIYK6hvJ4t0tWvGuXw==", 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5mLkGsBhAA+8zujdnA17lff/R9C0mgNQ==", 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.752 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rgw", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQBVdx5mQUqsBhAA3IohgebgorfcE5YVwUscig==", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAsdx5mD6xAHxAA9qRCa1l04q0YEtWCtybfYg==", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-04-16T13:06:16.753 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAsdx5mW7pVExAAKg1y730VfhQ8TZrPr1QPTA==", 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-04-16T13:06:16.754 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:16.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.737+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 msgr2=0x7f54f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 0x7f54f006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006fd0 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 msgr2=0x7f5514072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f550c02b8c0 tx=0x7f550c0046c0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 shutdown_connections 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f54f006c8f0 0x7f54f006edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55140cfd20 0x7f5514072ba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f55140cf890 0x7f551414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 --2- 172.21.15.67:0/1116588564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55140cc120 0x7f551406fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 >> 172.21.15.67:0/1116588564 conn(0x7f55140b2070 msgr2=0x7f5514150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 shutdown_connections 2024-04-16T13:06:16.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.738+0000 7f5519800640 1 -- 172.21.15.67:0/1116588564 wait complete. 2024-04-16T13:06:16.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-16T13:06:16.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.977+0000 7f9929a00640 1 Processor -- start 2024-04-16T13:06:16.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.977+0000 7f9929a00640 1 -- start start 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.978+0000 7f9929a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99240cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.978+0000 7f9929a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99240cbd60 con 0x7f992415c510 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.978+0000 7f9929a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99240cc040 con 0x7f99240ceb70 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9929a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f99240cdae0 con 0x7f99240ccbd0 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9922a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f992415c510 0x7f99240cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41454/0 (socket says 172.21.15.67:41454) 2024-04-16T13:06:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9922a00640 1 -- 172.21.15.67:0/4289487430 learned_addr learned my addr 172.21.15.67:0/4289487430 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:16.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9923400640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99240cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264502922 0 0) 0x7f99240cbd60 con 0x7f992415c510 2024-04-16T13:06:16.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.979+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9908003520 con 0x7f992415c510 2024-04-16T13:06:16.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2363965706 0 0) 0x7f9908003520 con 0x7f992415c510 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 msgr2=0x7f99240cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99240cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 >> v1:172.21.15.82:6789/0 conn(0x7f99240ceb70 legacy=0x7f99240cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99240cd490 con 0x7f992415c510 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f9914001690 con 0x7f992415c510 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 >> v1:172.21.15.67:6789/0 conn(0x7f992415c510 legacy=0x7f99240cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9908003fb0 0x7f9908004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f99080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f99240cdae0 con 0x7f9908004d40 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f990800bb00 con 0x7f9908003fb0 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f990800bd00 con 0x7f99240ccbd0 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9923400640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f99080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.980+0000 7f9922000640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9908003fb0 0x7f9908004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9922a00640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9923400640 1 -- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 msgr2=0x7f99080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9923400640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99240ccbd0 0x7f99080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9923400640 1 -- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9908003fb0 msgr2=0x7f9908004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9923400640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9908003fb0 0x7f9908004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9923400640 1 -- 172.21.15.67:0/4289487430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9908003520 con 0x7f9908004d40 2024-04-16T13:06:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.981+0000 7f9922000640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9908003fb0 0x7f9908004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.982+0000 7f9923400640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f99080051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9924071d10 tx=0x7f9908005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f015824667ff292 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.982+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c039070 con 0x7f9908004d40 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.982+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c02cb90 con 0x7f9908004d40 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.982+0000 7f9921600640 1 -- 172.21.15.67:0/4289487430 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c009c10 con 0x7f9908004d40 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 -- 172.21.15.67:0/4289487430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 msgr2=0x7f99080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 --2- 172.21.15.67:0/4289487430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f99080051c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9924071d10 tx=0x7f9908005830 comp rx=0 tx=0).stop 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9923400640 1 -- 172.21.15.67:0/4289487430 reap_dead start 2024-04-16T13:06:16.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 -- 172.21.15.67:0/4289487430 shutdown_connections 2024-04-16T13:06:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 -- 172.21.15.67:0/4289487430 >> 172.21.15.67:0/4289487430 conn(0x7f9924067d90 msgr2=0x7f992406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 -- 172.21.15.67:0/4289487430 shutdown_connections 2024-04-16T13:06:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.983+0000 7f9929a00640 1 -- 172.21.15.67:0/4289487430 wait complete. 2024-04-16T13:06:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.985+0000 7f9929a00640 1 Processor -- start 2024-04-16T13:06:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.985+0000 7f9929a00640 1 -- start start 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992413bfa0 0x7f992413c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99241626f0 0x7f9924162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f99240ce680 con 0x7f9908004d40 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f992415c8f0 con 0x7f992413bfa0 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9929a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f99240cefe0 con 0x7f99241626f0 2024-04-16T13:06:16.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9922a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9922a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37388/0 (socket says 172.21.15.67:37388) 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.986+0000 7f9922a00640 1 -- 172.21.15.67:0/563961868 learned_addr learned my addr 172.21.15.67:0/563961868 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 -- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99241626f0 msgr2=0x7f9924162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99241626f0 0x7f9924162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 -- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992413bfa0 msgr2=0x7f992413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922000640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992413bfa0 0x7f992413c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992413bfa0 0x7f992413c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 -- 172.21.15.67:0/563961868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992413c920 con 0x7f9908004d40 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9922a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f991400e6e0 tx=0x7f991400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991400c6c0 con 0x7f9908004d40 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9914018070 con 0x7f9908004d40 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991400ca80 con 0x7f9908004d40 2024-04-16T13:06:16.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.987+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992413fb90 con 0x7f9908004d40 2024-04-16T13:06:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.988+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992413f0b0 con 0x7f9908004d40 2024-04-16T13:06:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.989+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9924068a70 con 0x7f9908004d40 2024-04-16T13:06:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.990+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f991400cc20 con 0x7f9908004d40 2024-04-16T13:06:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.991+0000 7f991aa00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.991+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f991408b470 con 0x7f9908004d40 2024-04-16T13:06:16.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.992+0000 7f9922000640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:16.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.993+0000 7f9922000640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 0x7f990006ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:16.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:16.996+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9914059af0 con 0x7f9908004d40 2024-04-16T13:06:17.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.279+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f99240b3590 con 0x7f9908004d40 2024-04-16T13:06:17.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.284+0000 7f991aa00640 1 -- 172.21.15.67:0/563961868 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f99140593f0 con 0x7f9908004d40 2024-04-16T13:06:17.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 msgr2=0x7f990006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 0x7f990006ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-04-16T13:06:17.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 msgr2=0x7f9924160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f991400e6e0 tx=0x7f991400eba0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 shutdown_connections 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f99241626f0 0x7f9924162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f992413bfa0 0x7f992413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 --2- 172.21.15.67:0/563961868 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9908004d40 0x7f9924160710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 >> 172.21.15.67:0/563961868 conn(0x7f9924067d90 msgr2=0x7f99240cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 shutdown_connections 2024-04-16T13:06:17.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.287+0000 7f9929a00640 1 -- 172.21.15.67:0/563961868 wait complete. 2024-04-16T13:06:17.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-16T13:06:17.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.528+0000 7fd67c400640 1 Processor -- start 2024-04-16T13:06:17.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.529+0000 7fd67c400640 1 -- start start 2024-04-16T13:06:17.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.530+0000 7fd67c400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd67415c860 0x7fd6740c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.530+0000 7fd67c400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6740b3700 0x7fd6740b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.530+0000 7fd67c400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6740cce80 con 0x7fd6740cc9f0 2024-04-16T13:06:17.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.530+0000 7fd67c400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fd6740b4070 con 0x7fd67415c860 2024-04-16T13:06:17.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.530+0000 7fd67c400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd6740c7710 con 0x7fd6740b3700 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd679000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd6740cc9f0 0x7fd674160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41468/0 (socket says 172.21.15.67:41468) 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd679000640 1 -- 172.21.15.67:0/3307380269 learned_addr learned my addr 172.21.15.67:0/3307380269 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd679a00640 1 --2- 172.21.15.67:0/3307380269 >> v2:172.21.15.67:3300/0 conn(0x7fd67415c860 0x7fd6740c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd67a400640 1 --2- 172.21.15.67:0/3307380269 >> v2:172.21.15.82:3300/0 conn(0x7fd6740b3700 0x7fd6740b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd673e00640 1 -- 172.21.15.67:0/3307380269 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668388012 0 0) 0x7fd6740cce80 con 0x7fd6740cc9f0 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.531+0000 7fd673e00640 1 -- 172.21.15.67:0/3307380269 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd65c003520 con 0x7fd6740cc9f0 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.532+0000 7fd679a00640 1 -- 172.21.15.67:0/3307380269 >> v2:172.21.15.82:3300/0 conn(0x7fd6740b3700 msgr2=0x7fd6740b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.532+0000 7fd679a00640 1 --2- 172.21.15.67:0/3307380269 >> v2:172.21.15.82:3300/0 conn(0x7fd6740b3700 0x7fd6740b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.532+0000 7fd679a00640 1 -- 172.21.15.67:0/3307380269 >> v1:172.21.15.67:6789/0 conn(0x7fd6740cc9f0 legacy=0x7fd674160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.532+0000 7fd679a00640 1 -- 172.21.15.67:0/3307380269 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740c6e70 con 0x7fd67415c860 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.533+0000 7fd679a00640 1 --2- 172.21.15.67:0/3307380269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6740c6890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd6740d0440 tx=0x7fd66802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86c957d3fe4e715 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.533+0000 7fd673e00640 1 -- 172.21.15.67:0/3307380269 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668035020 con 0x7fd67415c860 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.533+0000 7fd673e00640 1 -- 172.21.15.67:0/3307380269 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd668031830 con 0x7fd67415c860 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.533+0000 7fd673e00640 1 -- 172.21.15.67:0/3307380269 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668031be0 con 0x7fd67415c860 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 -- 172.21.15.67:0/3307380269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 msgr2=0x7fd6740c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 --2- 172.21.15.67:0/3307380269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6740c6890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd6740d0440 tx=0x7fd66802b8d0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 -- 172.21.15.67:0/3307380269 shutdown_connections 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 --2- 172.21.15.67:0/3307380269 >> v2:172.21.15.82:3300/0 conn(0x7fd6740b3700 0x7fd6740b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 --2- 172.21.15.67:0/3307380269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6740c6890 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 -- 172.21.15.67:0/3307380269 >> 172.21.15.67:0/3307380269 conn(0x7fd674067d90 msgr2=0x7fd67406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:17.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 -- 172.21.15.67:0/3307380269 shutdown_connections 2024-04-16T13:06:17.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.534+0000 7fd67c400640 1 -- 172.21.15.67:0/3307380269 wait complete. 2024-04-16T13:06:17.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.536+0000 7fd67c400640 1 Processor -- start 2024-04-16T13:06:17.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.536+0000 7fd67c400640 1 -- start start 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6740b3700 0x7fd6741f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6740cc9f0 0x7fd67415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741605c0 con 0x7fd67415c860 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740c7430 con 0x7fd6740cc9f0 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67c400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd67415cc40 con 0x7fd6740b3700 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37414/0 (socket says 172.21.15.67:37414) 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd67a400640 1 -- 172.21.15.67:0/3724591534 learned_addr learned my addr 172.21.15.67:0/3724591534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd679a00640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6740b3700 0x7fd6741f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.537+0000 7fd679000640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6740cc9f0 0x7fd67415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 -- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6740b3700 msgr2=0x7fd6741f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6740b3700 0x7fd6741f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 -- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6740cc9f0 msgr2=0x7fd67415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6740cc9f0 0x7fd67415ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 -- 172.21.15.67:0/3724591534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67415d5c0 con 0x7fd67415c860 2024-04-16T13:06:17.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67a400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd66c007e40 tx=0x7fd66c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c014620 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66c019070 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c014a20 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.538+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67415d8a0 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.539+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67415e860 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.540+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6740cc650 con 0x7fd67415c860 2024-04-16T13:06:17.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.541+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd66c014bc0 con 0x7fd67415c860 2024-04-16T13:06:17.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.542+0000 7fd671600640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:17.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.542+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd66c08c2b0 con 0x7fd67415c860 2024-04-16T13:06:17.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.542+0000 7fd679a00640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:17.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.543+0000 7fd679a00640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 0x7fd65406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd668036000 tx=0x7fd66803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:17.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.546+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6740cc650 con 0x7fd67415c860 2024-04-16T13:06:17.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.831+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd6740d00a0 con 0x7fd67415c860 2024-04-16T13:06:17.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.836+0000 7fd671600640 1 -- 172.21.15.67:0/3724591534 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fd6740d00a0 con 0x7fd67415c860 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.838+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 msgr2=0x7fd65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.838+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 0x7fd65406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd668036000 tx=0x7fd66803c040 comp rx=0 tx=0).stop 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.838+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 msgr2=0x7fd6741e6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.838+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd66c007e40 tx=0x7fd66c00e4b0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 shutdown_connections 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd67415c860 0x7fd6741e6a20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6740cc9f0 0x7fd67415ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 --2- 172.21.15.67:0/3724591534 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd6740b3700 0x7fd6741f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:17.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 >> 172.21.15.67:0/3724591534 conn(0x7fd674067d90 msgr2=0x7fd6740cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:17.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 shutdown_connections 2024-04-16T13:06:17.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:17.839+0000 7fd67c400640 1 -- 172.21.15.67:0/3724591534 wait complete. 2024-04-16T13:06:17.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-16T13:06:18.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.084+0000 7f1a3d000640 1 Processor -- start 2024-04-16T13:06:18.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.084+0000 7f1a3d000640 1 -- start start 2024-04-16T13:06:18.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.085+0000 7f1a3d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1a380ceee0 0x7f1a380cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.085+0000 7f1a3d000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a380d0510 0x7f1a380d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.085+0000 7f1a3d000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a380cfa30 con 0x7f1a3815c560 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.085+0000 7f1a3d000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380cfd10 con 0x7f1a380ceee0 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.085+0000 7f1a3d000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380cfff0 con 0x7f1a380d0510 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a37400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1a3815c560 0x7f1a38071d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41480/0 (socket says 172.21.15.67:41480) 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a37400640 1 -- 172.21.15.67:0/2106540410 learned_addr learned my addr 172.21.15.67:0/2106540410 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:18.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a36a00640 1 --2- 172.21.15.67:0/2106540410 >> v2:172.21.15.67:3300/0 conn(0x7f1a380ceee0 0x7f1a380cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a37e00640 1 --2- 172.21.15.67:0/2106540410 >> v2:172.21.15.82:3300/0 conn(0x7f1a380d0510 0x7f1a380d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a36a00640 1 -- 172.21.15.67:0/2106540410 >> v2:172.21.15.82:3300/0 conn(0x7f1a380d0510 msgr2=0x7f1a380d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a36a00640 1 --2- 172.21.15.67:0/2106540410 >> v2:172.21.15.82:3300/0 conn(0x7f1a380d0510 0x7f1a380d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.086+0000 7f1a36a00640 1 -- 172.21.15.67:0/2106540410 >> v1:172.21.15.67:6789/0 conn(0x7f1a3815c560 legacy=0x7f1a38071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.087+0000 7f1a36a00640 1 -- 172.21.15.67:0/2106540410 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3806e870 con 0x7f1a380ceee0 2024-04-16T13:06:18.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.087+0000 7f1a36000640 1 -- 172.21.15.67:0/2106540410 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614546656 0 0) 0x7f1a380cfa30 con 0x7f1a3815c560 2024-04-16T13:06:18.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.088+0000 7f1a36a00640 1 --2- 172.21.15.67:0/2106540410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380ceee0 0x7f1a380cf370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1a380ca8b0 tx=0x7f1a2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5d07dfa1edb09d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.088+0000 7f1a36000640 1 -- 172.21.15.67:0/2106540410 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24035020 con 0x7f1a380ceee0 2024-04-16T13:06:18.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.088+0000 7f1a36000640 1 -- 172.21.15.67:0/2106540410 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a24031830 con 0x7f1a380ceee0 2024-04-16T13:06:18.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.088+0000 7f1a36000640 1 -- 172.21.15.67:0/2106540410 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24031c00 con 0x7f1a380ceee0 2024-04-16T13:06:18.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 -- 172.21.15.67:0/2106540410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380ceee0 msgr2=0x7f1a380cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 --2- 172.21.15.67:0/2106540410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380ceee0 0x7f1a380cf370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1a380ca8b0 tx=0x7f1a2402b8d0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 -- 172.21.15.67:0/2106540410 shutdown_connections 2024-04-16T13:06:18.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 --2- 172.21.15.67:0/2106540410 >> v2:172.21.15.82:3300/0 conn(0x7f1a380d0510 0x7f1a380d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 --2- 172.21.15.67:0/2106540410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380ceee0 0x7f1a380cf370 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 -- 172.21.15.67:0/2106540410 >> 172.21.15.67:0/2106540410 conn(0x7f1a3806bc00 msgr2=0x7f1a3806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:18.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 -- 172.21.15.67:0/2106540410 shutdown_connections 2024-04-16T13:06:18.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.089+0000 7f1a3d000640 1 -- 172.21.15.67:0/2106540410 wait complete. 2024-04-16T13:06:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.091+0000 7f1a3d000640 1 Processor -- start 2024-04-16T13:06:18.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.091+0000 7f1a3d000640 1 -- start start 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a380ceee0 0x7f1a3814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a3815c560 0x7f1a380ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380b4340 con 0x7f1a380d0510 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3815c940 con 0x7f1a380ceee0 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a3d000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f1a380b44c0 con 0x7f1a3815c560 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a36a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a36a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37430/0 (socket says 172.21.15.67:37430) 2024-04-16T13:06:18.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.092+0000 7f1a36a00640 1 -- 172.21.15.67:0/3562362215 learned_addr learned my addr 172.21.15.67:0/3562362215 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a37400640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a380ceee0 0x7f1a3814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 -- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a3815c560 msgr2=0x7f1a380ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a3815c560 0x7f1a380ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 -- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a380ceee0 msgr2=0x7f1a3814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a380ceee0 0x7f1a3814d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 -- 172.21.15.67:0/3562362215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380cd880 con 0x7f1a380d0510 2024-04-16T13:06:18.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a36a00640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.093+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24035070 con 0x7f1a380d0510 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.094+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a24004250 con 0x7f1a380d0510 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.094+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2403a6f0 con 0x7f1a380d0510 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.094+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3814dde0 con 0x7f1a380d0510 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.094+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a380c8b10 con 0x7f1a380d0510 2024-04-16T13:06:18.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.095+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a38075bd0 con 0x7f1a380d0510 2024-04-16T13:06:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.096+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a24038020 con 0x7f1a380d0510 2024-04-16T13:06:18.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.097+0000 7f1a2f400640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 0x7f1a1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.097+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f1a240ad6d0 con 0x7f1a380d0510 2024-04-16T13:06:18.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.097+0000 7f1a37400640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 0x7f1a1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.098+0000 7f1a37400640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 0x7f1a1806edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a280012e0 tx=0x7f1a28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.101+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a24040070 con 0x7f1a380d0510 2024-04-16T13:06:18.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.380+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f1a38074010 con 0x7f1a380d0510 2024-04-16T13:06:18.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.385+0000 7f1a2f400640 1 -- 172.21.15.67:0/3562362215 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f1a2407bcb0 con 0x7f1a380d0510 2024-04-16T13:06:18.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 msgr2=0x7f1a1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 0x7f1a1806edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a280012e0 tx=0x7f1a28009040 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 msgr2=0x7f1a3814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a240046c0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 shutdown_connections 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f1a1806c8f0 0x7f1a1806edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1a3815c560 0x7f1a380ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a380d0510 0x7f1a3814e310 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 --2- 172.21.15.67:0/3562362215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a380ceee0 0x7f1a3814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 >> 172.21.15.67:0/3562362215 conn(0x7f1a3806bc00 msgr2=0x7f1a38158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 shutdown_connections 2024-04-16T13:06:18.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.388+0000 7f1a3d000640 1 -- 172.21.15.67:0/3562362215 wait complete. 2024-04-16T13:06:18.409 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-16T13:06:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.626+0000 7f387da00640 1 Processor -- start 2024-04-16T13:06:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.626+0000 7f387da00640 1 -- start start 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.627+0000 7f387da00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 0x7f3878160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.627+0000 7f387da00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38780cf230 0x7f38780cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.627+0000 7f387da00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 0x7f38780c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.627+0000 7f387da00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f38780cfbd0 con 0x7f38780cf230 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f387da00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3878161290 con 0x7f38780c5540 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f387da00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3878072210 con 0x7f3878145340 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38780cf230 0x7f38780cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38780cf230 0x7f38780cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37446/0 (socket says 172.21.15.67:37446) 2024-04-16T13:06:18.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 -- 172.21.15.67:0/2933161755 learned_addr learned my addr 172.21.15.67:0/2933161755 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f3876a00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 0x7f3878160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f3877400640 1 --2- 172.21.15.67:0/2933161755 >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 0x7f38780c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 -- 172.21.15.67:0/2933161755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 msgr2=0x7f3878160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 0x7f3878160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.628+0000 7f386fe00640 1 -- 172.21.15.67:0/2933161755 >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 msgr2=0x7f38780c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.629+0000 7f386fe00640 1 --2- 172.21.15.67:0/2933161755 >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 0x7f38780c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.629+0000 7f386fe00640 1 -- 172.21.15.67:0/2933161755 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38780724f0 con 0x7f38780cf230 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.629+0000 7f3876a00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 0x7f3878160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.629+0000 7f3877400640 1 --2- 172.21.15.67:0/2933161755 >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 0x7f38780c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.630+0000 7f386fe00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38780cf230 0x7f38780cf690 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3878070030 tx=0x7f386002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9af07a2dd8a251 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.630+0000 7f3876000640 1 -- 172.21.15.67:0/2933161755 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860035020 con 0x7f38780cf230 2024-04-16T13:06:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.630+0000 7f3876000640 1 -- 172.21.15.67:0/2933161755 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860031880 con 0x7f38780cf230 2024-04-16T13:06:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.630+0000 7f3876000640 1 -- 172.21.15.67:0/2933161755 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860031c50 con 0x7f38780cf230 2024-04-16T13:06:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 -- 172.21.15.67:0/2933161755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38780cf230 msgr2=0x7f38780cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38780cf230 0x7f38780cf690 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3878070030 tx=0x7f386002b920 comp rx=0 tx=0).stop 2024-04-16T13:06:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 -- 172.21.15.67:0/2933161755 shutdown_connections 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 --2- 172.21.15.67:0/2933161755 >> v2:172.21.15.82:3300/0 conn(0x7f38780c5540 0x7f38780c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38780cf230 0x7f38780cf690 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 --2- 172.21.15.67:0/2933161755 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3878145340 0x7f3878160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 -- 172.21.15.67:0/2933161755 >> 172.21.15.67:0/2933161755 conn(0x7f387806c050 msgr2=0x7f38780b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 -- 172.21.15.67:0/2933161755 shutdown_connections 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.631+0000 7f387da00640 1 -- 172.21.15.67:0/2933161755 wait complete. 2024-04-16T13:06:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.633+0000 7f387da00640 1 Processor -- start 2024-04-16T13:06:18.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.633+0000 7f387da00640 1 -- start start 2024-04-16T13:06:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38780c5540 0x7f387815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38780cf230 0x7f38781f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3878072d90 con 0x7f3878145340 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3878072ab0 con 0x7f38780c5540 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f387da00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3878071ea0 con 0x7f38780cf230 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f3877400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f3877400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37462/0 (socket says 172.21.15.67:37462) 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f3877400640 1 -- 172.21.15.67:0/4111363522 learned_addr learned my addr 172.21.15.67:0/4111363522 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f386fe00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38780cf230 0x7f38781f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.634+0000 7f3876a00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38780c5540 0x7f387815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 -- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38780cf230 msgr2=0x7f38781f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38780cf230 0x7f38781f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 -- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38780c5540 msgr2=0x7f387815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38780c5540 0x7f387815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 -- 172.21.15.67:0/4111363522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38781f56f0 con 0x7f3878145340 2024-04-16T13:06:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f3877400640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f387000cd10 tx=0x7f387000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387000f680 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387000f840 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387000fc30 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38781f59d0 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.635+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38780cd4a0 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.637+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878068a70 con 0x7f3878145340 2024-04-16T13:06:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.638+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f387000e3e0 con 0x7f3878145340 2024-04-16T13:06:18.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.639+0000 7f386ea00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:18.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.639+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f387008c710 con 0x7f3878145340 2024-04-16T13:06:18.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.639+0000 7f3876a00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:18.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.640+0000 7f3876a00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 0x7f385406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f386800a990 tx=0x7f3868008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:18.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.643+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3870014030 con 0x7f3878145340 2024-04-16T13:06:18.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.917+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f38780cff70 con 0x7f3878145340 2024-04-16T13:06:18.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.922+0000 7f386ea00640 1 -- 172.21.15.67:0/4111363522 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f387005ad00 con 0x7f3878145340 2024-04-16T13:06:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 msgr2=0x7f385406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 0x7f385406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f386800a990 tx=0x7f3868008040 comp rx=0 tx=0).stop 2024-04-16T13:06:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 msgr2=0x7f38780cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f387000cd10 tx=0x7f387000a650 comp rx=0 tx=0).stop 2024-04-16T13:06:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 shutdown_connections 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f385406c8f0 0x7f385406edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3878145340 0x7f38780cd9c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f38780cf230 0x7f38781f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 --2- 172.21.15.67:0/4111363522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38780c5540 0x7f387815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 >> 172.21.15.67:0/4111363522 conn(0x7f387806c050 msgr2=0x7f38781418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 shutdown_connections 2024-04-16T13:06:18.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:18.925+0000 7f387da00640 1 -- 172.21.15.67:0/4111363522 wait complete. 2024-04-16T13:06:18.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-16T13:06:19.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.168+0000 7f34c8a00640 1 Processor -- start 2024-04-16T13:06:19.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.168+0000 7f34c8a00640 1 -- start start 2024-04-16T13:06:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40724f0 0x7f34c406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34c415cdc0 0x7f34c415d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c8a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c406dec0 con 0x7f34c40ce990 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c8a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f34c406e7f0 con 0x7f34c415cdc0 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34c406e1a0 con 0x7f34c40724f0 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34c415cdc0 0x7f34c415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f34c415cdc0 0x7f34c415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37472/0 (socket says 172.21.15.67:37472) 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.170+0000 7f34c3200640 1 -- 172.21.15.67:0/2186264211 learned_addr learned my addr 172.21.15.67:0/2186264211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.171+0000 7f34b9e00640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40724f0 0x7f34c406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.171+0000 7f34c3200640 1 -- 172.21.15.67:0/2186264211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40724f0 msgr2=0x7f34c406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.171+0000 7f34c3200640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40724f0 0x7f34c406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.171+0000 7f34c3200640 1 -- 172.21.15.67:0/2186264211 >> v1:172.21.15.82:6789/0 conn(0x7f34c40ce990 legacy=0x7f34c4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:19.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.171+0000 7f34c3200640 1 -- 172.21.15.67:0/2186264211 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c406e480 con 0x7f34c415cdc0 2024-04-16T13:06:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.172+0000 7f34c3200640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c415cdc0 0x7f34c415d250 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009e50 tx=0x7f34bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2fa088f0ecec4d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.172+0000 7f34c1e00640 1 -- 172.21.15.67:0/2186264211 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc02ca70 con 0x7f34c415cdc0 2024-04-16T13:06:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.172+0000 7f34c1e00640 1 -- 172.21.15.67:0/2186264211 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc02cc10 con 0x7f34c415cdc0 2024-04-16T13:06:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.172+0000 7f34c1e00640 1 -- 172.21.15.67:0/2186264211 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0343f0 con 0x7f34c415cdc0 2024-04-16T13:06:19.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 -- 172.21.15.67:0/2186264211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c415cdc0 msgr2=0x7f34c415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c415cdc0 0x7f34c415d250 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009e50 tx=0x7f34bc02bed0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 -- 172.21.15.67:0/2186264211 shutdown_connections 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c415cdc0 0x7f34c415d250 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2186264211 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40724f0 0x7f34c406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 -- 172.21.15.67:0/2186264211 >> 172.21.15.67:0/2186264211 conn(0x7f34c4067d90 msgr2=0x7f34c406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 -- 172.21.15.67:0/2186264211 shutdown_connections 2024-04-16T13:06:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.173+0000 7f34c8a00640 1 -- 172.21.15.67:0/2186264211 wait complete. 2024-04-16T13:06:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.175+0000 7f34c8a00640 1 Processor -- start 2024-04-16T13:06:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.175+0000 7f34c8a00640 1 -- start start 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 0x7f34c4157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34c415cdc0 0x7f34c415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34c415d790 con 0x7f34c40724f0 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34c415db10 con 0x7f34c415cdc0 2024-04-16T13:06:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34c415ddc0 con 0x7f34c40ce990 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37482/0 (socket says 172.21.15.67:37482) 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.176+0000 7f34c2800640 1 -- 172.21.15.67:0/2099488669 learned_addr learned my addr 172.21.15.67:0/2099488669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c3200640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34c415cdc0 0x7f34c415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34b9e00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 0x7f34c4157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 -- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 msgr2=0x7f34c4157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 0x7f34c4157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 -- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34c415cdc0 msgr2=0x7f34c415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34c415cdc0 0x7f34c415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 -- 172.21.15.67:0/2099488669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c4145870 con 0x7f34c40724f0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34b9e00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 0x7f34c4157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c2800640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c430 tx=0x7f34b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40052d0 con 0x7f34c40724f0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4005490 con 0x7f34c40724f0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4007260 con 0x7f34c40724f0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.177+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c41556d0 con 0x7f34c40724f0 2024-04-16T13:06:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.178+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c4157ea0 con 0x7f34c40724f0 2024-04-16T13:06:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.179+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c4075bd0 con 0x7f34c40724f0 2024-04-16T13:06:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.180+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34b4007400 con 0x7f34c40724f0 2024-04-16T13:06:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.180+0000 7f34bb400640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 0x7f34a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.181+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f34b408aff0 con 0x7f34c40724f0 2024-04-16T13:06:19.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.181+0000 7f34b9e00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 0x7f34a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.182+0000 7f34b9e00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 0x7f34a006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34c41530f0 tx=0x7f34ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.185+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34c4145870 con 0x7f34c40724f0 2024-04-16T13:06:19.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.469+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f34c415e290 con 0x7f34c40724f0 2024-04-16T13:06:19.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.474+0000 7f34bb400640 1 -- 172.21.15.67:0/2099488669 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v8) ==== 97+0+0 (secure 0 0 0) 0x7f34b40594d0 con 0x7f34c40724f0 2024-04-16T13:06:19.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 msgr2=0x7f34a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 0x7f34a006edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34c41530f0 tx=0x7f34ac008040 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 msgr2=0x7f34c4155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c430 tx=0x7f34b400c8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 shutdown_connections 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f34a006c8f0 0x7f34a006edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34c415cdc0 0x7f34c415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34c40ce990 0x7f34c4157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 --2- 172.21.15.67:0/2099488669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34c40724f0 0x7f34c4155190 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 >> 172.21.15.67:0/2099488669 conn(0x7f34c4067d90 msgr2=0x7f34c40b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 shutdown_connections 2024-04-16T13:06:19.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.477+0000 7f34c8a00640 1 -- 172.21.15.67:0/2099488669 wait complete. 2024-04-16T13:06:19.496 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-16T13:06:19.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.716+0000 7f5fc1a00640 1 Processor -- start 2024-04-16T13:06:19.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.716+0000 7f5fc1a00640 1 -- start start 2024-04-16T13:06:19.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.718+0000 7f5fc1a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.718+0000 7f5fc1a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5fbc15cdc0 0x7f5fbc15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.718+0000 7f5fc1a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc06dec0 con 0x7f5fbc0ce990 2024-04-16T13:06:19.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.718+0000 7f5fc1a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5fbc06e7f0 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.718+0000 7f5fc1a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5fbc06e1a0 con 0x7f5fbc0724f0 2024-04-16T13:06:19.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.719+0000 7f5fbb400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.719+0000 7f5fbb400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:44338/0 (socket says 172.21.15.67:44338) 2024-04-16T13:06:19.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.719+0000 7f5fbb400640 1 -- 172.21.15.67:0/2684814820 learned_addr learned my addr 172.21.15.67:0/2684814820 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:19.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.719+0000 7f5fc1000640 1 --2- 172.21.15.67:0/2684814820 >> v2:172.21.15.82:3300/0 conn(0x7f5fbc15cdc0 0x7f5fbc15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbaa00640 1 -- 172.21.15.67:0/2684814820 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286966147 0 0) 0x7f5fbc06dec0 con 0x7f5fbc0ce990 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbaa00640 1 -- 172.21.15.67:0/2684814820 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fa0003520 con 0x7f5fbc0ce990 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbb400640 1 -- 172.21.15.67:0/2684814820 >> v2:172.21.15.82:3300/0 conn(0x7f5fbc15cdc0 msgr2=0x7f5fbc15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbb400640 1 --2- 172.21.15.67:0/2684814820 >> v2:172.21.15.82:3300/0 conn(0x7f5fbc15cdc0 0x7f5fbc15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbb400640 1 -- 172.21.15.67:0/2684814820 >> v1:172.21.15.82:6789/0 conn(0x7f5fbc0ce990 legacy=0x7f5fbc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.720+0000 7f5fbb400640 1 -- 172.21.15.67:0/2684814820 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc06e480 con 0x7f5fbc0724f0 2024-04-16T13:06:19.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.721+0000 7f5fbb400640 1 --2- 172.21.15.67:0/2684814820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009870 tx=0x7f5fa402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64d93a264fca341 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fbaa00640 1 -- 172.21.15.67:0/2684814820 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4035020 con 0x7f5fbc0724f0 2024-04-16T13:06:19.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fbaa00640 1 -- 172.21.15.67:0/2684814820 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa4031640 con 0x7f5fbc0724f0 2024-04-16T13:06:19.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fbaa00640 1 -- 172.21.15.67:0/2684814820 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa402d040 con 0x7f5fbc0724f0 2024-04-16T13:06:19.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 -- 172.21.15.67:0/2684814820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 msgr2=0x7f5fbc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/2684814820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009870 tx=0x7f5fa402b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 -- 172.21.15.67:0/2684814820 shutdown_connections 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/2684814820 >> v2:172.21.15.82:3300/0 conn(0x7f5fbc15cdc0 0x7f5fbc15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/2684814820 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0724f0 0x7f5fbc06ec80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.722+0000 7f5fc1a00640 1 -- 172.21.15.67:0/2684814820 >> 172.21.15.67:0/2684814820 conn(0x7f5fbc067d90 msgr2=0x7f5fbc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.723+0000 7f5fc1a00640 1 -- 172.21.15.67:0/2684814820 shutdown_connections 2024-04-16T13:06:19.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.723+0000 7f5fc1a00640 1 -- 172.21.15.67:0/2684814820 wait complete. 2024-04-16T13:06:19.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.724+0000 7f5fc1a00640 1 Processor -- start 2024-04-16T13:06:19.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.724+0000 7f5fc1a00640 1 -- start start 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fbc0724f0 0x7f5fbc145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0ce990 0x7f5fbc149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc15d790 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc15db10 con 0x7f5fbc0724f0 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.725+0000 7f5fc1a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5fbc15ddc0 con 0x7f5fbc0ce990 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37492/0 (socket says 172.21.15.67:37492) 2024-04-16T13:06:19.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 -- 172.21.15.67:0/1789464136 learned_addr learned my addr 172.21.15.67:0/1789464136 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fbb400640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0ce990 0x7f5fbc149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fbbe00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fbc0724f0 0x7f5fbc145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 -- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0ce990 msgr2=0x7f5fbc149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0ce990 0x7f5fbc149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 -- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fbc0724f0 msgr2=0x7f5fbc145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fbc0724f0 0x7f5fbc145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:19.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.726+0000 7f5fc1000640 1 -- 172.21.15.67:0/1789464136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc1461c0 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fc1000640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009d30 tx=0x7f5fb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4018020 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb4014480 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4014870 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc1464a0 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.727+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc146a60 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.728+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc075bd0 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.729+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fb4005d10 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.731+0000 7f5fb3e00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 0x7f5f9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.731+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f5fb408c440 con 0x7f5fbc15cdc0 2024-04-16T13:06:19.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.731+0000 7f5fbbe00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 0x7f5f9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:19.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.733+0000 7f5fbbe00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 0x7f5f9806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fac001650 tx=0x7f5fac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:19.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:19.735+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fb4022070 con 0x7f5fbc15cdc0 2024-04-16T13:06:20.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.012+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f5fbc159a60 con 0x7f5fbc15cdc0 2024-04-16T13:06:20.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.016+0000 7f5fb3e00640 1 -- 172.21.15.67:0/1789464136 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f5fb4010040 con 0x7f5fbc15cdc0 2024-04-16T13:06:20.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.018+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 msgr2=0x7f5f9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.018+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 0x7f5f9806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fac001650 tx=0x7f5fac009040 comp rx=0 tx=0).stop 2024-04-16T13:06:20.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 msgr2=0x7f5fbc1f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009d30 tx=0x7f5fb400c490 comp rx=0 tx=0).stop 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 shutdown_connections 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5f9806c8f0 0x7f5f9806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5fbc15cdc0 0x7f5fbc1f5400 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5fbc0ce990 0x7f5fbc149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 --2- 172.21.15.67:0/1789464136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fbc0724f0 0x7f5fbc145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 >> 172.21.15.67:0/1789464136 conn(0x7f5fbc067d90 msgr2=0x7f5fbc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 shutdown_connections 2024-04-16T13:06:20.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.019+0000 7f5fc1a00640 1 -- 172.21.15.67:0/1789464136 wait complete. 2024-04-16T13:06:20.040 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:20.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.263+0000 7f82a9a00640 1 Processor -- start 2024-04-16T13:06:20.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.264+0000 7f82a9a00640 1 -- start start 2024-04-16T13:06:20.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a9a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f82a40cec90 0x7f82a415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a9a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a406dd50 con 0x7f82a4071e50 2024-04-16T13:06:20.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a9a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a415d4e0 con 0x7f82a4146150 2024-04-16T13:06:20.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a9a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f82a415d7c0 con 0x7f82a40cec90 2024-04-16T13:06:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a3400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f82a4071e50 0x7f82a406e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41496/0 (socket says 172.21.15.67:41496) 2024-04-16T13:06:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.265+0000 7f82a3400640 1 -- 172.21.15.67:0/3604332502 learned_addr learned my addr 172.21.15.67:0/3604332502 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a2000640 1 --2- 172.21.15.67:0/3604332502 >> v2:172.21.15.82:3300/0 conn(0x7f82a40cec90 0x7f82a415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472180117 0 0) 0x7f82a406dd50 con 0x7f82a4071e50 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284003520 con 0x7f82a4071e50 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750462803 0 0) 0x7f8284003520 con 0x7f82a4071e50 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 >> v2:172.21.15.82:3300/0 conn(0x7f82a40cec90 msgr2=0x7f82a415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 --2- 172.21.15.67:0/3604332502 >> v2:172.21.15.82:3300/0 conn(0x7f82a40cec90 0x7f82a415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 >> v1:172.21.15.82:6789/0 conn(0x7f82a4146150 legacy=0x7f82a415cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a415daa0 con 0x7f82a4071e50 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f829c0019f0 con 0x7f82a4071e50 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 >> v1:172.21.15.67:6789/0 conn(0x7f82a4071e50 legacy=0x7f82a406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.266+0000 7f82a1600640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f828400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82a415d7c0 con 0x7f82840052e0 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f828400c1b0 con 0x7f8284004800 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f828400c3b0 con 0x7f82840039b0 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f828400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a2a00640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 -- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82840039b0 msgr2=0x7f8284003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a2000640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 -- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284004800 msgr2=0x7f8284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.267+0000 7f82a3400640 1 -- 172.21.15.67:0/3604332502 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284003520 con 0x7f82840052e0 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.268+0000 7f82a3400640 1 -- 172.21.15.67:0/3604332502 reap_dead start 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.268+0000 7f82a3400640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f828400b9c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f829c00a810 tx=0x7f8284005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ca75cadecd51fe server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.269+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c00a460 con 0x7f82840052e0 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.269+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c034650 con 0x7f82840052e0 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.269+0000 7f82a1600640 1 -- 172.21.15.67:0/3604332502 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c034a40 con 0x7f82840052e0 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.269+0000 7f82a9a00640 1 -- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 msgr2=0x7f828400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.269+0000 7f82a9a00640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f828400b9c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f829c00a810 tx=0x7f8284005830 comp rx=0 tx=0).stop 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.270+0000 7f82a9a00640 1 -- 172.21.15.67:0/3604332502 shutdown_connections 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.270+0000 7f82a9a00640 1 --2- 172.21.15.67:0/3604332502 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f828400b9c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.270+0000 7f82a9a00640 1 -- 172.21.15.67:0/3604332502 >> 172.21.15.67:0/3604332502 conn(0x7f82a40b2210 msgr2=0x7f82a40b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.270+0000 7f82a9a00640 1 -- 172.21.15.67:0/3604332502 shutdown_connections 2024-04-16T13:06:20.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.270+0000 7f82a9a00640 1 -- 172.21.15.67:0/3604332502 wait complete. 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.271+0000 7f82a9a00640 1 Processor -- start 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.272+0000 7f82a9a00640 1 -- start start 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82a40c9890 0x7f82a41441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82a4144700 0x7f82a40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f82a4072630 con 0x7f82840052e0 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40724b0 con 0x7f82a40c9890 2024-04-16T13:06:20.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a9a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f82a40727b0 con 0x7f82a4144700 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37506/0 (socket says 172.21.15.67:37506) 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 -- 172.21.15.67:0/4176839124 learned_addr learned my addr 172.21.15.67:0/4176839124 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 -- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82a4144700 msgr2=0x7f82a40cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82a4144700 0x7f82a40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 -- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82a40c9890 msgr2=0x7f82a41441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82a40c9890 0x7f82a41441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.273+0000 7f82a2a00640 1 -- 172.21.15.67:0/4176839124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a40b3740 con 0x7f82840052e0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f82a2a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f829400e4b0 tx=0x7f829400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940052e0 con 0x7f82840052e0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8294018070 con 0x7f82840052e0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a40b3a20 con 0x7f82840052e0 2024-04-16T13:06:20.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294003830 con 0x7f82840052e0 2024-04-16T13:06:20.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.274+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a40b3fe0 con 0x7f82840052e0 2024-04-16T13:06:20.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.275+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a4144b20 con 0x7f82840052e0 2024-04-16T13:06:20.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.276+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82940039d0 con 0x7f82840052e0 2024-04-16T13:06:20.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.277+0000 7f829aa00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 0x7f828006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.277+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f829408b600 con 0x7f82840052e0 2024-04-16T13:06:20.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.278+0000 7f82a2000640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 0x7f828006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.279+0000 7f82a2000640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 0x7f828006edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82a4144d70 tx=0x7f828c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.281+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8294059be0 con 0x7f82840052e0 2024-04-16T13:06:20.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.491+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82a40d0240 con 0x7f82840052e0 2024-04-16T13:06:20.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.493+0000 7f829aa00640 1 -- 172.21.15.67:0/4176839124 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13068 (secure 0 0 0) 0x7f82940594e0 con 0x7f82840052e0 2024-04-16T13:06:20.494 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:20.494 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":35,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:06:16.209309+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 msgr2=0x7f828006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 0x7f828006edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82a4144d70 tx=0x7f828c008040 comp rx=0 tx=0).stop 2024-04-16T13:06:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 msgr2=0x7f82a40b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f829400e4b0 tx=0x7f829400e970 comp rx=0 tx=0).stop 2024-04-16T13:06:20.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 shutdown_connections 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f828006c8f0 0x7f828006edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f82a4144700 0x7f82a40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82a40c9890 0x7f82a41441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 --2- 172.21.15.67:0/4176839124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f82840052e0 0x7f82a40b4fe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 >> 172.21.15.67:0/4176839124 conn(0x7f82a40b2210 msgr2=0x7f82a40b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 shutdown_connections 2024-04-16T13:06:20.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.496+0000 7f82a9a00640 1 -- 172.21.15.67:0/4176839124 wait complete. 2024-04-16T13:06:20.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T13:04:34.521995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T13:06:20.517 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T13:06:20.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.743+0000 7f020e800640 1 Processor -- start 2024-04-16T13:06:20.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.744+0000 7f020e800640 1 -- start start 2024-04-16T13:06:20.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.745+0000 7f020e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f02081696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.745+0000 7f020e800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02080d0660 con 0x7f020815e650 2024-04-16T13:06:20.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.745+0000 7f020e800640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02080d2650 con 0x7f02080d21c0 2024-04-16T13:06:20.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.745+0000 7f020e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f02080d2930 con 0x7f02080d1680 2024-04-16T13:06:20.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.746+0000 7f020d400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f020815e650 0x7f02080cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41510/0 (socket says 172.21.15.67:41510) 2024-04-16T13:06:20.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.746+0000 7f020d400640 1 -- 172.21.15.67:0/3923190964 learned_addr learned my addr 172.21.15.67:0/3923190964 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.746+0000 7f020de00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f02081696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.746+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875221830 0 0) 0x7f02080d0660 con 0x7f020815e650 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.746+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01f0003520 con 0x7f020815e650 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 47140282 0 0) 0x7f01f0003520 con 0x7f020815e650 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 msgr2=0x7f02081696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f02081696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 >> v1:172.21.15.82:6789/0 conn(0x7f02080d21c0 legacy=0x7f02080d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02080d2c10 con 0x7f020815e650 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f01fc001690 con 0x7f020815e650 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 >> v1:172.21.15.67:6789/0 conn(0x7f020815e650 legacy=0x7f02080cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f0003ac0 0x7f01f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f0004800 0x7f01f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f01f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02080d2930 con 0x7f01f0004800 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01f000bb20 con 0x7f01f0003ac0 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f01f000bd20 con 0x7f02080d1680 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.747+0000 7f020ca00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f0004800 0x7f01f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020de00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f01f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020ca00640 1 -- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 msgr2=0x7f01f0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020ca00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080d1680 0x7f01f0005200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020ca00640 1 -- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f0003ac0 msgr2=0x7f01f0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020ca00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f0003ac0 0x7f01f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.748+0000 7f020ca00640 1 -- 172.21.15.67:0/3923190964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0003520 con 0x7f01f0004800 2024-04-16T13:06:20.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f020ca00640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f0004800 0x7f01f0004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01f40018b0 tx=0x7f01f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c83c7f7ad6c1497 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4038070 con 0x7f01f0004800 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4033650 con 0x7f01f0004800 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f0207e00640 1 -- 172.21.15.67:0/3923190964 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f402f050 con 0x7f01f0004800 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f020e800640 1 -- 172.21.15.67:0/3923190964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f0004800 msgr2=0x7f01f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f020e800640 1 --2- 172.21.15.67:0/3923190964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f0004800 0x7f01f0004c80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01f40018b0 tx=0x7f01f0005830 comp rx=0 tx=0).stop 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.749+0000 7f020de00640 1 -- 172.21.15.67:0/3923190964 reap_dead start 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.750+0000 7f020e800640 1 -- 172.21.15.67:0/3923190964 shutdown_connections 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.750+0000 7f020e800640 1 -- 172.21.15.67:0/3923190964 >> 172.21.15.67:0/3923190964 conn(0x7f020808c000 msgr2=0x7f02080d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.750+0000 7f020e800640 1 -- 172.21.15.67:0/3923190964 shutdown_connections 2024-04-16T13:06:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.750+0000 7f020e800640 1 -- 172.21.15.67:0/3923190964 wait complete. 2024-04-16T13:06:20.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.752+0000 7f020e800640 1 Processor -- start 2024-04-16T13:06:20.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.752+0000 7f020e800640 1 -- start start 2024-04-16T13:06:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02081593a0 0x7f02081574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080cdf60 0x7f020815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02080d36f0 con 0x7f020815bff0 2024-04-16T13:06:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02080d31d0 con 0x7f02081593a0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f020815ea30 con 0x7f02080cdf60 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37520/0 (socket says 172.21.15.67:37520) 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 -- 172.21.15.67:0/2306836514 learned_addr learned my addr 172.21.15.67:0/2306836514 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020ca00640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080cdf60 0x7f020815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 -- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080cdf60 msgr2=0x7f020815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080cdf60 0x7f020815bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 -- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02081593a0 msgr2=0x7f02081574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02081593a0 0x7f02081574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.753+0000 7f020de00640 1 -- 172.21.15.67:0/2306836514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02080cd380 con 0x7f020815bff0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f020de00640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f020806c4e0 tx=0x7f020000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020001c070 con 0x7f020815bff0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0200017400 con 0x7f020815bff0 2024-04-16T13:06:20.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02000177f0 con 0x7f020815bff0 2024-04-16T13:06:20.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02080cd660 con 0x7f020815bff0 2024-04-16T13:06:20.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.754+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02080b7e00 con 0x7f020815bff0 2024-04-16T13:06:20.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.756+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02080b7c20 con 0x7f020815bff0 2024-04-16T13:06:20.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.757+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f020001f070 con 0x7f020815bff0 2024-04-16T13:06:20.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.758+0000 7f0205600640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.758+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f020008bac0 con 0x7f020815bff0 2024-04-16T13:06:20.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.758+0000 7f020d400640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:20.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.759+0000 7f020d400640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 0x7f01e806edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0018c0 tx=0x7f01fc001430 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:20.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.762+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02080b7c20 con 0x7f020815bff0 2024-04-16T13:06:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.967+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02080ce860 con 0x7f020815bff0 2024-04-16T13:06:20.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.967+0000 7f0205600640 1 -- 172.21.15.67:0/2306836514 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f02080ce860 con 0x7f020815bff0 2024-04-16T13:06:20.969 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-04-16T13:06:20.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 msgr2=0x7f01e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 0x7f01e806edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0018c0 tx=0x7f01fc001430 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 msgr2=0x7f02080b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f020806c4e0 tx=0x7f020000f4a0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 shutdown_connections 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f01e806c8f0 0x7f01e806edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f020815bff0 0x7f02080b8600 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f02080cdf60 0x7f020815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 --2- 172.21.15.67:0/2306836514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02081593a0 0x7f02081574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 >> 172.21.15.67:0/2306836514 conn(0x7f020808c000 msgr2=0x7f02080b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 shutdown_connections 2024-04-16T13:06:20.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:20.970+0000 7f020e800640 1 -- 172.21.15.67:0/2306836514 wait complete. 2024-04-16T13:06:20.992 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-16T13:06:21.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.213+0000 7f95b5400640 1 Processor -- start 2024-04-16T13:06:21.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.213+0000 7f95b5400640 1 -- start start 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95b5400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b0072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95b5400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95b0160ba0 0x7f95b0161030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95b5400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b0072770 con 0x7f95b00aee70 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95b5400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f95b00afbe0 con 0x7f95b0160ba0 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95b5400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f95b00afec0 con 0x7f95b0071e50 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.215+0000 7f95af200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95b0160ba0 0x7f95b0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95b0160ba0 0x7f95b0161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37536/0 (socket says 172.21.15.67:37536) 2024-04-16T13:06:21.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 -- 172.21.15.67:0/4044699539 learned_addr learned my addr 172.21.15.67:0/4044699539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95ae800640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b0072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 -- 172.21.15.67:0/4044699539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 msgr2=0x7f95b0072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b0072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 -- 172.21.15.67:0/4044699539 >> v1:172.21.15.82:6789/0 conn(0x7f95b00aee70 legacy=0x7f95b00af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.216+0000 7f95af200640 1 -- 172.21.15.67:0/4044699539 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b01600c0 con 0x7f95b0160ba0 2024-04-16T13:06:21.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.217+0000 7f95af200640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b0161030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794d29f70cc94b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.217+0000 7f95ade00640 1 -- 172.21.15.67:0/4044699539 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a802ca70 con 0x7f95b0160ba0 2024-04-16T13:06:21.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.217+0000 7f95ade00640 1 -- 172.21.15.67:0/4044699539 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a802cc10 con 0x7f95b0160ba0 2024-04-16T13:06:21.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95ade00640 1 -- 172.21.15.67:0/4044699539 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a80343f0 con 0x7f95b0160ba0 2024-04-16T13:06:21.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 -- 172.21.15.67:0/4044699539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 msgr2=0x7f95b0161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b0161030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a802bed0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 -- 172.21.15.67:0/4044699539 shutdown_connections 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b0161030 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 --2- 172.21.15.67:0/4044699539 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b0072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.218+0000 7f95b5400640 1 -- 172.21.15.67:0/4044699539 >> 172.21.15.67:0/4044699539 conn(0x7f95b00b2210 msgr2=0x7f95b00b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.219+0000 7f95b5400640 1 -- 172.21.15.67:0/4044699539 shutdown_connections 2024-04-16T13:06:21.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.219+0000 7f95b5400640 1 -- 172.21.15.67:0/4044699539 wait complete. 2024-04-16T13:06:21.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.220+0000 7f95b5400640 1 Processor -- start 2024-04-16T13:06:21.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.220+0000 7f95b5400640 1 -- start start 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b00ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 0x7f95b014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0145310 con 0x7f95b0160ba0 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0145190 con 0x7f95b00aee70 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.221+0000 7f95b5400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f95b0161570 con 0x7f95b0071e50 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37538/0 (socket says 172.21.15.67:37538) 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 -- 172.21.15.67:0/3896749588 learned_addr learned my addr 172.21.15.67:0/3896749588 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95a5e00640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 0x7f95b014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95ae800640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b00ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 -- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 msgr2=0x7f95b00ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b00ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 -- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 msgr2=0x7f95b014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 0x7f95b014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95af200640 1 -- 172.21.15.67:0/3896749588 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0150290 con 0x7f95b0160ba0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.222+0000 7f95a5e00640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 0x7f95b014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95af200640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8043020 con 0x7f95b0160ba0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a803e450 con 0x7f95b0160ba0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8009510 con 0x7f95b0160ba0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b0150570 con 0x7f95b0160ba0 2024-04-16T13:06:21.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.223+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b0150b30 con 0x7f95b0160ba0 2024-04-16T13:06:21.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.224+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b0075bd0 con 0x7f95b0160ba0 2024-04-16T13:06:21.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.227+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95a8046020 con 0x7f95b0160ba0 2024-04-16T13:06:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.227+0000 7f95a7400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 0x7f958c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.228+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f95a80ae620 con 0x7f95b0160ba0 2024-04-16T13:06:21.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.228+0000 7f95ae800640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 0x7f958c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.230+0000 7f95ae800640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 0x7f958c06ede0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95a0006fd0 tx=0x7f95a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.231+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95a804d070 con 0x7f95b0160ba0 2024-04-16T13:06:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.442+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f95b006ce30 con 0x7f95b0160ba0 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.443+0000 7f95a7400640 1 -- 172.21.15.67:0/3896749588 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f95a807ccf0 con 0x7f95b0160ba0 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-04-16T13:06:21.445 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.445+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 msgr2=0x7f958c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.445+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 0x7f958c06ede0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95a0006fd0 tx=0x7f95a0008040 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.445+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 msgr2=0x7f95b00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.445+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009e50 tx=0x7f95a8004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 shutdown_connections 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f958c06c920 0x7f958c06ede0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95b0160ba0 0x7f95b00b3490 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95b00aee70 0x7f95b014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 --2- 172.21.15.67:0/3896749588 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f95b0071e50 0x7f95b00ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 >> 172.21.15.67:0/3896749588 conn(0x7f95b00b2210 msgr2=0x7f95b006dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 shutdown_connections 2024-04-16T13:06:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.446+0000 7f95b5400640 1 -- 172.21.15.67:0/3896749588 wait complete. 2024-04-16T13:06:21.468 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-16T13:06:21.468 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-16T13:06:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.692+0000 7fb053200640 1 Processor -- start 2024-04-16T13:06:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.693+0000 7fb053200640 1 -- start start 2024-04-16T13:06:21.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.694+0000 7fb053200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 0x7fb05406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.694+0000 7fb053200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 0x7fb05415d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.694+0000 7fb053200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05406dec0 con 0x7fb0540ce990 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.694+0000 7fb053200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fb05406e7f0 con 0x7fb0540724f0 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.694+0000 7fb053200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb05406e1a0 con 0x7fb05415cdc0 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.695+0000 7fb052800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 0x7fb05415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.695+0000 7fb051e00640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb0540ce990 0x7fb054071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:51278/0 (socket says 172.21.15.67:51278) 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.695+0000 7fb051e00640 1 -- 172.21.15.67:0/3787063198 learned_addr learned my addr 172.21.15.67:0/3787063198 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:21.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.695+0000 7fb04be00640 1 --2- 172.21.15.67:0/3787063198 >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 0x7fb05406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.696+0000 7fb052800640 1 -- 172.21.15.67:0/3787063198 >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 msgr2=0x7fb05406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.696+0000 7fb052800640 1 --2- 172.21.15.67:0/3787063198 >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 0x7fb05406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.696+0000 7fb052800640 1 -- 172.21.15.67:0/3787063198 >> v1:172.21.15.82:6789/0 conn(0x7fb0540ce990 legacy=0x7fb054071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.696+0000 7fb052800640 1 -- 172.21.15.67:0/3787063198 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05406e480 con 0x7fb05415cdc0 2024-04-16T13:06:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.696+0000 7fb04be00640 1 --2- 172.21.15.67:0/3787063198 >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 0x7fb05406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T13:06:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.698+0000 7fb052800640 1 --2- 172.21.15.67:0/3787063198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 0x7fb05415d250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009d90 tx=0x7fb04c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b65515ec3f2e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.698+0000 7fb051400640 1 -- 172.21.15.67:0/3787063198 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c039070 con 0x7fb05415cdc0 2024-04-16T13:06:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.698+0000 7fb051400640 1 -- 172.21.15.67:0/3787063198 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c02cbc0 con 0x7fb05415cdc0 2024-04-16T13:06:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.698+0000 7fb051400640 1 -- 172.21.15.67:0/3787063198 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c034440 con 0x7fb05415cdc0 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 -- 172.21.15.67:0/3787063198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 msgr2=0x7fb05415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 --2- 172.21.15.67:0/3787063198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 0x7fb05415d250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009d90 tx=0x7fb04c02be10 comp rx=0 tx=0).stop 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 -- 172.21.15.67:0/3787063198 shutdown_connections 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 --2- 172.21.15.67:0/3787063198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb05415cdc0 0x7fb05415d250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 --2- 172.21.15.67:0/3787063198 >> v2:172.21.15.82:3300/0 conn(0x7fb0540724f0 0x7fb05406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 -- 172.21.15.67:0/3787063198 >> 172.21.15.67:0/3787063198 conn(0x7fb054067d90 msgr2=0x7fb05406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 -- 172.21.15.67:0/3787063198 shutdown_connections 2024-04-16T13:06:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.699+0000 7fb053200640 1 -- 172.21.15.67:0/3787063198 wait complete. 2024-04-16T13:06:21.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.701+0000 7fb053200640 1 Processor -- start 2024-04-16T13:06:21.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.701+0000 7fb053200640 1 -- start start 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0540724f0 0x7fb054146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb05415cdc0 0x7fb054148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb05415d790 con 0x7fb0540ce990 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb05415db10 con 0x7fb05415cdc0 2024-04-16T13:06:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb053200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb05415ddc0 con 0x7fb0540724f0 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.702+0000 7fb04be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37550/0 (socket says 172.21.15.67:37550) 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 -- 172.21.15.67:0/2839900096 learned_addr learned my addr 172.21.15.67:0/2839900096 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb051e00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0540724f0 0x7fb054146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 -- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0540724f0 msgr2=0x7fb054146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0540724f0 0x7fb054146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 -- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb05415cdc0 msgr2=0x7fb054148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb05415cdc0 0x7fb054148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 -- 172.21.15.67:0/2839900096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb054149cd0 con 0x7fb0540ce990 2024-04-16T13:06:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.703+0000 7fb04be00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ec10 tx=0x7fb03c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.704+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c017070 con 0x7fb0540ce990 2024-04-16T13:06:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.704+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03c00cc30 con 0x7fb0540ce990 2024-04-16T13:06:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.704+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb054147260 con 0x7fb0540ce990 2024-04-16T13:06:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.704+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c013470 con 0x7fb0540ce990 2024-04-16T13:06:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.704+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb054147820 con 0x7fb0540ce990 2024-04-16T13:06:21.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.705+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb054075bd0 con 0x7fb0540ce990 2024-04-16T13:06:21.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.706+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb03c01a070 con 0x7fb0540ce990 2024-04-16T13:06:21.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.707+0000 7fb04a000640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 0x7fb03006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:21.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.707+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fb03c08b970 con 0x7fb0540ce990 2024-04-16T13:06:21.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.707+0000 7fb051e00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 0x7fb03006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:21.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.709+0000 7fb051e00640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 0x7fb03006edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb044000f60 tx=0x7fb044009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:21.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.711+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb054149cd0 con 0x7fb0540ce990 2024-04-16T13:06:21.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:21.917+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb0540b3140 con 0x7fb0540ce990 2024-04-16T13:06:22.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.229+0000 7fb04a000640 1 -- 172.21.15.67:0/2839900096 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7fb03c059ec0 con 0x7fb0540ce990 2024-04-16T13:06:22.232 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 msgr2=0x7fb03006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 0x7fb03006edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb044000f60 tx=0x7fb044009040 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 msgr2=0x7fb054149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ec10 tx=0x7fb03c00c520 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 shutdown_connections 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb03006c8f0 0x7fb03006edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb05415cdc0 0x7fb054148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0540ce990 0x7fb054149790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 --2- 172.21.15.67:0/2839900096 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb0540724f0 0x7fb054146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.233+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 >> 172.21.15.67:0/2839900096 conn(0x7fb054067d90 msgr2=0x7fb0541592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.234+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 shutdown_connections 2024-04-16T13:06:22.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.234+0000 7fb053200640 1 -- 172.21.15.67:0/2839900096 wait complete. 2024-04-16T13:06:22.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-16T13:06:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.470+0000 7fea85000640 1 Processor -- start 2024-04-16T13:06:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.470+0000 7fea85000640 1 -- start start 2024-04-16T13:06:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.471+0000 7fea85000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea8009b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.471+0000 7fea85000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea80160450 con 0x7fea800d0fe0 2024-04-16T13:06:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.471+0000 7fea85000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8009bf00 con 0x7fea8009b9c0 2024-04-16T13:06:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.471+0000 7fea85000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea800b5e10 con 0x7fea800b7fd0 2024-04-16T13:06:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.472+0000 7fea7fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fea800d0fe0 0x7fea800b62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44482/0 (socket says 172.21.15.67:44482) 2024-04-16T13:06:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.472+0000 7fea7fe00640 1 -- 172.21.15.67:0/1168106195 learned_addr learned my addr 172.21.15.67:0/1168106195 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.472+0000 7fea7f400640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea8009b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.472+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811835823 0 0) 0x7fea80160450 con 0x7fea800d0fe0 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.472+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea60003520 con 0x7fea800d0fe0 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356316835 0 0) 0x7fea60003520 con 0x7fea800d0fe0 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 msgr2=0x7fea8009b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea8009b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 >> v1:172.21.15.82:6789/0 conn(0x7fea8009b9c0 legacy=0x7fea800d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea800b5520 con 0x7fea800d0fe0 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fea78001670 con 0x7fea800d0fe0 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 >> v1:172.21.15.67:6789/0 conn(0x7fea800d0fe0 legacy=0x7fea800b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea600039e0 0x7fea60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea800b5e10 con 0x7fea60004800 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea6000baa0 con 0x7fea600039e0 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea6000bca0 con 0x7fea800b7fd0 2024-04-16T13:06:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.473+0000 7fea7ea00640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7f400640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea600039e0 0x7fea60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7fe00640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7ea00640 1 -- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 msgr2=0x7fea600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7ea00640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800b7fd0 0x7fea600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7ea00640 1 -- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea600039e0 msgr2=0x7fea60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7ea00640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea600039e0 0x7fea60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.474+0000 7fea7ea00640 1 -- 172.21.15.67:0/1168106195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea60003520 con 0x7fea60004800 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.475+0000 7fea7ea00640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea60004c80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fea68001e20 tx=0x7fea60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4faba4c7ded69 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.475+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68001a70 con 0x7fea60004800 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea68003b70 con 0x7fea60004800 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea7e000640 1 -- 172.21.15.67:0/1168106195 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea680050d0 con 0x7fea60004800 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 -- 172.21.15.67:0/1168106195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 msgr2=0x7fea60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 --2- 172.21.15.67:0/1168106195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea60004c80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fea68001e20 tx=0x7fea60005830 comp rx=0 tx=0).stop 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea7fe00640 1 -- 172.21.15.67:0/1168106195 reap_dead start 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 -- 172.21.15.67:0/1168106195 shutdown_connections 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 -- 172.21.15.67:0/1168106195 >> 172.21.15.67:0/1168106195 conn(0x7fea800b4090 msgr2=0x7fea800b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:22.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 -- 172.21.15.67:0/1168106195 shutdown_connections 2024-04-16T13:06:22.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.476+0000 7fea85000640 1 -- 172.21.15.67:0/1168106195 wait complete. 2024-04-16T13:06:22.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.478+0000 7fea85000640 1 Processor -- start 2024-04-16T13:06:22.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.478+0000 7fea85000640 1 -- start start 2024-04-16T13:06:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800c7a60 0x7fea800c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea800c7ee0 0x7fea800cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fea800b83b0 con 0x7fea60004800 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea800b5aa0 con 0x7fea800c7ee0 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.479+0000 7fea85000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fea800d0550 con 0x7fea800c7a60 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56804/0 (socket says 172.21.15.67:56804) 2024-04-16T13:06:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 -- 172.21.15.67:0/2737904413 learned_addr learned my addr 172.21.15.67:0/2737904413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7fe00640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea800c7ee0 0x7fea800cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7ea00640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800c7a60 0x7fea800c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 -- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800c7a60 msgr2=0x7fea800c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800c7a60 0x7fea800c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 -- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea800c7ee0 msgr2=0x7fea800cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea800c7ee0 0x7fea800cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.480+0000 7fea7f400640 1 -- 172.21.15.67:0/2737904413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea800c69c0 con 0x7fea60004800 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea7f400640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fea70011600 tx=0x7fea70011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000f920 con 0x7fea60004800 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7000fac0 con 0x7fea60004800 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea800c6ca0 con 0x7fea60004800 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000fe70 con 0x7fea60004800 2024-04-16T13:06:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.481+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea800c7260 con 0x7fea60004800 2024-04-16T13:06:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.482+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea80075bd0 con 0x7fea60004800 2024-04-16T13:06:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.484+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea70015460 con 0x7fea60004800 2024-04-16T13:06:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.485+0000 7fea77400640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 0x7fea5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:22.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.485+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7fea7008c510 con 0x7fea60004800 2024-04-16T13:06:22.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.485+0000 7fea7ea00640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 0x7fea5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:22.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.486+0000 7fea7ea00640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 0x7fea5c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea68034000 tx=0x7fea68039040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:22.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.489+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea70019030 con 0x7fea60004800 2024-04-16T13:06:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:22.701+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fea8009b260 con 0x7fea60004800 2024-04-16T13:06:23.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.236+0000 7fea77400640 1 -- 172.21.15.67:0/2737904413 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7fea7005a970 con 0x7fea60004800 2024-04-16T13:06:23.238 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-04-16T13:06:23.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.239+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 msgr2=0x7fea5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.239+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 0x7fea5c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fea68034000 tx=0x7fea68039040 comp rx=0 tx=0).stop 2024-04-16T13:06:23.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.239+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 msgr2=0x7fea80154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.239+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fea70011600 tx=0x7fea70011ac0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 shutdown_connections 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fea5c06c8f0 0x7fea5c06edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea800c7ee0 0x7fea800cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fea800c7a60 0x7fea800c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 --2- 172.21.15.67:0/2737904413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fea60004800 0x7fea80154b60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.240+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 >> 172.21.15.67:0/2737904413 conn(0x7fea800b4090 msgr2=0x7fea800717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:23.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.241+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 shutdown_connections 2024-04-16T13:06:23.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.244+0000 7fea85000640 1 -- 172.21.15.67:0/2737904413 wait complete. 2024-04-16T13:06:23.283 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-16T13:06:23.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.469+0000 7fb195600640 1 Processor -- start 2024-04-16T13:06:23.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.469+0000 7fb195600640 1 -- start start 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb195600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 0x7fb1900c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb195600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1900b3700 0x7fb1900b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb195600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1900c6e70 con 0x7fb1900cc9f0 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb195600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb1900c7710 con 0x7fb1900b3700 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb195600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb1900c7150 con 0x7fb19015c860 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb18f400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb1900b3700 0x7fb1900b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb187e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb1900cc9f0 0x7fb190160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44484/0 (socket says 172.21.15.67:44484) 2024-04-16T13:06:23.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.471+0000 7fb187e00640 1 -- 172.21.15.67:0/722800948 learned_addr learned my addr 172.21.15.67:0/722800948 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:23.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18ea00640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 0x7fb1900c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18f400640 1 -- 172.21.15.67:0/722800948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 msgr2=0x7fb1900c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:23.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18f400640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 0x7fb1900c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18f400640 1 -- 172.21.15.67:0/722800948 >> v1:172.21.15.67:6789/0 conn(0x7fb1900cc9f0 legacy=0x7fb190160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18f400640 1 -- 172.21.15.67:0/722800948 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1900c7430 con 0x7fb1900b3700 2024-04-16T13:06:23.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.472+0000 7fb18ea00640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 0x7fb1900c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.473+0000 7fb18f400640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900b3700 0x7fb1900b3b70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d90 tx=0x7fb18802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb35bb289c599a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.473+0000 7fb18e000640 1 -- 172.21.15.67:0/722800948 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188039070 con 0x7fb1900b3700 2024-04-16T13:06:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.473+0000 7fb18e000640 1 -- 172.21.15.67:0/722800948 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18802cc50 con 0x7fb1900b3700 2024-04-16T13:06:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.473+0000 7fb18e000640 1 -- 172.21.15.67:0/722800948 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188034440 con 0x7fb1900b3700 2024-04-16T13:06:23.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 -- 172.21.15.67:0/722800948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900b3700 msgr2=0x7fb1900b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900b3700 0x7fb1900b3b70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d90 tx=0x7fb18802bea0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 -- 172.21.15.67:0/722800948 shutdown_connections 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900b3700 0x7fb1900b3b70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 --2- 172.21.15.67:0/722800948 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb19015c860 0x7fb1900c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 -- 172.21.15.67:0/722800948 >> 172.21.15.67:0/722800948 conn(0x7fb190067d90 msgr2=0x7fb19006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 -- 172.21.15.67:0/722800948 shutdown_connections 2024-04-16T13:06:23.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.474+0000 7fb195600640 1 -- 172.21.15.67:0/722800948 wait complete. 2024-04-16T13:06:23.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.476+0000 7fb195600640 1 Processor -- start 2024-04-16T13:06:23.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.476+0000 7fb195600640 1 -- start start 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.477+0000 7fb195600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 0x7fb1901f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.477+0000 7fb195600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.477+0000 7fb195600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19015c860 0x7fb19015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb195600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb19015cc40 con 0x7fb1900cc9f0 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb195600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900cce50 con 0x7fb19015c860 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb195600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb1901611f0 con 0x7fb1900b3700 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56832/0 (socket says 172.21.15.67:56832) 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 -- 172.21.15.67:0/3522651090 learned_addr learned my addr 172.21.15.67:0/3522651090 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb18ea00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 0x7fb1901f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 -- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 msgr2=0x7fb1901f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 0x7fb1901f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb18f400640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19015c860 0x7fb19015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 -- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19015c860 msgr2=0x7fb19015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19015c860 0x7fb19015af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 -- 172.21.15.67:0/3522651090 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1901543f0 con 0x7fb1900cc9f0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb18ea00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 0x7fb1901f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.478+0000 7fb187e00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c400 tx=0x7fb17800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.479+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178017070 con 0x7fb1900cc9f0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.479+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb178005ce0 con 0x7fb1900cc9f0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.479+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1780072f0 con 0x7fb1900cc9f0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.479+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1901e69d0 con 0x7fb1900cc9f0 2024-04-16T13:06:23.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.479+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1901e7270 con 0x7fb1900cc9f0 2024-04-16T13:06:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.480+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb190068a70 con 0x7fb1900cc9f0 2024-04-16T13:06:23.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.482+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb17801a070 con 0x7fb1900cc9f0 2024-04-16T13:06:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.483+0000 7fb186a00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 0x7fb16c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:23.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.483+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fb17808b4e0 con 0x7fb1900cc9f0 2024-04-16T13:06:23.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.483+0000 7fb18ea00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 0x7fb16c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:23.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.485+0000 7fb18ea00640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 0x7fb16c06edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:23.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.487+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb178021020 con 0x7fb1900cc9f0 2024-04-16T13:06:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:23.733+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb1900b49f0 con 0x7fb1900cc9f0 2024-04-16T13:06:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.288+0000 7fb186a00640 1 -- 172.21.15.67:0/3522651090 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb178059850 con 0x7fb1900cc9f0 2024-04-16T13:06:24.291 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 5 and data pool 6 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.294+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 msgr2=0x7fb16c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 0x7fb16c06edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180008040 comp rx=0 tx=0).stop 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 msgr2=0x7fb1901e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c400 tx=0x7fb17800c8c0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 shutdown_connections 2024-04-16T13:06:24.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb16c06c8f0 0x7fb16c06edb0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180008040 comp rx=0 tx=0).stop 2024-04-16T13:06:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19015c860 0x7fb19015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb1900cc9f0 0x7fb1901e7a70 secure :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c400 tx=0x7fb17800c8c0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 --2- 172.21.15.67:0/3522651090 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb1900b3700 0x7fb1901f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.295+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 >> 172.21.15.67:0/3522651090 conn(0x7fb190067d90 msgr2=0x7fb190071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:24.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.299+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 shutdown_connections 2024-04-16T13:06:24.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.299+0000 7fb195600640 1 -- 172.21.15.67:0/3522651090 wait complete. 2024-04-16T13:06:24.340 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:24.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.522+0000 7fcd3ca00640 1 Processor -- start 2024-04-16T13:06:24.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.523+0000 7fcd3ca00640 1 -- start start 2024-04-16T13:06:24.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.524+0000 7fcd3ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd380ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.524+0000 7fcd3ca00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd3806e5a0 0x7fcd3806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.524+0000 7fcd3ca00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd38160800 con 0x7fcd3815c6f0 2024-04-16T13:06:24.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.524+0000 7fcd3ca00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fcd38161090 con 0x7fcd3806e5a0 2024-04-16T13:06:24.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.524+0000 7fcd3ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380adb10 con 0x7fcd380ad170 2024-04-16T13:06:24.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd37400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcd3815c6f0 0x7fcd381600f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44494/0 (socket says 172.21.15.67:44494) 2024-04-16T13:06:24.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd37400640 1 -- 172.21.15.67:0/162156033 learned_addr learned my addr 172.21.15.67:0/162156033 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd380ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd37e00640 1 --2- 172.21.15.67:0/162156033 >> v2:172.21.15.82:3300/0 conn(0x7fcd3806e5a0 0x7fcd3806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650738255 0 0) 0x7fcd38160800 con 0x7fcd3815c6f0 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd1c003520 con 0x7fcd3815c6f0 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456927186 0 0) 0x7fcd1c003520 con 0x7fcd3815c6f0 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 msgr2=0x7fcd380ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd380ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 >> v2:172.21.15.82:3300/0 conn(0x7fcd3806e5a0 msgr2=0x7fcd3806ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 --2- 172.21.15.67:0/162156033 >> v2:172.21.15.82:3300/0 conn(0x7fcd3806e5a0 0x7fcd3806ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd38160ad0 con 0x7fcd3815c6f0 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.525+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fcd28001670 con 0x7fcd3815c6f0 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 >> v1:172.21.15.67:6789/0 conn(0x7fcd3815c6f0 legacy=0x7fcd381600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd1c003f30 0x7fcd1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c004d40 0x7fcd1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c00b9c0 con 0x7fcd1c003f30 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c00bb40 con 0x7fcd1c004d40 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c00bcc0 con 0x7fcd380ad170 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd1c003f30 0x7fcd1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd37400640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 -- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 msgr2=0x7fcd1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:24.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd380ad170 0x7fcd1c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 -- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c004d40 msgr2=0x7fcd1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:24.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1c004d40 0x7fcd1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.526+0000 7fcd2fe00640 1 -- 172.21.15.67:0/162156033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c003520 con 0x7fcd1c003f30 2024-04-16T13:06:24.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.527+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd1c003f30 0x7fcd1c004800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ac0 tx=0x7fcd1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bfec87cd85b336 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:24.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20039070 con 0x7fcd1c003f30 2024-04-16T13:06:24.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2002c6b0 con 0x7fcd1c003f30 2024-04-16T13:06:24.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd36a00640 1 -- 172.21.15.67:0/162156033 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20009690 con 0x7fcd1c003f30 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd3ca00640 1 -- 172.21.15.67:0/162156033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd1c003f30 msgr2=0x7fcd1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/162156033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd1c003f30 0x7fcd1c004800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009ac0 tx=0x7fcd1c005830 comp rx=0 tx=0).stop 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.528+0000 7fcd37e00640 1 -- 172.21.15.67:0/162156033 reap_dead start 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.529+0000 7fcd3ca00640 1 -- 172.21.15.67:0/162156033 shutdown_connections 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.529+0000 7fcd3ca00640 1 -- 172.21.15.67:0/162156033 >> 172.21.15.67:0/162156033 conn(0x7fcd380d0220 msgr2=0x7fcd380d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.529+0000 7fcd3ca00640 1 -- 172.21.15.67:0/162156033 shutdown_connections 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.529+0000 7fcd3ca00640 1 -- 172.21.15.67:0/162156033 wait complete. 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.530+0000 7fcd3ca00640 1 Processor -- start 2024-04-16T13:06:24.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.531+0000 7fcd3ca00640 1 -- start start 2024-04-16T13:06:24.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.531+0000 7fcd3ca00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd1c003f30 0x7fcd381f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.531+0000 7fcd3ca00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd3ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd381f4650 0x7fcd38072e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd3ca00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3806dda0 con 0x7fcd380725d0 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd3ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3806e110 con 0x7fcd381f4650 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd3ca00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380af200 con 0x7fcd1c003f30 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56850/0 (socket says 172.21.15.67:56850) 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 -- 172.21.15.67:0/3876535404 learned_addr learned my addr 172.21.15.67:0/3876535404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd37400640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd1c003f30 0x7fcd381f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd37e00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd381f4650 0x7fcd38072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 -- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd1c003f30 msgr2=0x7fcd381f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd1c003f30 0x7fcd381f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 -- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd381f4650 msgr2=0x7fcd38072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd381f4650 0x7fcd38072e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.532+0000 7fcd2fe00640 1 -- 172.21.15.67:0/3876535404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd381f1b50 con 0x7fcd380725d0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd2fe00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd200099e0 tx=0x7fcd20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20042020 con 0x7fcd380725d0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2003a040 con 0x7fcd380725d0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20039070 con 0x7fcd380725d0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd381f4bd0 con 0x7fcd380725d0 2024-04-16T13:06:24.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.533+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd38071dd0 con 0x7fcd380725d0 2024-04-16T13:06:24.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.534+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd38075bd0 con 0x7fcd380725d0 2024-04-16T13:06:24.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.535+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd20045020 con 0x7fcd380725d0 2024-04-16T13:06:24.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.537+0000 7fcd2f400640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 0x7fcd1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.537+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fcd200acba0 con 0x7fcd380725d0 2024-04-16T13:06:24.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.537+0000 7fcd37400640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 0x7fcd1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.539+0000 7fcd37400640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 0x7fcd1406ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd280018e0 tx=0x7fcd28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:24.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.542+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcd381f1b50 con 0x7fcd380725d0 2024-04-16T13:06:24.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.746+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd3806fce0 con 0x7fcd380725d0 2024-04-16T13:06:24.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.749+0000 7fcd2f400640 1 -- 172.21.15.67:0/3876535404 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16859 (secure 0 0 0) 0x7fcd2007ada0 con 0x7fcd380725d0 2024-04-16T13:06:24.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:24.752 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":38,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:06:23.736364+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:06:21.935846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T13:06:22.716875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 msgr2=0x7fcd1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 0x7fcd1406ede0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcd280018e0 tx=0x7fcd28009040 comp rx=0 tx=0).stop 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 msgr2=0x7fcd381f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd200099e0 tx=0x7fcd20004730 comp rx=0 tx=0).stop 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 shutdown_connections 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fcd1406c920 0x7fcd1406ede0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd381f4650 0x7fcd38072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd380725d0 0x7fcd381f4110 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 --2- 172.21.15.67:0/3876535404 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fcd1c003f30 0x7fcd381f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 >> 172.21.15.67:0/3876535404 conn(0x7fcd380d0220 msgr2=0x7fcd380b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:24.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 shutdown_connections 2024-04-16T13:06:24.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.752+0000 7fcd3ca00640 1 -- 172.21.15.67:0/3876535404 wait complete. 2024-04-16T13:06:24.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:24.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.983+0000 7f26ff200640 1 Processor -- start 2024-04-16T13:06:24.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.984+0000 7f26ff200640 1 -- start start 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26ff200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 0x7f27000d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26ff200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f270006da70 0x7f27000d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26ff200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27000d0000 con 0x7f27000d5220 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26ff200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f27000d0c10 con 0x7f270006da70 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26ff200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f27000d02e0 con 0x7f270015eaa0 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.985+0000 7f26fe800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f270006da70 0x7f27000d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f270006da70 0x7f27000d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56852/0 (socket says 172.21.15.67:56852) 2024-04-16T13:06:24.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 -- 172.21.15.67:0/2838277571 learned_addr learned my addr 172.21.15.67:0/2838277571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fd400640 1 --1- 172.21.15.67:0/2838277571 >> v1:172.21.15.67:6789/0 conn(0x7f27000d5220 0x7f270006d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44496/0 (socket says 172.21.15.67:44496) 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fde00640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 0x7f27000d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 -- 172.21.15.67:0/2838277571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 msgr2=0x7f27000d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 0x7f27000d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 -- 172.21.15.67:0/2838277571 >> v1:172.21.15.67:6789/0 conn(0x7f27000d5220 legacy=0x7f270006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fe800640 1 -- 172.21.15.67:0/2838277571 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000d05c0 con 0x7f270006da70 2024-04-16T13:06:24.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.986+0000 7f26fde00640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 0x7f27000d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:24.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.987+0000 7f26fe800640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270006da70 0x7f27000d27b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7a582c2c7fc465 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:24.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26fca00640 1 -- 172.21.15.67:0/2838277571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f802ca80 con 0x7f270006da70 2024-04-16T13:06:24.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26fca00640 1 -- 172.21.15.67:0/2838277571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f802cc20 con 0x7f270006da70 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26fca00640 1 -- 172.21.15.67:0/2838277571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80343f0 con 0x7f270006da70 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 -- 172.21.15.67:0/2838277571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270006da70 msgr2=0x7f27000d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270006da70 0x7f27000d27b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802bee0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 -- 172.21.15.67:0/2838277571 shutdown_connections 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270006da70 0x7f27000d27b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 --2- 172.21.15.67:0/2838277571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f270015eaa0 0x7f27000d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 -- 172.21.15.67:0/2838277571 >> 172.21.15.67:0/2838277571 conn(0x7f270008c000 msgr2=0x7f27000d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 -- 172.21.15.67:0/2838277571 shutdown_connections 2024-04-16T13:06:24.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.988+0000 7f26ff200640 1 -- 172.21.15.67:0/2838277571 wait complete. 2024-04-16T13:06:24.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.990+0000 7f26ff200640 1 Processor -- start 2024-04-16T13:06:24.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.990+0000 7f26ff200640 1 -- start start 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f270006da70 0x7f27000cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27000d5220 0x7f27000a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f270006ceb0 con 0x7f270015eaa0 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f270015ee80 con 0x7f270006da70 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.991+0000 7f26ff200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f27000d2cf0 con 0x7f27000d5220 2024-04-16T13:06:24.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56860/0 (socket says 172.21.15.67:56860) 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 -- 172.21.15.67:0/435365276 learned_addr learned my addr 172.21.15.67:0/435365276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fd400640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27000d5220 0x7f27000a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 -- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27000d5220 msgr2=0x7f27000a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27000d5220 0x7f27000a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 -- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f270006da70 msgr2=0x7f27000cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f270006da70 0x7f27000cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 -- 172.21.15.67:0/435365276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27001f8570 con 0x7f270015eaa0 2024-04-16T13:06:24.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.992+0000 7f26fe800640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009f70 tx=0x7f26f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.993+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8043020 con 0x7f270015eaa0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.993+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f803e450 con 0x7f270015eaa0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.993+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8009510 con 0x7f270015eaa0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.993+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000a21a0 con 0x7f270015eaa0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.993+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001f7c40 con 0x7f270015eaa0 2024-04-16T13:06:24.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.994+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700075bd0 con 0x7f270015eaa0 2024-04-16T13:06:24.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.995+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26f8046020 con 0x7f270015eaa0 2024-04-16T13:06:24.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.996+0000 7f26f6000640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 0x7f26e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:24.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.996+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f26f80ae600 con 0x7f270015eaa0 2024-04-16T13:06:24.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.997+0000 7f26fde00640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 0x7f26e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:24.998+0000 7f26fde00640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 0x7f26e006edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26f0006fd0 tx=0x7f26f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:25.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.000+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26f804d030 con 0x7f270015eaa0 2024-04-16T13:06:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.208+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27000cc960 con 0x7f270015eaa0 2024-04-16T13:06:25.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.211+0000 7f26f6000640 1 -- 172.21.15.67:0/435365276 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16859 (secure 0 0 0) 0x7f26f807c800 con 0x7f270015eaa0 2024-04-16T13:06:25.213 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:25.213 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":38,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:06:23.736364+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:06:21.935846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T13:06:22.716875+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 msgr2=0x7f26e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 0x7f26e006edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f26f0006fd0 tx=0x7f26f0008040 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 msgr2=0x7f27000b9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009f70 tx=0x7f26f8004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 shutdown_connections 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f26e006c8f0 0x7f26e006edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f270015eaa0 0x7f27000b9120 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.213+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f27000d5220 0x7f27000a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.214+0000 7f26ff200640 1 --2- 172.21.15.67:0/435365276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f270006da70 0x7f27000cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.214+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 >> 172.21.15.67:0/435365276 conn(0x7f270008c000 msgr2=0x7f27000b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.214+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 shutdown_connections 2024-04-16T13:06:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.214+0000 7f26ff200640 1 -- 172.21.15.67:0/435365276 wait complete. 2024-04-16T13:06:25.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-16T13:06:25.309 INFO:tasks.ceph.mds.d.smithi082.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fc456400640 time 2024-04-16T13:06:25.309007+0000 2024-04-16T13:06:25.309 INFO:tasks.ceph.mds.d.smithi082.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc462d81f4c] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr:*** Caught signal (Aborted) ** 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr: in thread 7fc456400640 thread_name:ms_dispatch 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-04-16T13:06:25.309+0000 7fc456400640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fc456400640 time 2024-04-16T13:06:25.309007+0000 2024-04-16T13:06:25.310 INFO:tasks.ceph.mds.d.smithi082.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc462d81f4c] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.311 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc462454db0] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc4624a154c] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: raise() 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: abort() 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc462d81fa6] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.312 INFO:tasks.ceph.mds.d.smithi082.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr:2024-04-16T13:06:25.310+0000 7fc456400640 -1 *** Caught signal (Aborted) ** 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: in thread 7fc456400640 thread_name:ms_dispatch 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc462454db0] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc4624a154c] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: raise() 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: abort() 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc462d81fa6] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.313 INFO:tasks.ceph.mds.d.smithi082.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.314 INFO:tasks.ceph.mds.d.smithi082.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.314 INFO:tasks.ceph.mds.d.smithi082.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.314 INFO:tasks.ceph.mds.d.smithi082.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.314 INFO:tasks.ceph.mds.d.smithi082.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T13:06:25.314 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: -1> 2024-04-16T13:06:25.309+0000 7fc456400640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fc456400640 time 2024-04-16T13:06:25.309007+0000 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc462d81f4c] 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.319 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 0> 2024-04-16T13:06:25.310+0000 7fc456400640 -1 *** Caught signal (Aborted) ** 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: in thread 7fc456400640 thread_name:ms_dispatch 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc462454db0] 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc4624a154c] 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: raise() 2024-04-16T13:06:25.320 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: abort() 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc462d81fa6] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T13:06:25.321 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.324 INFO:tasks.ceph.mds.d.smithi082.stderr: -1> 2024-04-16T13:06:25.309+0000 7fc456400640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: In function 'void MDLog::trim()' thread 7fc456400640 time 2024-04-16T13:06:25.309007+0000 2024-04-16T13:06:25.324 INFO:tasks.ceph.mds.d.smithi082.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2868-gc3c87ed0/rpm/el9/BUILD/ceph-19.0.0-2868-gc3c87ed0/src/mds/MDLog.cc: 688: FAILED ceph_assert(num_total_segments >= num_replayed_segments) 2024-04-16T13:06:25.324 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.324 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc462d81f4c] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 0> 2024-04-16T13:06:25.310+0000 7fc456400640 -1 *** Caught signal (Aborted) ** 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: in thread 7fc456400640 thread_name:ms_dispatch 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: ceph version 19.0.0-2868-gc3c87ed0 (c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f) squid (dev) 2024-04-16T13:06:25.325 INFO:tasks.ceph.mds.d.smithi082.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc462454db0] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc4624a154c] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 3: raise() 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 4: abort() 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc462d81fa6] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18210a) [0x7fc462d8210a] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 7: (MDLog::trim()+0xf2a) [0x55947562a1aa] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 8: (MDLog::log_trim_upkeep()+0x339) [0x55947562a559] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 9: /lib64/libstdc++.so.6(+0xdb924) [0x7fc4628db924] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 10: /lib64/libc.so.6(+0x9f802) [0x7fc46249f802] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 11: /lib64/libc.so.6(+0x3f450) [0x7fc46243f450] 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T13:06:25.326 INFO:tasks.ceph.mds.d.smithi082.stderr: 2024-04-16T13:06:25.429 INFO:tasks.ceph.mds.d.smithi082.stderr:daemon-helper: command crashed with signal 6 2024-04-16T13:06:25.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.451+0000 7f6376a00640 1 Processor -- start 2024-04-16T13:06:25.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.452+0000 7f6376a00640 1 -- start start 2024-04-16T13:06:25.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6370072050 0x7f63700b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f637006e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 0x7f637006e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f63700b3970 con 0x7f6370072050 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f63701641f0 con 0x7f637006f9d0 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6376a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f63701635e0 con 0x7f637006f040 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6375600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6370072050 0x7f63700b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6375600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6370072050 0x7f63700b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56862/0 (socket says 172.21.15.67:56862) 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.453+0000 7f6375600640 1 -- 172.21.15.67:0/3637069784 learned_addr learned my addr 172.21.15.67:0/3637069784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6374c00640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f637006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6375600640 1 -- 172.21.15.67:0/3637069784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 msgr2=0x7f637006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6376000640 1 --2- 172.21.15.67:0/3637069784 >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 0x7f637006e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6375600640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f637006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6375600640 1 -- 172.21.15.67:0/3637069784 >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 msgr2=0x7f637006e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6375600640 1 --2- 172.21.15.67:0/3637069784 >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 0x7f637006e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6375600640 1 -- 172.21.15.67:0/3637069784 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63701638c0 con 0x7f6370072050 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6374c00640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f637006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:25.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.454+0000 7f6376000640 1 --2- 172.21.15.67:0/3637069784 >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 0x7f637006e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.455+0000 7f6375600640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6370072050 0x7f63700b3430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f63701637f0 tx=0x7f636402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff48602bd44636d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f636fe00640 1 -- 172.21.15.67:0/3637069784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364035020 con 0x7f6370072050 2024-04-16T13:06:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f636fe00640 1 -- 172.21.15.67:0/3637069784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6364031640 con 0x7f6370072050 2024-04-16T13:06:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f636fe00640 1 -- 172.21.15.67:0/3637069784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636402d040 con 0x7f6370072050 2024-04-16T13:06:25.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 -- 172.21.15.67:0/3637069784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6370072050 msgr2=0x7f63700b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6370072050 0x7f63700b3430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f63701637f0 tx=0x7f636402b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 -- 172.21.15.67:0/3637069784 shutdown_connections 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 --2- 172.21.15.67:0/3637069784 >> v2:172.21.15.82:3300/0 conn(0x7f637006f9d0 0x7f637006e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f637006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 --2- 172.21.15.67:0/3637069784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6370072050 0x7f63700b3430 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 -- 172.21.15.67:0/3637069784 >> 172.21.15.67:0/3637069784 conn(0x7f6370067d90 msgr2=0x7f637006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 -- 172.21.15.67:0/3637069784 shutdown_connections 2024-04-16T13:06:25.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.456+0000 7f6376a00640 1 -- 172.21.15.67:0/3637069784 wait complete. 2024-04-16T13:06:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.458+0000 7f6376a00640 1 Processor -- start 2024-04-16T13:06:25.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.458+0000 7f6376a00640 1 -- start start 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f63701f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 0x7f637015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f637006eb80 con 0x7f637006f9d0 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6370163e80 con 0x7f6370072050 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.459+0000 7f6376a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f637006ed00 con 0x7f637006f040 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56874/0 (socket says 172.21.15.67:56874) 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 -- 172.21.15.67:0/1019967386 learned_addr learned my addr 172.21.15.67:0/1019967386 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6375600640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f63701f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6376000640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 0x7f637015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 -- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 msgr2=0x7f63701f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:25.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f63701f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 -- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 msgr2=0x7f637015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 0x7f637015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 -- 172.21.15.67:0/1019967386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6370156c00 con 0x7f637006f9d0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6376000640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 0x7f637015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6375600640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f63701f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.460+0000 7f6374c00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f636000c7c0 tx=0x7f636000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.461+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360015070 con 0x7f637006f9d0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.461+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6360007820 con 0x7f637006f9d0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.461+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360007bf0 con 0x7f637006f9d0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.461+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6370156ee0 con 0x7f637006f9d0 2024-04-16T13:06:25.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.461+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6370153b50 con 0x7f637006f9d0 2024-04-16T13:06:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.462+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6370157400 con 0x7f637006f9d0 2024-04-16T13:06:25.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.463+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6360018070 con 0x7f637006f9d0 2024-04-16T13:06:25.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.465+0000 7f636d600640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 0x7f635406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.465+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f636008bc00 con 0x7f637006f9d0 2024-04-16T13:06:25.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.465+0000 7f6375600640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 0x7f635406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:25.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.467+0000 7f6375600640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 0x7f635406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6364036000 tx=0x7f636403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:25.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.470+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6360059ed0 con 0x7f637006f9d0 2024-04-16T13:06:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:25.713+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6370075bd0 con 0x7f637006f9d0 2024-04-16T13:06:25.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-16T13:06:26.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.302+0000 7f636d600640 1 -- 172.21.15.67:0/1019967386 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f63600597d0 con 0x7f637006f9d0 2024-04-16T13:06:26.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.305+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 msgr2=0x7f635406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 0x7f635406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6364036000 tx=0x7f636403c040 comp rx=0 tx=0).stop 2024-04-16T13:06:26.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 msgr2=0x7f6370156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f636000c7c0 tx=0x7f636000cc80 comp rx=0 tx=0).stop 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 shutdown_connections 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f635406c8f0 0x7f635406edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6370072050 0x7f637015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f637006f9d0 0x7f6370156180 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 --2- 172.21.15.67:0/1019967386 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f637006f040 0x7f63701f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 >> 172.21.15.67:0/1019967386 conn(0x7f6370067d90 msgr2=0x7f63701665f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 shutdown_connections 2024-04-16T13:06:26.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.306+0000 7f6376a00640 1 -- 172.21.15.67:0/1019967386 wait complete. 2024-04-16T13:06:26.328 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-16T13:06:26.328 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-16T13:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.558+0000 7fd917a00640 1 Processor -- start 2024-04-16T13:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.559+0000 7fd917a00640 1 -- start start 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd917a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9100c6890 0x7fd9100cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd917a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9100c6e70 con 0x7fd9100b3700 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd917a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9100c7150 con 0x7fd91015c860 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd917a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fd9100c7710 con 0x7fd9100c6890 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd915a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd9100b3700 0x7fd9100cf360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44502/0 (socket says 172.21.15.67:44502) 2024-04-16T13:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.560+0000 7fd915a00640 1 -- 172.21.15.67:0/2549235600 learned_addr learned my addr 172.21.15.67:0/2549235600 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666094866 0 0) 0x7fd9100c6e70 con 0x7fd9100b3700 2024-04-16T13:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8f4003520 con 0x7fd9100b3700 2024-04-16T13:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90fe00640 1 --2- 172.21.15.67:0/2549235600 >> v2:172.21.15.82:3300/0 conn(0x7fd9100c6890 0x7fd9100cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 834356181 0 0) 0x7fd8f4003520 con 0x7fd9100b3700 2024-04-16T13:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 >> v2:172.21.15.82:3300/0 conn(0x7fd9100c6890 msgr2=0x7fd9100cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 --2- 172.21.15.67:0/2549235600 >> v2:172.21.15.82:3300/0 conn(0x7fd9100c6890 0x7fd9100cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 >> v1:172.21.15.82:6789/0 conn(0x7fd91015c860 legacy=0x7fd910160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9100c7430 con 0x7fd9100b3700 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fd9080019f0 con 0x7fd9100b3700 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 >> v1:172.21.15.67:6789/0 conn(0x7fd9100b3700 legacy=0x7fd9100cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd8f4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8f4004800 0x7fd8f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8f40051c0 0x7fd8f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100c7710 con 0x7fd8f40039b0 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f400c0f0 con 0x7fd8f40051c0 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.561+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f400c2f0 con 0x7fd8f4004800 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd8f4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915a00640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8f40051c0 0x7fd8f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 -- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8f4004800 msgr2=0x7fd8f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd8f4004800 0x7fd8f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 -- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8f40051c0 msgr2=0x7fd8f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8f40051c0 0x7fd8f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915000640 1 -- 172.21.15.67:0/2549235600 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f4003520 con 0x7fd8f40039b0 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915a00640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8f40051c0 0x7fd8f400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.562+0000 7fd915a00640 1 -- 172.21.15.67:0/2549235600 reap_dead start 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.563+0000 7fd915000640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd8f4003db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd900003d80 tx=0x7fd8f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ae9607473ffa2b server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900037070 con 0x7fd8f40039b0 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900032600 con 0x7fd8f40039b0 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd90f400640 1 -- 172.21.15.67:0/2549235600 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900003980 con 0x7fd8f40039b0 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 -- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 msgr2=0x7fd8f4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd8f4003db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd900003d80 tx=0x7fd8f4005830 comp rx=0 tx=0).stop 2024-04-16T13:06:26.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 -- 172.21.15.67:0/2549235600 shutdown_connections 2024-04-16T13:06:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 --2- 172.21.15.67:0/2549235600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd8f4003db0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 -- 172.21.15.67:0/2549235600 >> 172.21.15.67:0/2549235600 conn(0x7fd910067d90 msgr2=0x7fd91006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 -- 172.21.15.67:0/2549235600 shutdown_connections 2024-04-16T13:06:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.564+0000 7fd917a00640 1 -- 172.21.15.67:0/2549235600 wait complete. 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.566+0000 7fd917a00640 1 Processor -- start 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.566+0000 7fd917a00640 1 -- start start 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd91015fa00 0x7fd910154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9100c8b30 0x7fd9100c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100cc9f0 con 0x7fd8f40039b0 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd91015cc40 con 0x7fd91015fa00 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd917a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fd9100ccb70 con 0x7fd9100c8b30 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd915000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd915000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56890/0 (socket says 172.21.15.67:56890) 2024-04-16T13:06:26.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.567+0000 7fd915000640 1 -- 172.21.15.67:0/2814436964 learned_addr learned my addr 172.21.15.67:0/2814436964 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 -- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9100c8b30 msgr2=0x7fd9100c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9100c8b30 0x7fd9100c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd90fe00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd91015fa00 0x7fd910154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9100c8b30 0x7fd9100c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 -- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd91015fa00 msgr2=0x7fd910154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd91015fa00 0x7fd910154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 -- 172.21.15.67:0/2814436964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9101f2650 con 0x7fd8f40039b0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.568+0000 7fd915000640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd900003d80 tx=0x7fd9000036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.569+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900042030 con 0x7fd8f40039b0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.569+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900032400 con 0x7fd8f40039b0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.569+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900037040 con 0x7fd8f40039b0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.569+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91015a680 con 0x7fd8f40039b0 2024-04-16T13:06:26.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.569+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9100c9d20 con 0x7fd8f40039b0 2024-04-16T13:06:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.570+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd910068a70 con 0x7fd8f40039b0 2024-04-16T13:06:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.571+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd900045070 con 0x7fd8f40039b0 2024-04-16T13:06:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.572+0000 7fd90cc00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 0x7fd8ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.572+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd9000ad880 con 0x7fd8f40039b0 2024-04-16T13:06:26.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.573+0000 7fd90fe00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 0x7fd8ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:26.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.574+0000 7fd90fe00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 0x7fd8ec06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006a90 tx=0x7fd8f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:26.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.577+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd90007bb10 con 0x7fd8f40039b0 2024-04-16T13:06:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:26.824+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd910071f40 con 0x7fd8f40039b0 2024-04-16T13:06:27.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.315+0000 7fd90cc00640 1 -- 172.21.15.67:0/2814436964 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fd90007b410 con 0x7fd8f40039b0 2024-04-16T13:06:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 msgr2=0x7fd8ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 0x7fd8ec06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006a90 tx=0x7fd8f8008040 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 msgr2=0x7fd910159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd900003d80 tx=0x7fd9000036f0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 shutdown_connections 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fd8ec06c8f0 0x7fd8ec06edb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fd9100c8b30 0x7fd9100c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd91015fa00 0x7fd910154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 --2- 172.21.15.67:0/2814436964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8f40039b0 0x7fd910159e50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.319+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 >> 172.21.15.67:0/2814436964 conn(0x7fd910067d90 msgr2=0x7fd91006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.320+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 shutdown_connections 2024-04-16T13:06:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.320+0000 7fd917a00640 1 -- 172.21.15.67:0/2814436964 wait complete. 2024-04-16T13:06:27.352 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-16T13:06:27.352 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:27.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.564+0000 7f7df6200640 1 Processor -- start 2024-04-16T13:06:27.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.564+0000 7f7df6200640 1 -- start start 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df6200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7df01601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df6200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df0161110 con 0x7f7df00c6930 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df6200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df0160870 con 0x7f7df015c800 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df6200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7df0160b50 con 0x7f7df015c420 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df5800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7df00c6930 0x7f7df00cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44518/0 (socket says 172.21.15.67:44518) 2024-04-16T13:06:27.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.566+0000 7f7df5800640 1 -- 172.21.15.67:0/438284565 learned_addr learned my addr 172.21.15.67:0/438284565 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:27.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695269726 0 0) 0x7f7df0161110 con 0x7f7df00c6930 2024-04-16T13:06:27.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7df4e00640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7df01601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dd8003520 con 0x7f7df00c6930 2024-04-16T13:06:27.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3719826067 0 0) 0x7f7dd8003520 con 0x7f7df00c6930 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 msgr2=0x7f7df01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7df01601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 >> v1:172.21.15.82:6789/0 conn(0x7f7df015c800 legacy=0x7f7df00c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df0160e30 con 0x7f7df00c6930 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f7de80019f0 con 0x7f7df00c6930 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 >> v1:172.21.15.67:6789/0 conn(0x7f7df00c6930 legacy=0x7f7df00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd80039e0 0x7f7dd8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.567+0000 7f7def400640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7dd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7def400640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd8004d40 0x7f7dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0160b50 con 0x7f7dd8004d40 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd800ffb0 con 0x7f7dd80039e0 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd80101b0 con 0x7f7df015c420 2024-04-16T13:06:27.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd8004d40 0x7f7dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df4e00640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd80039e0 0x7f7dd8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7defe00640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7dd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 -- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 msgr2=0x7f7dd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df015c420 0x7f7dd8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 -- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd80039e0 msgr2=0x7f7dd8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd80039e0 0x7f7dd8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.568+0000 7f7df5800640 1 -- 172.21.15.67:0/438284565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd8003520 con 0x7f7dd8004d40 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.569+0000 7f7df5800640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd8004d40 0x7f7dd80051c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7de800a810 tx=0x7f7dd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fcd46f9dce421c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de800a460 con 0x7f7dd8004d40 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de8034650 con 0x7f7dd8004d40 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7def400640 1 -- 172.21.15.67:0/438284565 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8034a40 con 0x7f7dd8004d40 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7df6200640 1 -- 172.21.15.67:0/438284565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd8004d40 msgr2=0x7f7dd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7df6200640 1 --2- 172.21.15.67:0/438284565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7dd8004d40 0x7f7dd80051c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7de800a810 tx=0x7f7dd8005830 comp rx=0 tx=0).stop 2024-04-16T13:06:27.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.570+0000 7f7df5800640 1 -- 172.21.15.67:0/438284565 reap_dead start 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.571+0000 7f7df6200640 1 -- 172.21.15.67:0/438284565 shutdown_connections 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.571+0000 7f7df6200640 1 -- 172.21.15.67:0/438284565 >> 172.21.15.67:0/438284565 conn(0x7f7df00b2070 msgr2=0x7f7df00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.571+0000 7f7df6200640 1 -- 172.21.15.67:0/438284565 shutdown_connections 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.571+0000 7f7df6200640 1 -- 172.21.15.67:0/438284565 wait complete. 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.572+0000 7f7df6200640 1 Processor -- start 2024-04-16T13:06:27.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.572+0000 7f7df6200640 1 -- start start 2024-04-16T13:06:27.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.573+0000 7f7df6200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd8004d40 0x7f7df0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.573+0000 7f7df6200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.573+0000 7f7df6200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 0x7f7df00b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.573+0000 7f7df6200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7df00c5280 con 0x7f7df00ad3a0 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7df6200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7df00c5100 con 0x7f7dd8004d40 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7df6200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7df00c5400 con 0x7f7df0158640 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56908/0 (socket says 172.21.15.67:56908) 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 -- 172.21.15.67:0/3648233030 learned_addr learned my addr 172.21.15.67:0/3648233030 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7df4e00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd8004d40 0x7f7df0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7df5800640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 0x7f7df00b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 -- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 msgr2=0x7f7df00b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 0x7f7df00b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 -- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd8004d40 msgr2=0x7f7df0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd8004d40 0x7f7df0158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7defe00640 1 -- 172.21.15.67:0/3648233030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df00adb90 con 0x7f7df00ad3a0 2024-04-16T13:06:27.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.574+0000 7f7df5800640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 0x7f7df00b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:27.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7defe00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e580 tx=0x7f7ddc00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0052e0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ddc018070 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc003810 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df00ade70 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.575+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df0158120 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.576+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df0075bd0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.577+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ddc0039b0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.578+0000 7f7decc00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 0x7f7dd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:27.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.578+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f7ddc08bac0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.579+0000 7f7df4e00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 0x7f7dd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:27.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.580+0000 7f7df4e00640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 0x7f7dd006edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:27.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.583+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ddc059cb0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.834+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7df00b1c70 con 0x7f7df00ad3a0 2024-04-16T13:06:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.836+0000 7f7decc00640 1 -- 172.21.15.67:0/3648233030 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f7ddc0595b0 con 0x7f7df00ad3a0 2024-04-16T13:06:27.838 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:27.838 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2013697614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2013697614},{"type":"v1","addr":"172.21.15.82:6835","nonce":2013697614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2223402768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2223402768},{"type":"v1","addr":"172.21.15.67:6834","nonce":2223402768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1074117415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1074117415},{"type":"v1","addr":"172.21.15.67:6835","nonce":1074117415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:06:23.736265+0000","modified":"2024-04-16T13:06:26.826919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5325":{"gid":5325,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/4271358534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4271358534},{"type":"v1","addr":"172.21.15.82:6837","nonce":4271358534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5325,"qdb_cluster":[5325]},"id":2}]} 2024-04-16T13:06:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 17 2024-04-16T13:06:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 msgr2=0x7f7dd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 0x7f7dd006edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4008040 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 msgr2=0x7f7df0147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00e580 tx=0x7f7ddc00ea40 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 shutdown_connections 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7dd006c8f0 0x7f7dd006edb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7df0158640 0x7f7df00b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7df00ad3a0 0x7f7df0147560 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 --2- 172.21.15.67:0/3648233030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dd8004d40 0x7f7df0158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.839+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 >> 172.21.15.67:0/3648233030 conn(0x7f7df00b2070 msgr2=0x7f7df00c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.840+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 shutdown_connections 2024-04-16T13:06:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:27.840+0000 7f7df6200640 1 -- 172.21.15.67:0/3648233030 wait complete. 2024-04-16T13:06:27.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:28.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.080+0000 7f524f000640 1 Processor -- start 2024-04-16T13:06:28.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.080+0000 7f524f000640 1 -- start start 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524f000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5248161bb0 0x7f5248169490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524f000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52480afbe0 con 0x7f52480aee70 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524f000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52480afec0 con 0x7f5248071e50 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524f000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f52481600c0 con 0x7f5248161bb0 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5248161bb0 0x7f5248169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5248161bb0 0x7f5248169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56910/0 (socket says 172.21.15.67:56910) 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f524d000640 1 -- 172.21.15.67:0/3928654050 learned_addr learned my addr 172.21.15.67:0/3928654050 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:28.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.082+0000 7f5247400640 1 --1- 172.21.15.67:0/3928654050 >> v1:172.21.15.67:6789/0 conn(0x7f52480aee70 0x7f52480af320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44524/0 (socket says 172.21.15.67:44524) 2024-04-16T13:06:28.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.083+0000 7f524d000640 1 -- 172.21.15.67:0/3928654050 >> v1:172.21.15.82:6789/0 conn(0x7f5248071e50 legacy=0x7f5248072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:28.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.083+0000 7f524d000640 1 -- 172.21.15.67:0/3928654050 >> v1:172.21.15.67:6789/0 conn(0x7f52480aee70 legacy=0x7f52480af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.083+0000 7f524d000640 1 -- 172.21.15.67:0/3928654050 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52481603a0 con 0x7f5248161bb0 2024-04-16T13:06:28.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.084+0000 7f524d000640 1 --2- 172.21.15.67:0/3928654050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248161bb0 0x7f5248169490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5240009e50 tx=0x7f524002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f891bb646d0869a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.084+0000 7f5246a00640 1 -- 172.21.15.67:0/3928654050 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524002cb20 con 0x7f5248161bb0 2024-04-16T13:06:28.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.084+0000 7f5246a00640 1 -- 172.21.15.67:0/3928654050 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524002ccc0 con 0x7f5248161bb0 2024-04-16T13:06:28.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.084+0000 7f5246a00640 1 -- 172.21.15.67:0/3928654050 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240034610 con 0x7f5248161bb0 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 -- 172.21.15.67:0/3928654050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248161bb0 msgr2=0x7f5248169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 --2- 172.21.15.67:0/3928654050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248161bb0 0x7f5248169490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5240009e50 tx=0x7f524002bf80 comp rx=0 tx=0).stop 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 -- 172.21.15.67:0/3928654050 shutdown_connections 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 --2- 172.21.15.67:0/3928654050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248161bb0 0x7f5248169490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 -- 172.21.15.67:0/3928654050 >> 172.21.15.67:0/3928654050 conn(0x7f52480b2210 msgr2=0x7f52480b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 -- 172.21.15.67:0/3928654050 shutdown_connections 2024-04-16T13:06:28.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.085+0000 7f524f000640 1 -- 172.21.15.67:0/3928654050 wait complete. 2024-04-16T13:06:28.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.087+0000 7f524f000640 1 Processor -- start 2024-04-16T13:06:28.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.087+0000 7f524f000640 1 -- start start 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 0x7f524806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5248161bb0 0x7f52481441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5248169b50 con 0x7f5248071e50 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52481699d0 con 0x7f52480aee70 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524f000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5248169cd0 con 0x7f5248161bb0 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56912/0 (socket says 172.21.15.67:56912) 2024-04-16T13:06:28.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 -- 172.21.15.67:0/2476879772 learned_addr learned my addr 172.21.15.67:0/2476879772 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:28.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 -- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5248161bb0 msgr2=0x7f52481441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f524d000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5248161bb0 0x7f52481441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5248161bb0 0x7f52481441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247400640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 0x7f524806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.088+0000 7f5247e00640 1 -- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 msgr2=0x7f524806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f5247e00640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 0x7f524806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f5247e00640 1 -- 172.21.15.67:0/2476879772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5248141690 con 0x7f5248071e50 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f5247400640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 0x7f524806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f5247e00640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f523800b420 tx=0x7f523800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238011830 con 0x7f5248071e50 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5238016070 con 0x7f5248071e50 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238011c10 con 0x7f5248071e50 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52480b4700 con 0x7f5248071e50 2024-04-16T13:06:28.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.089+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5248141c10 con 0x7f5248071e50 2024-04-16T13:06:28.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.091+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248075bd0 con 0x7f5248071e50 2024-04-16T13:06:28.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.092+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f523801b460 con 0x7f5248071e50 2024-04-16T13:06:28.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.092+0000 7f523fe00640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 0x7f522806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.093+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f523808b7d0 con 0x7f5248071e50 2024-04-16T13:06:28.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.093+0000 7f5247400640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 0x7f522806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.094+0000 7f5247400640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 0x7f522806edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5248139810 tx=0x7f5234009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.097+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5238020020 con 0x7f5248071e50 2024-04-16T13:06:28.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.304+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f524815f6f0 con 0x7f5248071e50 2024-04-16T13:06:28.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.307+0000 7f523fe00640 1 -- 172.21.15.67:0/2476879772 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16839 (secure 0 0 0) 0x7f5238059a40 con 0x7f5248071e50 2024-04-16T13:06:28.309 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:28.309 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:06:27.305061+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:06:21.935846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T13:06:22.716875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.309+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 msgr2=0x7f522806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.309+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 0x7f522806edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5248139810 tx=0x7f5234009040 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.309+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 msgr2=0x7f524815bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.309+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f523800b420 tx=0x7f523800b8e0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 shutdown_connections 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f522806c8f0 0x7f522806edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5248161bb0 0x7f52481441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52480aee70 0x7f524806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 --2- 172.21.15.67:0/2476879772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5248071e50 0x7f524815bb70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 >> 172.21.15.67:0/2476879772 conn(0x7f52480b2210 msgr2=0x7f524813c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:28.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 shutdown_connections 2024-04-16T13:06:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.310+0000 7f524f000640 1 -- 172.21.15.67:0/2476879772 wait complete. 2024-04-16T13:06:28.335 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-16T13:06:28.335 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.553+0000 7f566de00640 1 Processor -- start 2024-04-16T13:06:28.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.554+0000 7f566de00640 1 -- start start 2024-04-16T13:06:28.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.555+0000 7f566de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f566806d360 0x7f566806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.555+0000 7f566de00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56680d0000 con 0x7f56680d27b0 2024-04-16T13:06:28.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.555+0000 7f566de00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56680d02e0 con 0x7f566815eaa0 2024-04-16T13:06:28.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.555+0000 7f566de00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f566806dd00 con 0x7f566806d360 2024-04-16T13:06:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f566d400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f56680d27b0 0x7f56680d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44526/0 (socket says 172.21.15.67:44526) 2024-04-16T13:06:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f566d400640 1 -- 172.21.15.67:0/1978573687 learned_addr learned my addr 172.21.15.67:0/1978573687 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f5667e00640 1 --2- 172.21.15.67:0/1978573687 >> v2:172.21.15.67:3300/0 conn(0x7f566806d360 0x7f566806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f5667e00640 1 -- 172.21.15.67:0/1978573687 >> v1:172.21.15.82:6789/0 conn(0x7f566815eaa0 legacy=0x7f56680d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f5667e00640 1 -- 172.21.15.67:0/1978573687 >> v1:172.21.15.67:6789/0 conn(0x7f56680d27b0 legacy=0x7f56680d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f5667e00640 1 -- 172.21.15.67:0/1978573687 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56680d05c0 con 0x7f566806d360 2024-04-16T13:06:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.556+0000 7f5667400640 1 -- 172.21.15.67:0/1978573687 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684144815 0 0) 0x7f56680d0000 con 0x7f56680d27b0 2024-04-16T13:06:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.557+0000 7f5667e00640 1 --2- 172.21.15.67:0/1978573687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f566806d360 0x7f566806d7c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56580097a0 tx=0x7f565802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eeed05b45a8c6fc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f5667400640 1 -- 172.21.15.67:0/1978573687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658035020 con 0x7f566806d360 2024-04-16T13:06:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f5667400640 1 -- 172.21.15.67:0/1978573687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5658031830 con 0x7f566806d360 2024-04-16T13:06:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f5667400640 1 -- 172.21.15.67:0/1978573687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658031c00 con 0x7f566806d360 2024-04-16T13:06:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f566de00640 1 -- 172.21.15.67:0/1978573687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f566806d360 msgr2=0x7f566806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f566de00640 1 --2- 172.21.15.67:0/1978573687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f566806d360 0x7f566806d7c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f56580097a0 tx=0x7f565802b8d0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f566de00640 1 -- 172.21.15.67:0/1978573687 shutdown_connections 2024-04-16T13:06:28.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f566de00640 1 --2- 172.21.15.67:0/1978573687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f566806d360 0x7f566806d7c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.558+0000 7f566de00640 1 -- 172.21.15.67:0/1978573687 >> 172.21.15.67:0/1978573687 conn(0x7f566808c000 msgr2=0x7f56680d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:28.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.559+0000 7f566de00640 1 -- 172.21.15.67:0/1978573687 shutdown_connections 2024-04-16T13:06:28.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.559+0000 7f566de00640 1 -- 172.21.15.67:0/1978573687 wait complete. 2024-04-16T13:06:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.560+0000 7f566de00640 1 Processor -- start 2024-04-16T13:06:28.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.560+0000 7f566de00640 1 -- start start 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f566806d360 0x7f5668160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 0x7f56680b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f56680d53f0 con 0x7f56680d27b0 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56680d0c10 con 0x7f566806d360 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.561+0000 7f566de00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f566815ee80 con 0x7f566815eaa0 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56940/0 (socket says 172.21.15.67:56940) 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 -- 172.21.15.67:0/2116203112 learned_addr learned my addr 172.21.15.67:0/2116203112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f566ca00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f566806d360 0x7f5668160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f566d400640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 0x7f56680b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 -- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 msgr2=0x7f56680b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 0x7f56680b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 -- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f566806d360 msgr2=0x7f5668160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f566806d360 0x7f5668160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f5667e00640 1 -- 172.21.15.67:0/2116203112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5668160210 con 0x7f56680d27b0 2024-04-16T13:06:28.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.562+0000 7f566d400640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 0x7f56680b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f5667e00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f56580098c0 tx=0x7f56580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658040070 con 0x7f56680d27b0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5658039a00 con 0x7f56680d27b0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658035040 con 0x7f56680d27b0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56681604f0 con 0x7f56680d27b0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.563+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5668160ab0 con 0x7f56680d27b0 2024-04-16T13:06:28.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.564+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566815ff60 con 0x7f56680d27b0 2024-04-16T13:06:28.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.565+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5658038020 con 0x7f56680d27b0 2024-04-16T13:06:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.566+0000 7f5664c00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 0x7f564c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.566+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f56580ad7d0 con 0x7f56680d27b0 2024-04-16T13:06:28.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.567+0000 7f566ca00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 0x7f564c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:28.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.568+0000 7f566ca00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 0x7f564c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f565c000f60 tx=0x7f565c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:28.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.571+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f565807b9b0 con 0x7f56680d27b0 2024-04-16T13:06:28.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.775+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5668075bd0 con 0x7f564c06c8f0 2024-04-16T13:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.797+0000 7f5664c00640 1 -- 172.21.15.67:0/2116203112 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f5668075bd0 con 0x7f564c06c8f0 2024-04-16T13:06:28.803 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 msgr2=0x7f564c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 0x7f564c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f565c000f60 tx=0x7f565c009040 comp rx=0 tx=0).stop 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 msgr2=0x7f56680cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f56580098c0 tx=0x7f56580046c0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 shutdown_connections 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f564c06c8f0 0x7f564c06edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f566815eaa0 0x7f56680b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56680d27b0 0x7f56680cdc40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 --2- 172.21.15.67:0/2116203112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f566806d360 0x7f5668160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 >> 172.21.15.67:0/2116203112 conn(0x7f566808c000 msgr2=0x7f56680b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 shutdown_connections 2024-04-16T13:06:28.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:28.804+0000 7f566de00640 1 -- 172.21.15.67:0/2116203112 wait complete. 2024-04-16T13:06:28.825 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-16T13:06:28.533214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220712,"kb_used_data":4540,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754008,"statfs":{"total":773094113280,"available":772868104192,"internally_reserved":0,"allocated":4648960,"data_stored":2670303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.261111"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319577+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:24.319577+0000","last_peered":"2024-04-16T13:06:24.319577+0000","last_clean":"2024-04-16T13:06:24.319577+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:24.319577+0000","last_undegraded":"2024-04-16T13:06:24.319577+0000","last_fullsized":"2024-04-16T13:06:24.319577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317204+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:24.317204+0000","last_peered":"2024-04-16T13:06:24.317204+0000","last_clean":"2024-04-16T13:06:24.317204+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:24.317204+0000","last_undegraded":"2024-04-16T13:06:24.317204+0000","last_fullsized":"2024-04-16T13:06:24.317204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.313412+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:24.313412+0000","last_peered":"2024-04-16T13:06:24.313412+0000","last_clean":"2024-04-16T13:06:24.313412+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:24.313412+0000","last_undegraded":"2024-04-16T13:06:24.313412+0000","last_fullsized":"2024-04-16T13:06:24.313412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.325176+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:24.325176+0000","last_peered":"2024-04-16T13:06:24.325176+0000","last_clean":"2024-04-16T13:06:24.325176+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:24.325176+0000","last_undegraded":"2024-04-16T13:06:24.325176+0000","last_fullsized":"2024-04-16T13:06:24.325176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:01.074145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327831+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:24.327831+0000","last_peered":"2024-04-16T13:06:24.327831+0000","last_clean":"2024-04-16T13:06:24.327831+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:24.327831+0000","last_undegraded":"2024-04-16T13:06:24.327831+0000","last_fullsized":"2024-04-16T13:06:24.327831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:57.094337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.318786+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:24.318786+0000","last_peered":"2024-04-16T13:06:24.318786+0000","last_clean":"2024-04-16T13:06:24.318786+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:24.318786+0000","last_undegraded":"2024-04-16T13:06:24.318786+0000","last_fullsized":"2024-04-16T13:06:24.318786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317876+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:24.317876+0000","last_peered":"2024-04-16T13:06:24.317876+0000","last_clean":"2024-04-16T13:06:24.317876+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:24.317876+0000","last_undegraded":"2024-04-16T13:06:24.317876+0000","last_fullsized":"2024-04-16T13:06:24.317876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328989+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:24.328989+0000","last_peered":"2024-04-16T13:06:24.328989+0000","last_clean":"2024-04-16T13:06:24.328989+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:24.328989+0000","last_undegraded":"2024-04-16T13:06:24.328989+0000","last_fullsized":"2024-04-16T13:06:24.328989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323328+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:24.323328+0000","last_peered":"2024-04-16T13:06:24.323328+0000","last_clean":"2024-04-16T13:06:24.323328+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:24.323328+0000","last_undegraded":"2024-04-16T13:06:24.323328+0000","last_fullsized":"2024-04-16T13:06:24.323328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.303132+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:24.303132+0000","last_peered":"2024-04-16T13:06:24.303132+0000","last_clean":"2024-04-16T13:06:24.303132+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:24.303132+0000","last_undegraded":"2024-04-16T13:06:24.303132+0000","last_fullsized":"2024-04-16T13:06:24.303132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327241+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:24.327241+0000","last_peered":"2024-04-16T13:06:24.327241+0000","last_clean":"2024-04-16T13:06:24.327241+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:24.327241+0000","last_undegraded":"2024-04-16T13:06:24.327241+0000","last_fullsized":"2024-04-16T13:06:24.327241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308650+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:24.308650+0000","last_peered":"2024-04-16T13:06:24.308650+0000","last_clean":"2024-04-16T13:06:24.308650+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:24.308650+0000","last_undegraded":"2024-04-16T13:06:24.308650+0000","last_fullsized":"2024-04-16T13:06:24.308650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317350+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:24.317350+0000","last_peered":"2024-04-16T13:06:24.317350+0000","last_clean":"2024-04-16T13:06:24.317350+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:24.317350+0000","last_undegraded":"2024-04-16T13:06:24.317350+0000","last_fullsized":"2024-04-16T13:06:24.317350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333282+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:24.333282+0000","last_peered":"2024-04-16T13:06:24.333282+0000","last_clean":"2024-04-16T13:06:24.333282+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:24.333282+0000","last_undegraded":"2024-04-16T13:06:24.333282+0000","last_fullsized":"2024-04-16T13:06:24.333282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309575+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:24.309575+0000","last_peered":"2024-04-16T13:06:24.309575+0000","last_clean":"2024-04-16T13:06:24.309575+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:24.309575+0000","last_undegraded":"2024-04-16T13:06:24.309575+0000","last_fullsized":"2024-04-16T13:06:24.309575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.304928+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:24.304928+0000","last_peered":"2024-04-16T13:06:24.304928+0000","last_clean":"2024-04-16T13:06:24.304928+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:24.304928+0000","last_undegraded":"2024-04-16T13:06:24.304928+0000","last_fullsized":"2024-04-16T13:06:24.304928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307788+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:24.307788+0000","last_peered":"2024-04-16T13:06:24.307788+0000","last_clean":"2024-04-16T13:06:24.307788+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:24.307788+0000","last_undegraded":"2024-04-16T13:06:24.307788+0000","last_fullsized":"2024-04-16T13:06:24.307788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330427+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:24.330427+0000","last_peered":"2024-04-16T13:06:24.330427+0000","last_clean":"2024-04-16T13:06:24.330427+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:24.330427+0000","last_undegraded":"2024-04-16T13:06:24.330427+0000","last_fullsized":"2024-04-16T13:06:24.330427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:50.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.306891+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:24.306891+0000","last_peered":"2024-04-16T13:06:24.306891+0000","last_clean":"2024-04-16T13:06:24.306891+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:24.306891+0000","last_undegraded":"2024-04-16T13:06:24.306891+0000","last_fullsized":"2024-04-16T13:06:24.306891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:07:43.619103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331248+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:24.331248+0000","last_peered":"2024-04-16T13:06:24.331248+0000","last_clean":"2024-04-16T13:06:24.331248+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:24.331248+0000","last_undegraded":"2024-04-16T13:06:24.331248+0000","last_fullsized":"2024-04-16T13:06:24.331248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:18.191612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309608+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:24.309608+0000","last_peered":"2024-04-16T13:06:24.309608+0000","last_clean":"2024-04-16T13:06:24.309608+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:24.309608+0000","last_undegraded":"2024-04-16T13:06:24.309608+0000","last_fullsized":"2024-04-16T13:06:24.309608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333307+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:24.333307+0000","last_peered":"2024-04-16T13:06:24.333307+0000","last_clean":"2024-04-16T13:06:24.333307+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:24.333307+0000","last_undegraded":"2024-04-16T13:06:24.333307+0000","last_fullsized":"2024-04-16T13:06:24.333307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305858+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:24.305858+0000","last_peered":"2024-04-16T13:06:24.305858+0000","last_clean":"2024-04-16T13:06:24.305858+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:24.305858+0000","last_undegraded":"2024-04-16T13:06:24.305858+0000","last_fullsized":"2024-04-16T13:06:24.305858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.301153+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:24.301153+0000","last_peered":"2024-04-16T13:06:24.301153+0000","last_clean":"2024-04-16T13:06:24.301153+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:24.301153+0000","last_undegraded":"2024-04-16T13:06:24.301153+0000","last_fullsized":"2024-04-16T13:06:24.301153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:55.232028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.318290+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:24.318290+0000","last_peered":"2024-04-16T13:06:24.318290+0000","last_clean":"2024-04-16T13:06:24.318290+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:24.318290+0000","last_undegraded":"2024-04-16T13:06:24.318290+0000","last_fullsized":"2024-04-16T13:06:24.318290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:56.223862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307470+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:24.307470+0000","last_peered":"2024-04-16T13:06:24.307470+0000","last_clean":"2024-04-16T13:06:24.307470+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:24.307470+0000","last_undegraded":"2024-04-16T13:06:24.307470+0000","last_fullsized":"2024-04-16T13:06:24.307470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.315524+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:24.315524+0000","last_peered":"2024-04-16T13:06:24.315524+0000","last_clean":"2024-04-16T13:06:24.315524+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:24.315524+0000","last_undegraded":"2024-04-16T13:06:24.315524+0000","last_fullsized":"2024-04-16T13:06:24.315524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:21.042254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327917+0000","last_change":"2024-04-16T13:06:24.320409+0000","last_active":"2024-04-16T13:06:24.327917+0000","last_peered":"2024-04-16T13:06:24.327917+0000","last_clean":"2024-04-16T13:06:24.327917+0000","last_became_active":"2024-04-16T13:06:24.320144+0000","last_became_peered":"2024-04-16T13:06:24.320144+0000","last_unstale":"2024-04-16T13:06:24.327917+0000","last_undegraded":"2024-04-16T13:06:24.327917+0000","last_fullsized":"2024-04-16T13:06:24.327917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323419+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:24.323419+0000","last_peered":"2024-04-16T13:06:24.323419+0000","last_clean":"2024-04-16T13:06:24.323419+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:24.323419+0000","last_undegraded":"2024-04-16T13:06:24.323419+0000","last_fullsized":"2024-04-16T13:06:24.323419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:44:17.566480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.324802+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:24.324802+0000","last_peered":"2024-04-16T13:06:24.324802+0000","last_clean":"2024-04-16T13:06:24.324802+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:24.324802+0000","last_undegraded":"2024-04-16T13:06:24.324802+0000","last_fullsized":"2024-04-16T13:06:24.324802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:26.743151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305801+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:24.305801+0000","last_peered":"2024-04-16T13:06:24.305801+0000","last_clean":"2024-04-16T13:06:24.305801+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:24.305801+0000","last_undegraded":"2024-04-16T13:06:24.305801+0000","last_fullsized":"2024-04-16T13:06:24.305801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298913+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:24.298913+0000","last_peered":"2024-04-16T13:06:24.298913+0000","last_clean":"2024-04-16T13:06:24.298913+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:24.298913+0000","last_undegraded":"2024-04-16T13:06:24.298913+0000","last_fullsized":"2024-04-16T13:06:24.298913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307873+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:24.307873+0000","last_peered":"2024-04-16T13:06:24.307873+0000","last_clean":"2024-04-16T13:06:24.307873+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:24.307873+0000","last_undegraded":"2024-04-16T13:06:24.307873+0000","last_fullsized":"2024-04-16T13:06:24.307873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333953+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:24.333953+0000","last_peered":"2024-04-16T13:06:24.333953+0000","last_clean":"2024-04-16T13:06:24.333953+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:24.333953+0000","last_undegraded":"2024-04-16T13:06:24.333953+0000","last_fullsized":"2024-04-16T13:06:24.333953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307435+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:24.307435+0000","last_peered":"2024-04-16T13:06:24.307435+0000","last_clean":"2024-04-16T13:06:24.307435+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:24.307435+0000","last_undegraded":"2024-04-16T13:06:24.307435+0000","last_fullsized":"2024-04-16T13:06:24.307435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331979+0000","last_change":"2024-04-16T13:06:23.273252+0000","last_active":"2024-04-16T13:06:24.331979+0000","last_peered":"2024-04-16T13:06:24.331979+0000","last_clean":"2024-04-16T13:06:24.331979+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:24.331979+0000","last_undegraded":"2024-04-16T13:06:24.331979+0000","last_fullsized":"2024-04-16T13:06:24.331979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333045+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:24.333045+0000","last_peered":"2024-04-16T13:06:24.333045+0000","last_clean":"2024-04-16T13:06:24.333045+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:24.333045+0000","last_undegraded":"2024-04-16T13:06:24.333045+0000","last_fullsized":"2024-04-16T13:06:24.333045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334867+0000","last_change":"2024-04-16T13:06:23.272459+0000","last_active":"2024-04-16T13:06:24.334867+0000","last_peered":"2024-04-16T13:06:24.334867+0000","last_clean":"2024-04-16T13:06:24.334867+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:24.334867+0000","last_undegraded":"2024-04-16T13:06:24.334867+0000","last_fullsized":"2024-04-16T13:06:24.334867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323047+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:24.323047+0000","last_peered":"2024-04-16T13:06:24.323047+0000","last_clean":"2024-04-16T13:06:24.323047+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:24.323047+0000","last_undegraded":"2024-04-16T13:06:24.323047+0000","last_fullsized":"2024-04-16T13:06:24.323047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332794+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:24.332794+0000","last_peered":"2024-04-16T13:06:24.332794+0000","last_clean":"2024-04-16T13:06:24.332794+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:24.332794+0000","last_undegraded":"2024-04-16T13:06:24.332794+0000","last_fullsized":"2024-04-16T13:06:24.332794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308391+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:24.308391+0000","last_peered":"2024-04-16T13:06:24.308391+0000","last_clean":"2024-04-16T13:06:24.308391+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:24.308391+0000","last_undegraded":"2024-04-16T13:06:24.308391+0000","last_fullsized":"2024-04-16T13:06:24.308391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328829+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:24.328829+0000","last_peered":"2024-04-16T13:06:24.328829+0000","last_clean":"2024-04-16T13:06:24.328829+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:24.328829+0000","last_undegraded":"2024-04-16T13:06:24.328829+0000","last_fullsized":"2024-04-16T13:06:24.328829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309552+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:24.309552+0000","last_peered":"2024-04-16T13:06:24.309552+0000","last_clean":"2024-04-16T13:06:24.309552+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:24.309552+0000","last_undegraded":"2024-04-16T13:06:24.309552+0000","last_fullsized":"2024-04-16T13:06:24.309552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333890+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:24.333890+0000","last_peered":"2024-04-16T13:06:24.333890+0000","last_clean":"2024-04-16T13:06:24.333890+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:24.333890+0000","last_undegraded":"2024-04-16T13:06:24.333890+0000","last_fullsized":"2024-04-16T13:06:24.333890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323886+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:24.323886+0000","last_peered":"2024-04-16T13:06:24.323886+0000","last_clean":"2024-04-16T13:06:24.323886+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:24.323886+0000","last_undegraded":"2024-04-16T13:06:24.323886+0000","last_fullsized":"2024-04-16T13:06:24.323886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.292061+0000","last_change":"2024-04-16T13:06:23.268772+0000","last_active":"2024-04-16T13:06:24.292061+0000","last_peered":"2024-04-16T13:06:24.292061+0000","last_clean":"2024-04-16T13:06:24.292061+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:24.292061+0000","last_undegraded":"2024-04-16T13:06:24.292061+0000","last_fullsized":"2024-04-16T13:06:24.292061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.326165+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:24.326165+0000","last_peered":"2024-04-16T13:06:24.326165+0000","last_clean":"2024-04-16T13:06:24.326165+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:24.326165+0000","last_undegraded":"2024-04-16T13:06:24.326165+0000","last_fullsized":"2024-04-16T13:06:24.326165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298848+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:24.298848+0000","last_peered":"2024-04-16T13:06:24.298848+0000","last_clean":"2024-04-16T13:06:24.298848+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:24.298848+0000","last_undegraded":"2024-04-16T13:06:24.298848+0000","last_fullsized":"2024-04-16T13:06:24.298848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327881+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:24.327881+0000","last_peered":"2024-04-16T13:06:24.327881+0000","last_clean":"2024-04-16T13:06:24.327881+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:24.327881+0000","last_undegraded":"2024-04-16T13:06:24.327881+0000","last_fullsized":"2024-04-16T13:06:24.327881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:21.042254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309707+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:24.309707+0000","last_peered":"2024-04-16T13:06:24.309707+0000","last_clean":"2024-04-16T13:06:24.309707+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:24.309707+0000","last_undegraded":"2024-04-16T13:06:24.309707+0000","last_fullsized":"2024-04-16T13:06:24.309707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:30.702356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314431+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:24.314431+0000","last_peered":"2024-04-16T13:06:24.314431+0000","last_clean":"2024-04-16T13:06:24.314431+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:24.314431+0000","last_undegraded":"2024-04-16T13:06:24.314431+0000","last_fullsized":"2024-04-16T13:06:24.314431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.283563+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:24.283563+0000","last_peered":"2024-04-16T13:06:24.283563+0000","last_clean":"2024-04-16T13:06:24.283563+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:24.283563+0000","last_undegraded":"2024-04-16T13:06:24.283563+0000","last_fullsized":"2024-04-16T13:06:24.283563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.313354+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:24.313354+0000","last_peered":"2024-04-16T13:06:24.313354+0000","last_clean":"2024-04-16T13:06:24.313354+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:24.313354+0000","last_undegraded":"2024-04-16T13:06:24.313354+0000","last_fullsized":"2024-04-16T13:06:24.313354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330309+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:24.330309+0000","last_peered":"2024-04-16T13:06:24.330309+0000","last_clean":"2024-04-16T13:06:24.330309+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:24.330309+0000","last_undegraded":"2024-04-16T13:06:24.330309+0000","last_fullsized":"2024-04-16T13:06:24.330309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332753+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:24.332753+0000","last_peered":"2024-04-16T13:06:24.332753+0000","last_clean":"2024-04-16T13:06:24.332753+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:24.332753+0000","last_undegraded":"2024-04-16T13:06:24.332753+0000","last_fullsized":"2024-04-16T13:06:24.332753+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333425+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:24.333425+0000","last_peered":"2024-04-16T13:06:24.333425+0000","last_clean":"2024-04-16T13:06:24.333425+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:24.333425+0000","last_undegraded":"2024-04-16T13:06:24.333425+0000","last_fullsized":"2024-04-16T13:06:24.333425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:13.322320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.322629+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:24.322629+0000","last_peered":"2024-04-16T13:06:24.322629+0000","last_clean":"2024-04-16T13:06:24.322629+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:24.322629+0000","last_undegraded":"2024-04-16T13:06:24.322629+0000","last_fullsized":"2024-04-16T13:06:24.322629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328570+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:24.328570+0000","last_peered":"2024-04-16T13:06:24.328570+0000","last_clean":"2024-04-16T13:06:24.328570+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:24.328570+0000","last_undegraded":"2024-04-16T13:06:24.328570+0000","last_fullsized":"2024-04-16T13:06:24.328570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:46.791311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.329655+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:24.329655+0000","last_peered":"2024-04-16T13:06:24.329655+0000","last_clean":"2024-04-16T13:06:24.329655+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:24.329655+0000","last_undegraded":"2024-04-16T13:06:24.329655+0000","last_fullsized":"2024-04-16T13:06:24.329655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:07:29.199088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.290047+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:24.290047+0000","last_peered":"2024-04-16T13:06:24.290047+0000","last_clean":"2024-04-16T13:06:24.290047+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:24.290047+0000","last_undegraded":"2024-04-16T13:06:24.290047+0000","last_fullsized":"2024-04-16T13:06:24.290047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305101+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:24.305101+0000","last_peered":"2024-04-16T13:06:24.305101+0000","last_clean":"2024-04-16T13:06:24.305101+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:24.305101+0000","last_undegraded":"2024-04-16T13:06:24.305101+0000","last_fullsized":"2024-04-16T13:06:24.305101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.296613+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:24.296613+0000","last_peered":"2024-04-16T13:06:24.296613+0000","last_clean":"2024-04-16T13:06:24.296613+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:24.296613+0000","last_undegraded":"2024-04-16T13:06:24.296613+0000","last_fullsized":"2024-04-16T13:06:24.296613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319188+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:24.319188+0000","last_peered":"2024-04-16T13:06:24.319188+0000","last_clean":"2024-04-16T13:06:24.319188+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:24.319188+0000","last_undegraded":"2024-04-16T13:06:24.319188+0000","last_fullsized":"2024-04-16T13:06:24.319188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334969+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:24.334969+0000","last_peered":"2024-04-16T13:06:24.334969+0000","last_clean":"2024-04-16T13:06:24.334969+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:24.334969+0000","last_undegraded":"2024-04-16T13:06:24.334969+0000","last_fullsized":"2024-04-16T13:06:24.334969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323816+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:24.323816+0000","last_peered":"2024-04-16T13:06:24.323816+0000","last_clean":"2024-04-16T13:06:24.323816+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:24.323816+0000","last_undegraded":"2024-04-16T13:06:24.323816+0000","last_fullsized":"2024-04-16T13:06:24.323816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328805+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:24.328805+0000","last_peered":"2024-04-16T13:06:24.328805+0000","last_clean":"2024-04-16T13:06:24.328805+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:24.328805+0000","last_undegraded":"2024-04-16T13:06:24.328805+0000","last_fullsized":"2024-04-16T13:06:24.328805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309763+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:24.309763+0000","last_peered":"2024-04-16T13:06:24.309763+0000","last_clean":"2024-04-16T13:06:24.309763+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:24.309763+0000","last_undegraded":"2024-04-16T13:06:24.309763+0000","last_fullsized":"2024-04-16T13:06:24.309763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331959+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:24.331959+0000","last_peered":"2024-04-16T13:06:24.331959+0000","last_clean":"2024-04-16T13:06:24.331959+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:24.331959+0000","last_undegraded":"2024-04-16T13:06:24.331959+0000","last_fullsized":"2024-04-16T13:06:24.331959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334641+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:24.334641+0000","last_peered":"2024-04-16T13:06:24.334641+0000","last_clean":"2024-04-16T13:06:24.334641+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:24.334641+0000","last_undegraded":"2024-04-16T13:06:24.334641+0000","last_fullsized":"2024-04-16T13:06:24.334641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332718+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:24.332718+0000","last_peered":"2024-04-16T13:06:24.332718+0000","last_clean":"2024-04-16T13:06:24.332718+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:24.332718+0000","last_undegraded":"2024-04-16T13:06:24.332718+0000","last_fullsized":"2024-04-16T13:06:24.332718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:14.630151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.325097+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:24.325097+0000","last_peered":"2024-04-16T13:06:24.325097+0000","last_clean":"2024-04-16T13:06:24.325097+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:24.325097+0000","last_undegraded":"2024-04-16T13:06:24.325097+0000","last_fullsized":"2024-04-16T13:06:24.325097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:49.204869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.290161+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:24.290161+0000","last_peered":"2024-04-16T13:06:24.290161+0000","last_clean":"2024-04-16T13:06:24.290161+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:24.290161+0000","last_undegraded":"2024-04-16T13:06:24.290161+0000","last_fullsized":"2024-04-16T13:06:24.290161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305740+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:24.305740+0000","last_peered":"2024-04-16T13:06:24.305740+0000","last_clean":"2024-04-16T13:06:24.305740+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:24.305740+0000","last_undegraded":"2024-04-16T13:06:24.305740+0000","last_fullsized":"2024-04-16T13:06:24.305740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328950+0000","last_change":"2024-04-16T13:06:23.268372+0000","last_active":"2024-04-16T13:06:24.328950+0000","last_peered":"2024-04-16T13:06:24.328950+0000","last_clean":"2024-04-16T13:06:24.328950+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:24.328950+0000","last_undegraded":"2024-04-16T13:06:24.328950+0000","last_fullsized":"2024-04-16T13:06:24.328950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:12:28.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319779+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:24.319779+0000","last_peered":"2024-04-16T13:06:24.319779+0000","last_clean":"2024-04-16T13:06:24.319779+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:24.319779+0000","last_undegraded":"2024-04-16T13:06:24.319779+0000","last_fullsized":"2024-04-16T13:06:24.319779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275441+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:24.275441+0000","last_peered":"2024-04-16T13:06:24.275441+0000","last_clean":"2024-04-16T13:06:24.275441+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:24.275441+0000","last_undegraded":"2024-04-16T13:06:24.275441+0000","last_fullsized":"2024-04-16T13:06:24.275441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:46:00.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319395+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:24.319395+0000","last_peered":"2024-04-16T13:06:24.319395+0000","last_clean":"2024-04-16T13:06:24.319395+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:24.319395+0000","last_undegraded":"2024-04-16T13:06:24.319395+0000","last_fullsized":"2024-04-16T13:06:24.319395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.284177+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:24.284177+0000","last_peered":"2024-04-16T13:06:24.284177+0000","last_clean":"2024-04-16T13:06:24.284177+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:24.284177+0000","last_undegraded":"2024-04-16T13:06:24.284177+0000","last_fullsized":"2024-04-16T13:06:24.284177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319206+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:24.319206+0000","last_peered":"2024-04-16T13:06:24.319206+0000","last_clean":"2024-04-16T13:06:24.319206+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:24.319206+0000","last_undegraded":"2024-04-16T13:06:24.319206+0000","last_fullsized":"2024-04-16T13:06:24.319206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275073+0000","last_change":"2024-04-16T13:06:23.263252+0000","last_active":"2024-04-16T13:06:24.275073+0000","last_peered":"2024-04-16T13:06:24.275073+0000","last_clean":"2024-04-16T13:06:24.275073+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:24.275073+0000","last_undegraded":"2024-04-16T13:06:24.275073+0000","last_fullsized":"2024-04-16T13:06:24.275073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:57:38.175317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307353+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:24.307353+0000","last_peered":"2024-04-16T13:06:24.307353+0000","last_clean":"2024-04-16T13:06:24.307353+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:24.307353+0000","last_undegraded":"2024-04-16T13:06:24.307353+0000","last_fullsized":"2024-04-16T13:06:24.307353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330308+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:24.330308+0000","last_peered":"2024-04-16T13:06:24.330308+0000","last_clean":"2024-04-16T13:06:24.330308+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:24.330308+0000","last_undegraded":"2024-04-16T13:06:24.330308+0000","last_fullsized":"2024-04-16T13:06:24.330308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314401+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:24.314401+0000","last_peered":"2024-04-16T13:06:24.314401+0000","last_clean":"2024-04-16T13:06:24.314401+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:24.314401+0000","last_undegraded":"2024-04-16T13:06:24.314401+0000","last_fullsized":"2024-04-16T13:06:24.314401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275772+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:24.275772+0000","last_peered":"2024-04-16T13:06:24.275772+0000","last_clean":"2024-04-16T13:06:24.275772+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:24.275772+0000","last_undegraded":"2024-04-16T13:06:24.275772+0000","last_fullsized":"2024-04-16T13:06:24.275772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:33.550187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328907+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:24.328907+0000","last_peered":"2024-04-16T13:06:24.328907+0000","last_clean":"2024-04-16T13:06:24.328907+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:24.328907+0000","last_undegraded":"2024-04-16T13:06:24.328907+0000","last_fullsized":"2024-04-16T13:06:24.328907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298990+0000","last_change":"2024-04-16T13:06:23.265745+0000","last_active":"2024-04-16T13:06:24.298990+0000","last_peered":"2024-04-16T13:06:24.298990+0000","last_clean":"2024-04-16T13:06:24.298990+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:24.298990+0000","last_undegraded":"2024-04-16T13:06:24.298990+0000","last_fullsized":"2024-04-16T13:06:24.298990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.326374+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:24.326374+0000","last_peered":"2024-04-16T13:06:24.326374+0000","last_clean":"2024-04-16T13:06:24.326374+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:24.326374+0000","last_undegraded":"2024-04-16T13:06:24.326374+0000","last_fullsized":"2024-04-16T13:06:24.326374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298407+0000","last_change":"2024-04-16T13:06:23.279016+0000","last_active":"2024-04-16T13:06:24.298407+0000","last_peered":"2024-04-16T13:06:24.298407+0000","last_clean":"2024-04-16T13:06:24.298407+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:24.298407+0000","last_undegraded":"2024-04-16T13:06:24.298407+0000","last_fullsized":"2024-04-16T13:06:24.298407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319460+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:24.319460+0000","last_peered":"2024-04-16T13:06:24.319460+0000","last_clean":"2024-04-16T13:06:24.319460+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:24.319460+0000","last_undegraded":"2024-04-16T13:06:24.319460+0000","last_fullsized":"2024-04-16T13:06:24.319460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.310875+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:24.310875+0000","last_peered":"2024-04-16T13:06:24.310875+0000","last_clean":"2024-04-16T13:06:24.310875+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:24.310875+0000","last_undegraded":"2024-04-16T13:06:24.310875+0000","last_fullsized":"2024-04-16T13:06:24.310875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319811+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:24.319811+0000","last_peered":"2024-04-16T13:06:24.319811+0000","last_clean":"2024-04-16T13:06:24.319811+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:24.319811+0000","last_undegraded":"2024-04-16T13:06:24.319811+0000","last_fullsized":"2024-04-16T13:06:24.319811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.297988+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:24.297988+0000","last_peered":"2024-04-16T13:06:24.297988+0000","last_clean":"2024-04-16T13:06:24.297988+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:24.297988+0000","last_undegraded":"2024-04-16T13:06:24.297988+0000","last_fullsized":"2024-04-16T13:06:24.297988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314467+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:24.314467+0000","last_peered":"2024-04-16T13:06:24.314467+0000","last_clean":"2024-04-16T13:06:24.314467+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:24.314467+0000","last_undegraded":"2024-04-16T13:06:24.314467+0000","last_fullsized":"2024-04-16T13:06:24.314467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308430+0000","last_change":"2024-04-16T13:06:23.261663+0000","last_active":"2024-04-16T13:06:24.308430+0000","last_peered":"2024-04-16T13:06:24.308430+0000","last_clean":"2024-04-16T13:06:24.308430+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:24.308430+0000","last_undegraded":"2024-04-16T13:06:24.308430+0000","last_fullsized":"2024-04-16T13:06:24.308430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:14.752238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327377+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:24.327377+0000","last_peered":"2024-04-16T13:06:24.327377+0000","last_clean":"2024-04-16T13:06:24.327377+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:24.327377+0000","last_undegraded":"2024-04-16T13:06:24.327377+0000","last_fullsized":"2024-04-16T13:06:24.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.287149+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:24.287149+0000","last_peered":"2024-04-16T13:06:24.287149+0000","last_clean":"2024-04-16T13:06:24.287149+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:24.287149+0000","last_undegraded":"2024-04-16T13:06:24.287149+0000","last_fullsized":"2024-04-16T13:06:24.287149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.284210+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:24.284210+0000","last_peered":"2024-04-16T13:06:24.284210+0000","last_clean":"2024-04-16T13:06:24.284210+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:24.284210+0000","last_undegraded":"2024-04-16T13:06:24.284210+0000","last_fullsized":"2024-04-16T13:06:24.284210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":782515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":190465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":190465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":773666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:28.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:29.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.093+0000 7f3faf200640 1 Processor -- start 2024-04-16T13:06:29.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.094+0000 7f3faf200640 1 -- start start 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3faf200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fb015eaa0 0x7f3fb00d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3faf200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb00d5220 0x7f3fb006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3faf200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb00d0000 con 0x7f3fb006d8a0 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3faf200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb00d0c10 con 0x7f3fb015eaa0 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3faf200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb00d02e0 con 0x7f3fb00d5220 2024-04-16T13:06:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3fade00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fb015eaa0 0x7f3fb00d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.095+0000 7f3fae800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3fb006d8a0 0x7f3fb00d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44540/0 (socket says 172.21.15.67:44540) 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fae800640 1 -- 172.21.15.67:0/445274187 learned_addr learned my addr 172.21.15.67:0/445274187 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fad400640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb00d5220 0x7f3fb006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fade00640 1 -- 172.21.15.67:0/445274187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb00d5220 msgr2=0x7f3fb006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fade00640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb00d5220 0x7f3fb006d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fade00640 1 -- 172.21.15.67:0/445274187 >> v1:172.21.15.67:6789/0 conn(0x7f3fb006d8a0 legacy=0x7f3fb00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3faca00640 1 -- 172.21.15.67:0/445274187 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883288058 0 0) 0x7f3fb00d0000 con 0x7f3fb006d8a0 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.096+0000 7f3fade00640 1 -- 172.21.15.67:0/445274187 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb00d05c0 con 0x7f3fb015eaa0 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.097+0000 7f3fade00640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb015eaa0 0x7f3fb00d4ce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009d90 tx=0x7f3fa002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538e19535e0a68f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.097+0000 7f3faca00640 1 -- 172.21.15.67:0/445274187 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0039070 con 0x7f3fb015eaa0 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.097+0000 7f3faca00640 1 -- 172.21.15.67:0/445274187 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa002cbc0 con 0x7f3fb015eaa0 2024-04-16T13:06:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.097+0000 7f3faca00640 1 -- 172.21.15.67:0/445274187 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0034440 con 0x7f3fb015eaa0 2024-04-16T13:06:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 -- 172.21.15.67:0/445274187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb015eaa0 msgr2=0x7f3fb00d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb015eaa0 0x7f3fb00d4ce0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009d90 tx=0x7f3fa002be10 comp rx=0 tx=0).stop 2024-04-16T13:06:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 -- 172.21.15.67:0/445274187 shutdown_connections 2024-04-16T13:06:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb00d5220 0x7f3fb006d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 --2- 172.21.15.67:0/445274187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb015eaa0 0x7f3fb00d4ce0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 -- 172.21.15.67:0/445274187 >> 172.21.15.67:0/445274187 conn(0x7f3fb008c000 msgr2=0x7f3fb00d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 -- 172.21.15.67:0/445274187 shutdown_connections 2024-04-16T13:06:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.098+0000 7f3faf200640 1 -- 172.21.15.67:0/445274187 wait complete. 2024-04-16T13:06:29.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.100+0000 7f3faf200640 1 Processor -- start 2024-04-16T13:06:29.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.100+0000 7f3faf200640 1 -- start start 2024-04-16T13:06:29.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fb006d8a0 0x7f3fb00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb015eaa0 0x7f3fb00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb006ceb0 con 0x7f3fb00d5220 2024-04-16T13:06:29.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb015ee80 con 0x7f3fb006d8a0 2024-04-16T13:06:29.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.101+0000 7f3faf200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb00d37c0 con 0x7f3fb015eaa0 2024-04-16T13:06:29.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56962/0 (socket says 172.21.15.67:56962) 2024-04-16T13:06:29.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 -- 172.21.15.67:0/86325219 learned_addr learned my addr 172.21.15.67:0/86325219 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fade00640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fb006d8a0 0x7f3fb00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fae800640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb015eaa0 0x7f3fb00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 -- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb015eaa0 msgr2=0x7f3fb00b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb015eaa0 0x7f3fb00b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 -- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fb006d8a0 msgr2=0x7f3fb00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fb006d8a0 0x7f3fb00ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 -- 172.21.15.67:0/86325219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb00ccfd0 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.102+0000 7f3fad400640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c7f0 tx=0x7f3f9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.103+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98015070 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.103+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f98004220 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.103+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb00cd270 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.103+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007620 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.103+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb00cd830 con 0x7f3fb00d5220 2024-04-16T13:06:29.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.104+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb0075bd0 con 0x7f3fb00d5220 2024-04-16T13:06:29.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.105+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f980079d0 con 0x7f3fb00d5220 2024-04-16T13:06:29.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.106+0000 7f3fa6000640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.107+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f3f9808c170 con 0x7f3fb00d5220 2024-04-16T13:06:29.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.107+0000 7f3fade00640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.108+0000 7f3fade00640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.111+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f9805a350 con 0x7f3fb00d5220 2024-04-16T13:06:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.313+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fb00b4450 con 0x7f3f8c06c8f0 2024-04-16T13:06:29.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.333+0000 7f3fa6000640 1 -- 172.21.15.67:0/86325219 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f3fb00b4450 con 0x7f3f8c06c8f0 2024-04-16T13:06:29.338 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:29.339 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.338+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 msgr2=0x7f3f8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.338+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036000 tx=0x7f3fa0030000 comp rx=0 tx=0).stop 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.338+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 msgr2=0x7f3fb00b7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.338+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c7f0 tx=0x7f3f9800ccb0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 shutdown_connections 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3f8c06c8f0 0x7f3f8c06edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3fb015eaa0 0x7f3fb00b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fb00d5220 0x7f3fb00b7390 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 --2- 172.21.15.67:0/86325219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fb006d8a0 0x7f3fb00ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 >> 172.21.15.67:0/86325219 conn(0x7f3fb008c000 msgr2=0x7f3fb00b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 shutdown_connections 2024-04-16T13:06:29.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.339+0000 7f3faf200640 1 -- 172.21.15.67:0/86325219 wait complete. 2024-04-16T13:06:29.362 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-16T13:06:28.533214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220712,"kb_used_data":4540,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754008,"statfs":{"total":773094113280,"available":772868104192,"internally_reserved":0,"allocated":4648960,"data_stored":2670303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.261111"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319577+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:24.319577+0000","last_peered":"2024-04-16T13:06:24.319577+0000","last_clean":"2024-04-16T13:06:24.319577+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:24.319577+0000","last_undegraded":"2024-04-16T13:06:24.319577+0000","last_fullsized":"2024-04-16T13:06:24.319577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317204+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:24.317204+0000","last_peered":"2024-04-16T13:06:24.317204+0000","last_clean":"2024-04-16T13:06:24.317204+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:24.317204+0000","last_undegraded":"2024-04-16T13:06:24.317204+0000","last_fullsized":"2024-04-16T13:06:24.317204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.313412+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:24.313412+0000","last_peered":"2024-04-16T13:06:24.313412+0000","last_clean":"2024-04-16T13:06:24.313412+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:24.313412+0000","last_undegraded":"2024-04-16T13:06:24.313412+0000","last_fullsized":"2024-04-16T13:06:24.313412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.325176+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:24.325176+0000","last_peered":"2024-04-16T13:06:24.325176+0000","last_clean":"2024-04-16T13:06:24.325176+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:24.325176+0000","last_undegraded":"2024-04-16T13:06:24.325176+0000","last_fullsized":"2024-04-16T13:06:24.325176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:01.074145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327831+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:24.327831+0000","last_peered":"2024-04-16T13:06:24.327831+0000","last_clean":"2024-04-16T13:06:24.327831+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:24.327831+0000","last_undegraded":"2024-04-16T13:06:24.327831+0000","last_fullsized":"2024-04-16T13:06:24.327831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:57.094337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.318786+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:24.318786+0000","last_peered":"2024-04-16T13:06:24.318786+0000","last_clean":"2024-04-16T13:06:24.318786+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:24.318786+0000","last_undegraded":"2024-04-16T13:06:24.318786+0000","last_fullsized":"2024-04-16T13:06:24.318786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317876+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:24.317876+0000","last_peered":"2024-04-16T13:06:24.317876+0000","last_clean":"2024-04-16T13:06:24.317876+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:24.317876+0000","last_undegraded":"2024-04-16T13:06:24.317876+0000","last_fullsized":"2024-04-16T13:06:24.317876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328989+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:24.328989+0000","last_peered":"2024-04-16T13:06:24.328989+0000","last_clean":"2024-04-16T13:06:24.328989+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:24.328989+0000","last_undegraded":"2024-04-16T13:06:24.328989+0000","last_fullsized":"2024-04-16T13:06:24.328989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323328+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:24.323328+0000","last_peered":"2024-04-16T13:06:24.323328+0000","last_clean":"2024-04-16T13:06:24.323328+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:24.323328+0000","last_undegraded":"2024-04-16T13:06:24.323328+0000","last_fullsized":"2024-04-16T13:06:24.323328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.303132+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:24.303132+0000","last_peered":"2024-04-16T13:06:24.303132+0000","last_clean":"2024-04-16T13:06:24.303132+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:24.303132+0000","last_undegraded":"2024-04-16T13:06:24.303132+0000","last_fullsized":"2024-04-16T13:06:24.303132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327241+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:24.327241+0000","last_peered":"2024-04-16T13:06:24.327241+0000","last_clean":"2024-04-16T13:06:24.327241+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:24.327241+0000","last_undegraded":"2024-04-16T13:06:24.327241+0000","last_fullsized":"2024-04-16T13:06:24.327241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308650+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:24.308650+0000","last_peered":"2024-04-16T13:06:24.308650+0000","last_clean":"2024-04-16T13:06:24.308650+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:24.308650+0000","last_undegraded":"2024-04-16T13:06:24.308650+0000","last_fullsized":"2024-04-16T13:06:24.308650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.317350+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:24.317350+0000","last_peered":"2024-04-16T13:06:24.317350+0000","last_clean":"2024-04-16T13:06:24.317350+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:24.317350+0000","last_undegraded":"2024-04-16T13:06:24.317350+0000","last_fullsized":"2024-04-16T13:06:24.317350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333282+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:24.333282+0000","last_peered":"2024-04-16T13:06:24.333282+0000","last_clean":"2024-04-16T13:06:24.333282+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:24.333282+0000","last_undegraded":"2024-04-16T13:06:24.333282+0000","last_fullsized":"2024-04-16T13:06:24.333282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309575+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:24.309575+0000","last_peered":"2024-04-16T13:06:24.309575+0000","last_clean":"2024-04-16T13:06:24.309575+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:24.309575+0000","last_undegraded":"2024-04-16T13:06:24.309575+0000","last_fullsized":"2024-04-16T13:06:24.309575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.304928+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:24.304928+0000","last_peered":"2024-04-16T13:06:24.304928+0000","last_clean":"2024-04-16T13:06:24.304928+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:24.304928+0000","last_undegraded":"2024-04-16T13:06:24.304928+0000","last_fullsized":"2024-04-16T13:06:24.304928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307788+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:24.307788+0000","last_peered":"2024-04-16T13:06:24.307788+0000","last_clean":"2024-04-16T13:06:24.307788+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:24.307788+0000","last_undegraded":"2024-04-16T13:06:24.307788+0000","last_fullsized":"2024-04-16T13:06:24.307788+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330427+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:24.330427+0000","last_peered":"2024-04-16T13:06:24.330427+0000","last_clean":"2024-04-16T13:06:24.330427+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:24.330427+0000","last_undegraded":"2024-04-16T13:06:24.330427+0000","last_fullsized":"2024-04-16T13:06:24.330427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:50.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.306891+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:24.306891+0000","last_peered":"2024-04-16T13:06:24.306891+0000","last_clean":"2024-04-16T13:06:24.306891+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:24.306891+0000","last_undegraded":"2024-04-16T13:06:24.306891+0000","last_fullsized":"2024-04-16T13:06:24.306891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:07:43.619103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331248+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:24.331248+0000","last_peered":"2024-04-16T13:06:24.331248+0000","last_clean":"2024-04-16T13:06:24.331248+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:24.331248+0000","last_undegraded":"2024-04-16T13:06:24.331248+0000","last_fullsized":"2024-04-16T13:06:24.331248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:18.191612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309608+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:24.309608+0000","last_peered":"2024-04-16T13:06:24.309608+0000","last_clean":"2024-04-16T13:06:24.309608+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:24.309608+0000","last_undegraded":"2024-04-16T13:06:24.309608+0000","last_fullsized":"2024-04-16T13:06:24.309608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333307+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:24.333307+0000","last_peered":"2024-04-16T13:06:24.333307+0000","last_clean":"2024-04-16T13:06:24.333307+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:24.333307+0000","last_undegraded":"2024-04-16T13:06:24.333307+0000","last_fullsized":"2024-04-16T13:06:24.333307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305858+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:24.305858+0000","last_peered":"2024-04-16T13:06:24.305858+0000","last_clean":"2024-04-16T13:06:24.305858+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:24.305858+0000","last_undegraded":"2024-04-16T13:06:24.305858+0000","last_fullsized":"2024-04-16T13:06:24.305858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.301153+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:24.301153+0000","last_peered":"2024-04-16T13:06:24.301153+0000","last_clean":"2024-04-16T13:06:24.301153+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:24.301153+0000","last_undegraded":"2024-04-16T13:06:24.301153+0000","last_fullsized":"2024-04-16T13:06:24.301153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:55.232028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.318290+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:24.318290+0000","last_peered":"2024-04-16T13:06:24.318290+0000","last_clean":"2024-04-16T13:06:24.318290+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:24.318290+0000","last_undegraded":"2024-04-16T13:06:24.318290+0000","last_fullsized":"2024-04-16T13:06:24.318290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:56.223862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307470+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:24.307470+0000","last_peered":"2024-04-16T13:06:24.307470+0000","last_clean":"2024-04-16T13:06:24.307470+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:24.307470+0000","last_undegraded":"2024-04-16T13:06:24.307470+0000","last_fullsized":"2024-04-16T13:06:24.307470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.315524+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:24.315524+0000","last_peered":"2024-04-16T13:06:24.315524+0000","last_clean":"2024-04-16T13:06:24.315524+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:24.315524+0000","last_undegraded":"2024-04-16T13:06:24.315524+0000","last_fullsized":"2024-04-16T13:06:24.315524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:21.042254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327917+0000","last_change":"2024-04-16T13:06:24.320409+0000","last_active":"2024-04-16T13:06:24.327917+0000","last_peered":"2024-04-16T13:06:24.327917+0000","last_clean":"2024-04-16T13:06:24.327917+0000","last_became_active":"2024-04-16T13:06:24.320144+0000","last_became_peered":"2024-04-16T13:06:24.320144+0000","last_unstale":"2024-04-16T13:06:24.327917+0000","last_undegraded":"2024-04-16T13:06:24.327917+0000","last_fullsized":"2024-04-16T13:06:24.327917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323419+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:24.323419+0000","last_peered":"2024-04-16T13:06:24.323419+0000","last_clean":"2024-04-16T13:06:24.323419+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:24.323419+0000","last_undegraded":"2024-04-16T13:06:24.323419+0000","last_fullsized":"2024-04-16T13:06:24.323419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:44:17.566480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.324802+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:24.324802+0000","last_peered":"2024-04-16T13:06:24.324802+0000","last_clean":"2024-04-16T13:06:24.324802+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:24.324802+0000","last_undegraded":"2024-04-16T13:06:24.324802+0000","last_fullsized":"2024-04-16T13:06:24.324802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:26.743151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305801+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:24.305801+0000","last_peered":"2024-04-16T13:06:24.305801+0000","last_clean":"2024-04-16T13:06:24.305801+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:24.305801+0000","last_undegraded":"2024-04-16T13:06:24.305801+0000","last_fullsized":"2024-04-16T13:06:24.305801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298913+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:24.298913+0000","last_peered":"2024-04-16T13:06:24.298913+0000","last_clean":"2024-04-16T13:06:24.298913+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:24.298913+0000","last_undegraded":"2024-04-16T13:06:24.298913+0000","last_fullsized":"2024-04-16T13:06:24.298913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307873+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:24.307873+0000","last_peered":"2024-04-16T13:06:24.307873+0000","last_clean":"2024-04-16T13:06:24.307873+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:24.307873+0000","last_undegraded":"2024-04-16T13:06:24.307873+0000","last_fullsized":"2024-04-16T13:06:24.307873+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333953+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:24.333953+0000","last_peered":"2024-04-16T13:06:24.333953+0000","last_clean":"2024-04-16T13:06:24.333953+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:24.333953+0000","last_undegraded":"2024-04-16T13:06:24.333953+0000","last_fullsized":"2024-04-16T13:06:24.333953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307435+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:24.307435+0000","last_peered":"2024-04-16T13:06:24.307435+0000","last_clean":"2024-04-16T13:06:24.307435+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:24.307435+0000","last_undegraded":"2024-04-16T13:06:24.307435+0000","last_fullsized":"2024-04-16T13:06:24.307435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331979+0000","last_change":"2024-04-16T13:06:23.273252+0000","last_active":"2024-04-16T13:06:24.331979+0000","last_peered":"2024-04-16T13:06:24.331979+0000","last_clean":"2024-04-16T13:06:24.331979+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:24.331979+0000","last_undegraded":"2024-04-16T13:06:24.331979+0000","last_fullsized":"2024-04-16T13:06:24.331979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333045+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:24.333045+0000","last_peered":"2024-04-16T13:06:24.333045+0000","last_clean":"2024-04-16T13:06:24.333045+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:24.333045+0000","last_undegraded":"2024-04-16T13:06:24.333045+0000","last_fullsized":"2024-04-16T13:06:24.333045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334867+0000","last_change":"2024-04-16T13:06:23.272459+0000","last_active":"2024-04-16T13:06:24.334867+0000","last_peered":"2024-04-16T13:06:24.334867+0000","last_clean":"2024-04-16T13:06:24.334867+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:24.334867+0000","last_undegraded":"2024-04-16T13:06:24.334867+0000","last_fullsized":"2024-04-16T13:06:24.334867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323047+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:24.323047+0000","last_peered":"2024-04-16T13:06:24.323047+0000","last_clean":"2024-04-16T13:06:24.323047+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:24.323047+0000","last_undegraded":"2024-04-16T13:06:24.323047+0000","last_fullsized":"2024-04-16T13:06:24.323047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332794+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:24.332794+0000","last_peered":"2024-04-16T13:06:24.332794+0000","last_clean":"2024-04-16T13:06:24.332794+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:24.332794+0000","last_undegraded":"2024-04-16T13:06:24.332794+0000","last_fullsized":"2024-04-16T13:06:24.332794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308391+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:24.308391+0000","last_peered":"2024-04-16T13:06:24.308391+0000","last_clean":"2024-04-16T13:06:24.308391+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:24.308391+0000","last_undegraded":"2024-04-16T13:06:24.308391+0000","last_fullsized":"2024-04-16T13:06:24.308391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328829+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:24.328829+0000","last_peered":"2024-04-16T13:06:24.328829+0000","last_clean":"2024-04-16T13:06:24.328829+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:24.328829+0000","last_undegraded":"2024-04-16T13:06:24.328829+0000","last_fullsized":"2024-04-16T13:06:24.328829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309552+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:24.309552+0000","last_peered":"2024-04-16T13:06:24.309552+0000","last_clean":"2024-04-16T13:06:24.309552+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:24.309552+0000","last_undegraded":"2024-04-16T13:06:24.309552+0000","last_fullsized":"2024-04-16T13:06:24.309552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333890+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:24.333890+0000","last_peered":"2024-04-16T13:06:24.333890+0000","last_clean":"2024-04-16T13:06:24.333890+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:24.333890+0000","last_undegraded":"2024-04-16T13:06:24.333890+0000","last_fullsized":"2024-04-16T13:06:24.333890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323886+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:24.323886+0000","last_peered":"2024-04-16T13:06:24.323886+0000","last_clean":"2024-04-16T13:06:24.323886+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:24.323886+0000","last_undegraded":"2024-04-16T13:06:24.323886+0000","last_fullsized":"2024-04-16T13:06:24.323886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.292061+0000","last_change":"2024-04-16T13:06:23.268772+0000","last_active":"2024-04-16T13:06:24.292061+0000","last_peered":"2024-04-16T13:06:24.292061+0000","last_clean":"2024-04-16T13:06:24.292061+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:24.292061+0000","last_undegraded":"2024-04-16T13:06:24.292061+0000","last_fullsized":"2024-04-16T13:06:24.292061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.326165+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:24.326165+0000","last_peered":"2024-04-16T13:06:24.326165+0000","last_clean":"2024-04-16T13:06:24.326165+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:24.326165+0000","last_undegraded":"2024-04-16T13:06:24.326165+0000","last_fullsized":"2024-04-16T13:06:24.326165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298848+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:24.298848+0000","last_peered":"2024-04-16T13:06:24.298848+0000","last_clean":"2024-04-16T13:06:24.298848+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:24.298848+0000","last_undegraded":"2024-04-16T13:06:24.298848+0000","last_fullsized":"2024-04-16T13:06:24.298848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327881+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:24.327881+0000","last_peered":"2024-04-16T13:06:24.327881+0000","last_clean":"2024-04-16T13:06:24.327881+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:24.327881+0000","last_undegraded":"2024-04-16T13:06:24.327881+0000","last_fullsized":"2024-04-16T13:06:24.327881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:21.042254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309707+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:24.309707+0000","last_peered":"2024-04-16T13:06:24.309707+0000","last_clean":"2024-04-16T13:06:24.309707+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:24.309707+0000","last_undegraded":"2024-04-16T13:06:24.309707+0000","last_fullsized":"2024-04-16T13:06:24.309707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:30.702356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314431+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:24.314431+0000","last_peered":"2024-04-16T13:06:24.314431+0000","last_clean":"2024-04-16T13:06:24.314431+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:24.314431+0000","last_undegraded":"2024-04-16T13:06:24.314431+0000","last_fullsized":"2024-04-16T13:06:24.314431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.283563+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:24.283563+0000","last_peered":"2024-04-16T13:06:24.283563+0000","last_clean":"2024-04-16T13:06:24.283563+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:24.283563+0000","last_undegraded":"2024-04-16T13:06:24.283563+0000","last_fullsized":"2024-04-16T13:06:24.283563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.313354+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:24.313354+0000","last_peered":"2024-04-16T13:06:24.313354+0000","last_clean":"2024-04-16T13:06:24.313354+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:24.313354+0000","last_undegraded":"2024-04-16T13:06:24.313354+0000","last_fullsized":"2024-04-16T13:06:24.313354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330309+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:24.330309+0000","last_peered":"2024-04-16T13:06:24.330309+0000","last_clean":"2024-04-16T13:06:24.330309+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:24.330309+0000","last_undegraded":"2024-04-16T13:06:24.330309+0000","last_fullsized":"2024-04-16T13:06:24.330309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332753+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:24.332753+0000","last_peered":"2024-04-16T13:06:24.332753+0000","last_clean":"2024-04-16T13:06:24.332753+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:24.332753+0000","last_undegraded":"2024-04-16T13:06:24.332753+0000","last_fullsized":"2024-04-16T13:06:24.332753+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.333425+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:24.333425+0000","last_peered":"2024-04-16T13:06:24.333425+0000","last_clean":"2024-04-16T13:06:24.333425+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:24.333425+0000","last_undegraded":"2024-04-16T13:06:24.333425+0000","last_fullsized":"2024-04-16T13:06:24.333425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:13.322320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.322629+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:24.322629+0000","last_peered":"2024-04-16T13:06:24.322629+0000","last_clean":"2024-04-16T13:06:24.322629+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:24.322629+0000","last_undegraded":"2024-04-16T13:06:24.322629+0000","last_fullsized":"2024-04-16T13:06:24.322629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328570+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:24.328570+0000","last_peered":"2024-04-16T13:06:24.328570+0000","last_clean":"2024-04-16T13:06:24.328570+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:24.328570+0000","last_undegraded":"2024-04-16T13:06:24.328570+0000","last_fullsized":"2024-04-16T13:06:24.328570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:46.791311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.329655+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:24.329655+0000","last_peered":"2024-04-16T13:06:24.329655+0000","last_clean":"2024-04-16T13:06:24.329655+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:24.329655+0000","last_undegraded":"2024-04-16T13:06:24.329655+0000","last_fullsized":"2024-04-16T13:06:24.329655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:07:29.199088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.290047+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:24.290047+0000","last_peered":"2024-04-16T13:06:24.290047+0000","last_clean":"2024-04-16T13:06:24.290047+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:24.290047+0000","last_undegraded":"2024-04-16T13:06:24.290047+0000","last_fullsized":"2024-04-16T13:06:24.290047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305101+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:24.305101+0000","last_peered":"2024-04-16T13:06:24.305101+0000","last_clean":"2024-04-16T13:06:24.305101+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:24.305101+0000","last_undegraded":"2024-04-16T13:06:24.305101+0000","last_fullsized":"2024-04-16T13:06:24.305101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.296613+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:24.296613+0000","last_peered":"2024-04-16T13:06:24.296613+0000","last_clean":"2024-04-16T13:06:24.296613+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:24.296613+0000","last_undegraded":"2024-04-16T13:06:24.296613+0000","last_fullsized":"2024-04-16T13:06:24.296613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319188+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:24.319188+0000","last_peered":"2024-04-16T13:06:24.319188+0000","last_clean":"2024-04-16T13:06:24.319188+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:24.319188+0000","last_undegraded":"2024-04-16T13:06:24.319188+0000","last_fullsized":"2024-04-16T13:06:24.319188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334969+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:24.334969+0000","last_peered":"2024-04-16T13:06:24.334969+0000","last_clean":"2024-04-16T13:06:24.334969+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:24.334969+0000","last_undegraded":"2024-04-16T13:06:24.334969+0000","last_fullsized":"2024-04-16T13:06:24.334969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.323816+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:24.323816+0000","last_peered":"2024-04-16T13:06:24.323816+0000","last_clean":"2024-04-16T13:06:24.323816+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:24.323816+0000","last_undegraded":"2024-04-16T13:06:24.323816+0000","last_fullsized":"2024-04-16T13:06:24.323816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328805+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:24.328805+0000","last_peered":"2024-04-16T13:06:24.328805+0000","last_clean":"2024-04-16T13:06:24.328805+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:24.328805+0000","last_undegraded":"2024-04-16T13:06:24.328805+0000","last_fullsized":"2024-04-16T13:06:24.328805+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.309763+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:24.309763+0000","last_peered":"2024-04-16T13:06:24.309763+0000","last_clean":"2024-04-16T13:06:24.309763+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:24.309763+0000","last_undegraded":"2024-04-16T13:06:24.309763+0000","last_fullsized":"2024-04-16T13:06:24.309763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.331959+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:24.331959+0000","last_peered":"2024-04-16T13:06:24.331959+0000","last_clean":"2024-04-16T13:06:24.331959+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:24.331959+0000","last_undegraded":"2024-04-16T13:06:24.331959+0000","last_fullsized":"2024-04-16T13:06:24.331959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.334641+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:24.334641+0000","last_peered":"2024-04-16T13:06:24.334641+0000","last_clean":"2024-04-16T13:06:24.334641+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:24.334641+0000","last_undegraded":"2024-04-16T13:06:24.334641+0000","last_fullsized":"2024-04-16T13:06:24.334641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.332718+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:24.332718+0000","last_peered":"2024-04-16T13:06:24.332718+0000","last_clean":"2024-04-16T13:06:24.332718+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:24.332718+0000","last_undegraded":"2024-04-16T13:06:24.332718+0000","last_fullsized":"2024-04-16T13:06:24.332718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:14.630151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.325097+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:24.325097+0000","last_peered":"2024-04-16T13:06:24.325097+0000","last_clean":"2024-04-16T13:06:24.325097+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:24.325097+0000","last_undegraded":"2024-04-16T13:06:24.325097+0000","last_fullsized":"2024-04-16T13:06:24.325097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:49.204869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.290161+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:24.290161+0000","last_peered":"2024-04-16T13:06:24.290161+0000","last_clean":"2024-04-16T13:06:24.290161+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:24.290161+0000","last_undegraded":"2024-04-16T13:06:24.290161+0000","last_fullsized":"2024-04-16T13:06:24.290161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.305740+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:24.305740+0000","last_peered":"2024-04-16T13:06:24.305740+0000","last_clean":"2024-04-16T13:06:24.305740+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:24.305740+0000","last_undegraded":"2024-04-16T13:06:24.305740+0000","last_fullsized":"2024-04-16T13:06:24.305740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:28.261375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328950+0000","last_change":"2024-04-16T13:06:23.268372+0000","last_active":"2024-04-16T13:06:24.328950+0000","last_peered":"2024-04-16T13:06:24.328950+0000","last_clean":"2024-04-16T13:06:24.328950+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:24.328950+0000","last_undegraded":"2024-04-16T13:06:24.328950+0000","last_fullsized":"2024-04-16T13:06:24.328950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:12:28.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319779+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:24.319779+0000","last_peered":"2024-04-16T13:06:24.319779+0000","last_clean":"2024-04-16T13:06:24.319779+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:24.319779+0000","last_undegraded":"2024-04-16T13:06:24.319779+0000","last_fullsized":"2024-04-16T13:06:24.319779+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275441+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:24.275441+0000","last_peered":"2024-04-16T13:06:24.275441+0000","last_clean":"2024-04-16T13:06:24.275441+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:24.275441+0000","last_undegraded":"2024-04-16T13:06:24.275441+0000","last_fullsized":"2024-04-16T13:06:24.275441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:46:00.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319395+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:24.319395+0000","last_peered":"2024-04-16T13:06:24.319395+0000","last_clean":"2024-04-16T13:06:24.319395+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:24.319395+0000","last_undegraded":"2024-04-16T13:06:24.319395+0000","last_fullsized":"2024-04-16T13:06:24.319395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.284177+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:24.284177+0000","last_peered":"2024-04-16T13:06:24.284177+0000","last_clean":"2024-04-16T13:06:24.284177+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:24.284177+0000","last_undegraded":"2024-04-16T13:06:24.284177+0000","last_fullsized":"2024-04-16T13:06:24.284177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319206+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:24.319206+0000","last_peered":"2024-04-16T13:06:24.319206+0000","last_clean":"2024-04-16T13:06:24.319206+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:24.319206+0000","last_undegraded":"2024-04-16T13:06:24.319206+0000","last_fullsized":"2024-04-16T13:06:24.319206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275073+0000","last_change":"2024-04-16T13:06:23.263252+0000","last_active":"2024-04-16T13:06:24.275073+0000","last_peered":"2024-04-16T13:06:24.275073+0000","last_clean":"2024-04-16T13:06:24.275073+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:24.275073+0000","last_undegraded":"2024-04-16T13:06:24.275073+0000","last_fullsized":"2024-04-16T13:06:24.275073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:57:38.175317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.307353+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:24.307353+0000","last_peered":"2024-04-16T13:06:24.307353+0000","last_clean":"2024-04-16T13:06:24.307353+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:24.307353+0000","last_undegraded":"2024-04-16T13:06:24.307353+0000","last_fullsized":"2024-04-16T13:06:24.307353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.330308+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:24.330308+0000","last_peered":"2024-04-16T13:06:24.330308+0000","last_clean":"2024-04-16T13:06:24.330308+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:24.330308+0000","last_undegraded":"2024-04-16T13:06:24.330308+0000","last_fullsized":"2024-04-16T13:06:24.330308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314401+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:24.314401+0000","last_peered":"2024-04-16T13:06:24.314401+0000","last_clean":"2024-04-16T13:06:24.314401+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:24.314401+0000","last_undegraded":"2024-04-16T13:06:24.314401+0000","last_fullsized":"2024-04-16T13:06:24.314401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.275772+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:24.275772+0000","last_peered":"2024-04-16T13:06:24.275772+0000","last_clean":"2024-04-16T13:06:24.275772+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:24.275772+0000","last_undegraded":"2024-04-16T13:06:24.275772+0000","last_fullsized":"2024-04-16T13:06:24.275772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:33.550187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.328907+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:24.328907+0000","last_peered":"2024-04-16T13:06:24.328907+0000","last_clean":"2024-04-16T13:06:24.328907+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:24.328907+0000","last_undegraded":"2024-04-16T13:06:24.328907+0000","last_fullsized":"2024-04-16T13:06:24.328907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298990+0000","last_change":"2024-04-16T13:06:23.265745+0000","last_active":"2024-04-16T13:06:24.298990+0000","last_peered":"2024-04-16T13:06:24.298990+0000","last_clean":"2024-04-16T13:06:24.298990+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:24.298990+0000","last_undegraded":"2024-04-16T13:06:24.298990+0000","last_fullsized":"2024-04-16T13:06:24.298990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.326374+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:24.326374+0000","last_peered":"2024-04-16T13:06:24.326374+0000","last_clean":"2024-04-16T13:06:24.326374+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:24.326374+0000","last_undegraded":"2024-04-16T13:06:24.326374+0000","last_fullsized":"2024-04-16T13:06:24.326374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.298407+0000","last_change":"2024-04-16T13:06:23.279016+0000","last_active":"2024-04-16T13:06:24.298407+0000","last_peered":"2024-04-16T13:06:24.298407+0000","last_clean":"2024-04-16T13:06:24.298407+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:24.298407+0000","last_undegraded":"2024-04-16T13:06:24.298407+0000","last_fullsized":"2024-04-16T13:06:24.298407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319460+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:24.319460+0000","last_peered":"2024-04-16T13:06:24.319460+0000","last_clean":"2024-04-16T13:06:24.319460+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:24.319460+0000","last_undegraded":"2024-04-16T13:06:24.319460+0000","last_fullsized":"2024-04-16T13:06:24.319460+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:37.247453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.310875+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:24.310875+0000","last_peered":"2024-04-16T13:06:24.310875+0000","last_clean":"2024-04-16T13:06:24.310875+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:24.310875+0000","last_undegraded":"2024-04-16T13:06:24.310875+0000","last_fullsized":"2024-04-16T13:06:24.310875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.319811+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:24.319811+0000","last_peered":"2024-04-16T13:06:24.319811+0000","last_clean":"2024-04-16T13:06:24.319811+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:24.319811+0000","last_undegraded":"2024-04-16T13:06:24.319811+0000","last_fullsized":"2024-04-16T13:06:24.319811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.297988+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:24.297988+0000","last_peered":"2024-04-16T13:06:24.297988+0000","last_clean":"2024-04-16T13:06:24.297988+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:24.297988+0000","last_undegraded":"2024-04-16T13:06:24.297988+0000","last_fullsized":"2024-04-16T13:06:24.297988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.314467+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:24.314467+0000","last_peered":"2024-04-16T13:06:24.314467+0000","last_clean":"2024-04-16T13:06:24.314467+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:24.314467+0000","last_undegraded":"2024-04-16T13:06:24.314467+0000","last_fullsized":"2024-04-16T13:06:24.314467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.308430+0000","last_change":"2024-04-16T13:06:23.261663+0000","last_active":"2024-04-16T13:06:24.308430+0000","last_peered":"2024-04-16T13:06:24.308430+0000","last_clean":"2024-04-16T13:06:24.308430+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:24.308430+0000","last_undegraded":"2024-04-16T13:06:24.308430+0000","last_fullsized":"2024-04-16T13:06:24.308430+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:14.752238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.327377+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:24.327377+0000","last_peered":"2024-04-16T13:06:24.327377+0000","last_clean":"2024-04-16T13:06:24.327377+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:24.327377+0000","last_undegraded":"2024-04-16T13:06:24.327377+0000","last_fullsized":"2024-04-16T13:06:24.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.287149+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:24.287149+0000","last_peered":"2024-04-16T13:06:24.287149+0000","last_clean":"2024-04-16T13:06:24.287149+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:24.287149+0000","last_undegraded":"2024-04-16T13:06:24.287149+0000","last_fullsized":"2024-04-16T13:06:24.287149+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-16T13:06:24.284210+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:24.284210+0000","last_peered":"2024-04-16T13:06:24.284210+0000","last_clean":"2024-04-16T13:06:24.284210+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:24.284210+0000","last_undegraded":"2024-04-16T13:06:24.284210+0000","last_fullsized":"2024-04-16T13:06:24.284210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":782515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":190465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":190465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":183298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":773666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:29.367 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-16T13:06:29.367 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-16T13:06:29.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.638+0000 7f34a5400640 1 Processor -- start 2024-04-16T13:06:29.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.638+0000 7f34a5400640 1 -- start start 2024-04-16T13:06:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.640+0000 7f34a5400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.640+0000 7f34a5400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f34a00b4ce0 0x7f34a00af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.640+0000 7f34a5400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34a006f360 con 0x7f34a00af7b0 2024-04-16T13:06:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.640+0000 7f34a5400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f34a00b5dd0 con 0x7f34a00b4ce0 2024-04-16T13:06:29.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.640+0000 7f34a5400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34a00aede0 con 0x7f34a015b4b0 2024-04-16T13:06:29.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.641+0000 7f349fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.641+0000 7f349fe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:49276/0 (socket says 172.21.15.67:49276) 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.641+0000 7f349fe00640 1 -- 172.21.15.67:0/1693185702 learned_addr learned my addr 172.21.15.67:0/1693185702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.641+0000 7f349f400640 1 --2- 172.21.15.67:0/1693185702 >> v2:172.21.15.82:3300/0 conn(0x7f34a00b4ce0 0x7f34a00af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.642+0000 7f349fe00640 1 -- 172.21.15.67:0/1693185702 >> v2:172.21.15.82:3300/0 conn(0x7f34a00b4ce0 msgr2=0x7f34a00af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.642+0000 7f349fe00640 1 --2- 172.21.15.67:0/1693185702 >> v2:172.21.15.82:3300/0 conn(0x7f34a00b4ce0 0x7f34a00af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.642+0000 7f349fe00640 1 -- 172.21.15.67:0/1693185702 >> v1:172.21.15.82:6789/0 conn(0x7f34a00af7b0 legacy=0x7f34a015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.642+0000 7f349fe00640 1 -- 172.21.15.67:0/1693185702 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a00b5530 con 0x7f34a015b4b0 2024-04-16T13:06:29.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.642+0000 7f349ea00640 1 -- 172.21.15.67:0/1693185702 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848345463 0 0) 0x7f34a006f360 con 0x7f34a00af7b0 2024-04-16T13:06:29.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.643+0000 7f349fe00640 1 --2- 172.21.15.67:0/1693185702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f349000bb10 tx=0x7f349002e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9325e518ef2de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.643+0000 7f349ea00640 1 -- 172.21.15.67:0/1693185702 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349003b070 con 0x7f34a015b4b0 2024-04-16T13:06:29.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f349ea00640 1 -- 172.21.15.67:0/1693185702 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3490036440 con 0x7f34a015b4b0 2024-04-16T13:06:29.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f349ea00640 1 -- 172.21.15.67:0/1693185702 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490036810 con 0x7f34a015b4b0 2024-04-16T13:06:29.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 -- 172.21.15.67:0/1693185702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 msgr2=0x7f34a006ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 --2- 172.21.15.67:0/1693185702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f349000bb10 tx=0x7f349002e150 comp rx=0 tx=0).stop 2024-04-16T13:06:29.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 -- 172.21.15.67:0/1693185702 shutdown_connections 2024-04-16T13:06:29.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 --2- 172.21.15.67:0/1693185702 >> v2:172.21.15.82:3300/0 conn(0x7f34a00b4ce0 0x7f34a00af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 --2- 172.21.15.67:0/1693185702 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a006ee20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 -- 172.21.15.67:0/1693185702 >> 172.21.15.67:0/1693185702 conn(0x7f34a00732c0 msgr2=0x7f34a009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:29.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 -- 172.21.15.67:0/1693185702 shutdown_connections 2024-04-16T13:06:29.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.644+0000 7f34a5400640 1 -- 172.21.15.67:0/1693185702 wait complete. 2024-04-16T13:06:29.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.646+0000 7f34a5400640 1 Processor -- start 2024-04-16T13:06:29.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.646+0000 7f34a5400640 1 -- start start 2024-04-16T13:06:29.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34a00af7b0 0x7f34a0152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a014bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f34a00b5120 con 0x7f34a00b4ce0 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34a00b5af0 con 0x7f34a00af7b0 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.647+0000 7f34a5400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f34a00b52a0 con 0x7f34a015b4b0 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56966/0 (socket says 172.21.15.67:56966) 2024-04-16T13:06:29.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 -- 172.21.15.67:0/1908717501 learned_addr learned my addr 172.21.15.67:0/1908717501 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:29.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349fe00640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34a00af7b0 0x7f34a0152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f34a4a00640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a014bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 -- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 msgr2=0x7f34a014bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a014bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 -- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34a00af7b0 msgr2=0x7f34a0152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34a00af7b0 0x7f34a0152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.648+0000 7f349f400640 1 -- 172.21.15.67:0/1908717501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a014e450 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f349f400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e9e0 tx=0x7f348c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c017070 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c00c9d0 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a014e730 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c00cdc0 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.649+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a014ecf0 con 0x7f34a00b4ce0 2024-04-16T13:06:29.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.650+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a0075bd0 con 0x7f34a00b4ce0 2024-04-16T13:06:29.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.651+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f348c01a070 con 0x7f34a00b4ce0 2024-04-16T13:06:29.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.652+0000 7f3497e00640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 0x7f348006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:29.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.652+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f348c08c140 con 0x7f34a00b4ce0 2024-04-16T13:06:29.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.653+0000 7f349fe00640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 0x7f348006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:29.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.654+0000 7f349fe00640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 0x7f348006edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3490038000 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:29.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.657+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f348c05a320 con 0x7f34a00b4ce0 2024-04-16T13:06:29.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.934+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f34a0156850 con 0x7f34a00b4ce0 2024-04-16T13:06:29.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.938+0000 7f3497e00640 1 -- 172.21.15.67:0/1908717501 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f348c059c20 con 0x7f34a00b4ce0 2024-04-16T13:06:29.940 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-04-16T13:06:29.941 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAtdx5mZkj6MRAAjWl5YRoT0oxyKKPI86iZSw== 2024-04-16T13:06:29.941 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2024-04-16T13:06:29.941 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2024-04-16T13:06:29.941 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-16T13:06:29.941 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 msgr2=0x7f348006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 0x7f348006edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3490038000 tx=0x7f3490008040 comp rx=0 tx=0).stop 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 msgr2=0x7f34a014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f348c00e9e0 tx=0x7f348c00eea0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 shutdown_connections 2024-04-16T13:06:29.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f348006c8f0 0x7f348006edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f34a015b4b0 0x7f34a014bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f34a00b4ce0 0x7f34a014dd00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 --2- 172.21.15.67:0/1908717501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34a00af7b0 0x7f34a0152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 >> 172.21.15.67:0/1908717501 conn(0x7f34a00732c0 msgr2=0x7f34a015e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 shutdown_connections 2024-04-16T13:06:29.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:29.941+0000 7f34a5400640 1 -- 172.21.15.67:0/1908717501 wait complete. 2024-04-16T13:06:29.965 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:06:30.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.189+0000 7f8f2d200640 1 Processor -- start 2024-04-16T13:06:30.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.189+0000 7f8f2d200640 1 -- start start 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.190+0000 7f8f2d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f2815c420 0x7f8f281601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.190+0000 7f8f2d200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 0x7f8f280c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.190+0000 7f8f2d200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f28161110 con 0x7f8f280c5100 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f2d200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8f28160870 con 0x7f8f2815c420 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f2d200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f28160b50 con 0x7f8f2815c800 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f2815c420 0x7f8f281601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8f280c5100 0x7f8f2806ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:44544/0 (socket says 172.21.15.67:44544) 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8f2815c420 0x7f8f281601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56980/0 (socket says 172.21.15.67:56980) 2024-04-16T13:06:30.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27e00640 1 -- 172.21.15.67:0/2822745953 learned_addr learned my addr 172.21.15.67:0/2822745953 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f1ea00640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 0x7f8f280c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 -- 172.21.15.67:0/2822745953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 msgr2=0x7f8f280c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f26a00640 1 -- 172.21.15.67:0/2822745953 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711070661 0 0) 0x7f8f28161110 con 0x7f8f280c5100 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 0x7f8f280c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 -- 172.21.15.67:0/2822745953 >> v1:172.21.15.67:6789/0 conn(0x7f8f280c5100 legacy=0x7f8f2806ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f27400640 1 -- 172.21.15.67:0/2822745953 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f28160e30 con 0x7f8f2815c420 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.191+0000 7f8f1ea00640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 0x7f8f280c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.193+0000 7f8f27400640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f281601e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c9918411bc4ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.193+0000 7f8f26a00640 1 -- 172.21.15.67:0/2822745953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18039070 con 0x7f8f2815c420 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.193+0000 7f8f26a00640 1 -- 172.21.15.67:0/2822745953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1802cb30 con 0x7f8f2815c420 2024-04-16T13:06:30.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.193+0000 7f8f26a00640 1 -- 172.21.15.67:0/2822745953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18034440 con 0x7f8f2815c420 2024-04-16T13:06:30.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 -- 172.21.15.67:0/2822745953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 msgr2=0x7f8f281601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f281601e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1802bd80 comp rx=0 tx=0).stop 2024-04-16T13:06:30.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 -- 172.21.15.67:0/2822745953 shutdown_connections 2024-04-16T13:06:30.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f2815c800 0x7f8f280c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 --2- 172.21.15.67:0/2822745953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f281601e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 -- 172.21.15.67:0/2822745953 >> 172.21.15.67:0/2822745953 conn(0x7f8f280b2070 msgr2=0x7f8f280b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 -- 172.21.15.67:0/2822745953 shutdown_connections 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.194+0000 7f8f2d200640 1 -- 172.21.15.67:0/2822745953 wait complete. 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.196+0000 7f8f2d200640 1 Processor -- start 2024-04-16T13:06:30.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.196+0000 7f8f2d200640 1 -- start start 2024-04-16T13:06:30.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f280c5100 0x7f8f280ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2815c800 0x7f8f28154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280cd100 con 0x7f8f2815c420 2024-04-16T13:06:30.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280ccf80 con 0x7f8f2815c800 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f2d200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8f280cd280 con 0x7f8f280c5100 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f1ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f1ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56984/0 (socket says 172.21.15.67:56984) 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f1ea00640 1 -- 172.21.15.67:0/4410647 learned_addr learned my addr 172.21.15.67:0/4410647 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.197+0000 7f8f27400640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f280c5100 0x7f8f280ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f27e00640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2815c800 0x7f8f28154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 -- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f280c5100 msgr2=0x7f8f280ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f280c5100 0x7f8f280ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 -- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2815c800 msgr2=0x7f8f28154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2815c800 0x7f8f28154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 -- 172.21.15.67:0/4410647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f280cea70 con 0x7f8f2815c420 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1ea00640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000c820 tx=0x7f8f1000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:30.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10015070 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10007a30 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10007e00 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f280ced50 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.198+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f280cf310 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.200+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f28075bd0 con 0x7f8f2815c420 2024-04-16T13:06:30.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.201+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f10018070 con 0x7f8f2815c420 2024-04-16T13:06:30.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.202+0000 7f8f1fe00640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 0x7f8f0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:30.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.202+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8f1008bce0 con 0x7f8f2815c420 2024-04-16T13:06:30.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.203+0000 7f8f27400640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 0x7f8f0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:30.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.204+0000 7f8f27400640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 0x7f8f0406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f18036000 tx=0x7f8f18030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:30.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.208+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f10059f50 con 0x7f8f2815c420 2024-04-16T13:06:30.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.458+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f280b3dc0 con 0x7f8f2815c420 2024-04-16T13:06:30.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.459+0000 7f8f1fe00640 1 -- 172.21.15.67:0/4410647 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5181 (secure 0 0 0) 0x7f8f10059850 con 0x7f8f2815c420 2024-04-16T13:06:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:30.462 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2013697614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2013697614},{"type":"v1","addr":"172.21.15.82:6835","nonce":2013697614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2223402768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2223402768},{"type":"v1","addr":"172.21.15.67:6834","nonce":2223402768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1074117415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1074117415},{"type":"v1","addr":"172.21.15.67:6835","nonce":1074117415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:06:23.736265+0000","modified":"2024-04-16T13:06:26.826919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5325":{"gid":5325,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/4271358534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4271358534},{"type":"v1","addr":"172.21.15.82:6837","nonce":4271358534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5325,"qdb_cluster":[5325]},"id":2}]} 2024-04-16T13:06:30.462 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 17 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 msgr2=0x7f8f0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 0x7f8f0406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f18036000 tx=0x7f8f18030000 comp rx=0 tx=0).stop 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 msgr2=0x7f8f280ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000c820 tx=0x7f8f1000cc20 comp rx=0 tx=0).stop 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 shutdown_connections 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8f0406c8f0 0x7f8f0406edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2815c800 0x7f8f28154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f2815c420 0x7f8f280ae4d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 --2- 172.21.15.67:0/4410647 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8f280c5100 0x7f8f280ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:30.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.462+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 >> 172.21.15.67:0/4410647 conn(0x7f8f280b2070 msgr2=0x7f8f280b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:30.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.463+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 shutdown_connections 2024-04-16T13:06:30.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:30.463+0000 7f8f2d200640 1 -- 172.21.15.67:0/4410647 wait complete. 2024-04-16T13:06:30.792 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2024-04-16T13:06:30.792 INFO:tasks.cephfs_test_runner: 2024-04-16T13:06:30.792 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T13:06:30.792 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-16T13:06:30.792 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/xfstests_dev.py", line 27, in setUp 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: super(XFSTestsDev, self).setUp() 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-04-16T13:06:30.793 INFO:tasks.cephfs_test_runner: 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:Ran 1 test in 42.320s 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/xfstests_dev.py", line 27, in setUp 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: super(XFSTestsDev, self).setUp() 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/cephfs_test_case.py", line 180, in setUp 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: self.fs.wait_for_daemons() 2024-04-16T13:06:30.794 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1270, in wait_for_daemons 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs/filesystem.py", line 1075, in are_daemons_healthy 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: mds.check_status() 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 43, in check_status 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: return self.proc.poll() 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 211, in poll 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-04-16T13:06:30.795 INFO:tasks.cephfs_test_runner: 2024-04-16T13:06:30.795 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-16T13:06:31.039 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4a7e23708b3445f59aa9d6ffe779af91 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c3c87ed01bade92fb0ec360baa9bd9c82b8fde4f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-16T13:06:31.041 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-16T13:06:31.051 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-16T13:06:31.106 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-16T13:06:31.107 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:06:31.107 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:31.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052777,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498008k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249004k,nr_inodes=812251,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498008k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T13:06:31.171 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-04-16T13:06:31.171 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:31.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052777,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498008k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249004k,nr_inodes=812251,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498008k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-16T13:06:31.226 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:06:31.226 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:31.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052756,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T13:06:31.286 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-16T13:06:31.286 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T13:06:31.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052756,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-16T13:06:31.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.338 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:06:31.395 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T13:06:31.395 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-16T13:06:31.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T13:06:31.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-16T13:06:31.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-16T13:06:31.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.714 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-04-16T13:06:31.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.758 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-04-16T13:06:31.903 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-04-16T13:06:31.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:06:31.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.909 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:06:31.965 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T13:06:31.965 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-16T13:06:31.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:31.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T13:06:32.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:32.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-16T13:06:32.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:32.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-16T13:06:32.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:32.260 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-04-16T13:06:32.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T13:06:32.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-04-16T13:06:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-04-16T13:06:32.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:06:32.442 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T13:06:32.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-16T13:06:32.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:32.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-04-16T13:06:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.677+0000 7f07c9e00640 1 Processor -- start 2024-04-16T13:06:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.677+0000 7f07c9e00640 1 -- start start 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 0x7f07c41601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 0x7f07c40c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07c40c5100 0x7f07c40c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f07c4161110 con 0x7f07c40c5100 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f07c4160870 con 0x7f07c415c800 2024-04-16T13:06:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4160b50 con 0x7f07c415c420 2024-04-16T13:06:32.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07c40c5100 0x7f07c40c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07c40c5100 0x7f07c40c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43288/0 (socket says 172.21.15.67:43288) 2024-04-16T13:06:32.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9400640 1 -- 172.21.15.67:0/3006591744 learned_addr learned my addr 172.21.15.67:0/3006591744 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:32.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c8a00640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 0x7f07c41601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c9400640 1 -- 172.21.15.67:0/3006591744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 msgr2=0x7f07c41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:32.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.679+0000 7f07c3e00640 1 --2- 172.21.15.67:0/3006591744 >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 0x7f07c40c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c9400640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 0x7f07c41601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c9400640 1 -- 172.21.15.67:0/3006591744 >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 msgr2=0x7f07c40c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c9400640 1 --2- 172.21.15.67:0/3006591744 >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 0x7f07c40c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c9400640 1 -- 172.21.15.67:0/3006591744 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c4160e30 con 0x7f07c40c5100 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c8a00640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 0x7f07c41601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.680+0000 7f07c3e00640 1 --2- 172.21.15.67:0/3006591744 >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 0x7f07c40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.681+0000 7f07c9400640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c6760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c40d01a0 tx=0x7f07bc02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f668f2cbee9861dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.681+0000 7f07c3400640 1 -- 172.21.15.67:0/3006591744 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc02c960 con 0x7f07c40c5100 2024-04-16T13:06:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.681+0000 7f07c3400640 1 -- 172.21.15.67:0/3006591744 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc02cb00 con 0x7f07c40c5100 2024-04-16T13:06:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.681+0000 7f07c3400640 1 -- 172.21.15.67:0/3006591744 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0343f0 con 0x7f07c40c5100 2024-04-16T13:06:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 -- 172.21.15.67:0/3006591744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 msgr2=0x7f07c40c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c6760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c40d01a0 tx=0x7f07bc02bdc0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 -- 172.21.15.67:0/3006591744 shutdown_connections 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c6760 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3006591744 >> v2:172.21.15.82:3300/0 conn(0x7f07c415c800 0x7f07c40c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3006591744 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c420 0x7f07c41601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 -- 172.21.15.67:0/3006591744 >> 172.21.15.67:0/3006591744 conn(0x7f07c40b2070 msgr2=0x7f07c40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 -- 172.21.15.67:0/3006591744 shutdown_connections 2024-04-16T13:06:32.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.682+0000 7f07c9e00640 1 -- 172.21.15.67:0/3006591744 wait complete. 2024-04-16T13:06:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.684+0000 7f07c9e00640 1 Processor -- start 2024-04-16T13:06:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.684+0000 7f07c9e00640 1 -- start start 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c415c420 0x7f07c414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c800 0x7f07c40cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07c406bba0 con 0x7f07c40c5100 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07c406ba20 con 0x7f07c415c420 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c9e00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f07c406bd20 con 0x7f07c415c800 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43292/0 (socket says 172.21.15.67:43292) 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.685+0000 7f07c8a00640 1 -- 172.21.15.67:0/3471785907 learned_addr learned my addr 172.21.15.67:0/3471785907 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c9400640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c800 0x7f07c40cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c3e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c415c420 0x7f07c414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 -- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c800 msgr2=0x7f07c40cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c800 0x7f07c40cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 -- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c415c420 msgr2=0x7f07c414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c415c420 0x7f07c414d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 -- 172.21.15.67:0/3471785907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c40ad170 con 0x7f07c40c5100 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c8a00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c7f0 tx=0x7f07b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4015070 con 0x7f07c40c5100 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4007a30 con 0x7f07c40c5100 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4007e00 con 0x7f07c40c5100 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.686+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c40ca390 con 0x7f07c40c5100 2024-04-16T13:06:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.687+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c40ad6f0 con 0x7f07c40c5100 2024-04-16T13:06:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.688+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c40b3950 con 0x7f07c40c5100 2024-04-16T13:06:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.689+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f07b4018070 con 0x7f07c40c5100 2024-04-16T13:06:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.689+0000 7f07c0c00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 0x7f07a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.690+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f07b408bc40 con 0x7f07c40c5100 2024-04-16T13:06:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.690+0000 7f07c3e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 0x7f07a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.692+0000 7f07c3e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 0x7f07a406ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07c40b1ad0 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.695+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f07c40b3950 con 0x7f07c40c5100 2024-04-16T13:06:32.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.899+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07c40b3dc0 con 0x7f07a406c920 2024-04-16T13:06:32.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.917+0000 7f07c0c00640 1 -- 172.21.15.67:0/3471785907 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f07c40b3dc0 con 0x7f07a406c920 2024-04-16T13:06:32.922 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:32.925 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 msgr2=0x7f07a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 0x7f07a406ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f07c40b1ad0 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 msgr2=0x7f07c40c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c7f0 tx=0x7f07b400ccb0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 shutdown_connections 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f07a406c920 0x7f07a406ede0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f07c415c800 0x7f07c40cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c415c420 0x7f07c414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 --2- 172.21.15.67:0/3471785907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07c40c5100 0x7f07c40c76d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:32.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 >> 172.21.15.67:0/3471785907 conn(0x7f07c40b2070 msgr2=0x7f07c40c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:32.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 shutdown_connections 2024-04-16T13:06:32.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:32.924+0000 7f07c9e00640 1 -- 172.21.15.67:0/3471785907 wait complete. 2024-04-16T13:06:32.944 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-16T13:06:32.534759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5029888,"data_stored":2851712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.231254"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607696+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:28.607696+0000","last_peered":"2024-04-16T13:06:28.607696+0000","last_clean":"2024-04-16T13:06:28.607696+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:28.607696+0000","last_undegraded":"2024-04-16T13:06:28.607696+0000","last_fullsized":"2024-04-16T13:06:28.607696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:44.728162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607337+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:28.607337+0000","last_peered":"2024-04-16T13:06:28.607337+0000","last_clean":"2024-04-16T13:06:28.607337+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:28.607337+0000","last_undegraded":"2024-04-16T13:06:28.607337+0000","last_fullsized":"2024-04-16T13:06:28.607337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:25.025727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331683+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:28.331683+0000","last_peered":"2024-04-16T13:06:28.331683+0000","last_clean":"2024-04-16T13:06:28.331683+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:28.331683+0000","last_undegraded":"2024-04-16T13:06:28.331683+0000","last_fullsized":"2024-04-16T13:06:28.331683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061695+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:28.061695+0000","last_peered":"2024-04-16T13:06:28.061695+0000","last_clean":"2024-04-16T13:06:28.061695+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:28.061695+0000","last_undegraded":"2024-04-16T13:06:28.061695+0000","last_fullsized":"2024-04-16T13:06:28.061695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:44:17.566480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061458+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:28.061458+0000","last_peered":"2024-04-16T13:06:28.061458+0000","last_clean":"2024-04-16T13:06:28.061458+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:28.061458+0000","last_undegraded":"2024-04-16T13:06:28.061458+0000","last_fullsized":"2024-04-16T13:06:28.061458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:18.191612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324427+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:28.324427+0000","last_peered":"2024-04-16T13:06:28.324427+0000","last_clean":"2024-04-16T13:06:28.324427+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:28.324427+0000","last_undegraded":"2024-04-16T13:06:28.324427+0000","last_fullsized":"2024-04-16T13:06:28.324427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327163+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:28.327163+0000","last_peered":"2024-04-16T13:06:28.327163+0000","last_clean":"2024-04-16T13:06:28.327163+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:28.327163+0000","last_undegraded":"2024-04-16T13:06:28.327163+0000","last_fullsized":"2024-04-16T13:06:28.327163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606560+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:28.606560+0000","last_peered":"2024-04-16T13:06:28.606560+0000","last_clean":"2024-04-16T13:06:28.606560+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:28.606560+0000","last_undegraded":"2024-04-16T13:06:28.606560+0000","last_fullsized":"2024-04-16T13:06:28.606560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331998+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:28.331998+0000","last_peered":"2024-04-16T13:06:28.331998+0000","last_clean":"2024-04-16T13:06:28.331998+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:28.331998+0000","last_undegraded":"2024-04-16T13:06:28.331998+0000","last_fullsized":"2024-04-16T13:06:28.331998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329152+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:28.329152+0000","last_peered":"2024-04-16T13:06:28.329152+0000","last_clean":"2024-04-16T13:06:28.329152+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:28.329152+0000","last_undegraded":"2024-04-16T13:06:28.329152+0000","last_fullsized":"2024-04-16T13:06:28.329152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328808+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:28.328808+0000","last_peered":"2024-04-16T13:06:28.328808+0000","last_clean":"2024-04-16T13:06:28.328808+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:28.328808+0000","last_undegraded":"2024-04-16T13:06:28.328808+0000","last_fullsized":"2024-04-16T13:06:28.328808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332432+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:28.332432+0000","last_peered":"2024-04-16T13:06:28.332432+0000","last_clean":"2024-04-16T13:06:28.332432+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:28.332432+0000","last_undegraded":"2024-04-16T13:06:28.332432+0000","last_fullsized":"2024-04-16T13:06:28.332432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328023+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:28.328023+0000","last_peered":"2024-04-16T13:06:28.328023+0000","last_clean":"2024-04-16T13:06:28.328023+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:28.328023+0000","last_undegraded":"2024-04-16T13:06:28.328023+0000","last_fullsized":"2024-04-16T13:06:28.328023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325517+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:27.325517+0000","last_peered":"2024-04-16T13:06:27.325517+0000","last_clean":"2024-04-16T13:06:27.325517+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:27.325517+0000","last_undegraded":"2024-04-16T13:06:27.325517+0000","last_fullsized":"2024-04-16T13:06:27.325517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327377+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:28.327377+0000","last_peered":"2024-04-16T13:06:28.327377+0000","last_clean":"2024-04-16T13:06:28.327377+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:28.327377+0000","last_undegraded":"2024-04-16T13:06:28.327377+0000","last_fullsized":"2024-04-16T13:06:28.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329786+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:28.329786+0000","last_peered":"2024-04-16T13:06:28.329786+0000","last_clean":"2024-04-16T13:06:28.329786+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:28.329786+0000","last_undegraded":"2024-04-16T13:06:28.329786+0000","last_fullsized":"2024-04-16T13:06:28.329786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331058+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:28.331058+0000","last_peered":"2024-04-16T13:06:28.331058+0000","last_clean":"2024-04-16T13:06:28.331058+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:28.331058+0000","last_undegraded":"2024-04-16T13:06:28.331058+0000","last_fullsized":"2024-04-16T13:06:28.331058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740260+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:28.740260+0000","last_peered":"2024-04-16T13:06:28.740260+0000","last_clean":"2024-04-16T13:06:28.740260+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:28.740260+0000","last_undegraded":"2024-04-16T13:06:28.740260+0000","last_fullsized":"2024-04-16T13:06:28.740260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061795+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:28.061795+0000","last_peered":"2024-04-16T13:06:28.061795+0000","last_clean":"2024-04-16T13:06:28.061795+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:28.061795+0000","last_undegraded":"2024-04-16T13:06:28.061795+0000","last_fullsized":"2024-04-16T13:06:28.061795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:26.743151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739999+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:28.739999+0000","last_peered":"2024-04-16T13:06:28.739999+0000","last_clean":"2024-04-16T13:06:28.739999+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:28.739999+0000","last_undegraded":"2024-04-16T13:06:28.739999+0000","last_fullsized":"2024-04-16T13:06:28.739999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328029+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:28.328029+0000","last_peered":"2024-04-16T13:06:28.328029+0000","last_clean":"2024-04-16T13:06:28.328029+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:28.328029+0000","last_undegraded":"2024-04-16T13:06:28.328029+0000","last_fullsized":"2024-04-16T13:06:28.328029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326220+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:27.326220+0000","last_peered":"2024-04-16T13:06:27.326220+0000","last_clean":"2024-04-16T13:06:27.326220+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:27.326220+0000","last_undegraded":"2024-04-16T13:06:27.326220+0000","last_fullsized":"2024-04-16T13:06:27.326220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330022+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:28.330022+0000","last_peered":"2024-04-16T13:06:28.330022+0000","last_clean":"2024-04-16T13:06:28.330022+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:28.330022+0000","last_undegraded":"2024-04-16T13:06:28.330022+0000","last_fullsized":"2024-04-16T13:06:28.330022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061471+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:28.061471+0000","last_peered":"2024-04-16T13:06:28.061471+0000","last_clean":"2024-04-16T13:06:28.061471+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:28.061471+0000","last_undegraded":"2024-04-16T13:06:28.061471+0000","last_fullsized":"2024-04-16T13:06:28.061471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:56.223862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740428+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:28.740428+0000","last_peered":"2024-04-16T13:06:28.740428+0000","last_clean":"2024-04-16T13:06:28.740428+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:28.740428+0000","last_undegraded":"2024-04-16T13:06:28.740428+0000","last_fullsized":"2024-04-16T13:06:28.740428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324862+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:28.324862+0000","last_peered":"2024-04-16T13:06:28.324862+0000","last_clean":"2024-04-16T13:06:28.324862+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:28.324862+0000","last_undegraded":"2024-04-16T13:06:28.324862+0000","last_fullsized":"2024-04-16T13:06:28.324862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740255+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:28.740255+0000","last_peered":"2024-04-16T13:06:28.740255+0000","last_clean":"2024-04-16T13:06:28.740255+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:28.740255+0000","last_undegraded":"2024-04-16T13:06:28.740255+0000","last_fullsized":"2024-04-16T13:06:28.740255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.612903+0000","last_change":"2024-04-16T13:06:28.609312+0000","last_active":"2024-04-16T13:06:28.612903+0000","last_peered":"2024-04-16T13:06:28.612903+0000","last_clean":"2024-04-16T13:06:28.612903+0000","last_became_active":"2024-04-16T13:06:28.608582+0000","last_became_peered":"2024-04-16T13:06:28.608582+0000","last_unstale":"2024-04-16T13:06:28.612903+0000","last_undegraded":"2024-04-16T13:06:28.612903+0000","last_fullsized":"2024-04-16T13:06:28.612903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739857+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:28.739857+0000","last_peered":"2024-04-16T13:06:28.739857+0000","last_clean":"2024-04-16T13:06:28.739857+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:28.739857+0000","last_undegraded":"2024-04-16T13:06:28.739857+0000","last_fullsized":"2024-04-16T13:06:28.739857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739833+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:28.739833+0000","last_peered":"2024-04-16T13:06:28.739833+0000","last_clean":"2024-04-16T13:06:28.739833+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:28.739833+0000","last_undegraded":"2024-04-16T13:06:28.739833+0000","last_fullsized":"2024-04-16T13:06:28.739833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330245+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:28.330245+0000","last_peered":"2024-04-16T13:06:28.330245+0000","last_clean":"2024-04-16T13:06:28.330245+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:28.330245+0000","last_undegraded":"2024-04-16T13:06:28.330245+0000","last_fullsized":"2024-04-16T13:06:28.330245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324519+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:28.324519+0000","last_peered":"2024-04-16T13:06:28.324519+0000","last_clean":"2024-04-16T13:06:28.324519+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:28.324519+0000","last_undegraded":"2024-04-16T13:06:28.324519+0000","last_fullsized":"2024-04-16T13:06:28.324519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330380+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:28.330380+0000","last_peered":"2024-04-16T13:06:28.330380+0000","last_clean":"2024-04-16T13:06:28.330380+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:28.330380+0000","last_undegraded":"2024-04-16T13:06:28.330380+0000","last_fullsized":"2024-04-16T13:06:28.330380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740417+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:28.740417+0000","last_peered":"2024-04-16T13:06:28.740417+0000","last_clean":"2024-04-16T13:06:28.740417+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:28.740417+0000","last_undegraded":"2024-04-16T13:06:28.740417+0000","last_fullsized":"2024-04-16T13:06:28.740417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324999+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:28.324999+0000","last_peered":"2024-04-16T13:06:28.324999+0000","last_clean":"2024-04-16T13:06:28.324999+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:28.324999+0000","last_undegraded":"2024-04-16T13:06:28.324999+0000","last_fullsized":"2024-04-16T13:06:28.324999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332177+0000","last_change":"2024-04-16T13:06:23.273252+0000","last_active":"2024-04-16T13:06:28.332177+0000","last_peered":"2024-04-16T13:06:28.332177+0000","last_clean":"2024-04-16T13:06:28.332177+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:28.332177+0000","last_undegraded":"2024-04-16T13:06:28.332177+0000","last_fullsized":"2024-04-16T13:06:28.332177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325775+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:27.325775+0000","last_peered":"2024-04-16T13:06:27.325775+0000","last_clean":"2024-04-16T13:06:27.325775+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:27.325775+0000","last_undegraded":"2024-04-16T13:06:27.325775+0000","last_fullsized":"2024-04-16T13:06:27.325775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325196+0000","last_change":"2024-04-16T13:06:23.272459+0000","last_active":"2024-04-16T13:06:28.325196+0000","last_peered":"2024-04-16T13:06:28.325196+0000","last_clean":"2024-04-16T13:06:28.325196+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:28.325196+0000","last_undegraded":"2024-04-16T13:06:28.325196+0000","last_fullsized":"2024-04-16T13:06:28.325196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607491+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:28.607491+0000","last_peered":"2024-04-16T13:06:28.607491+0000","last_clean":"2024-04-16T13:06:28.607491+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:28.607491+0000","last_undegraded":"2024-04-16T13:06:28.607491+0000","last_fullsized":"2024-04-16T13:06:28.607491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:11.345104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326017+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:27.326017+0000","last_peered":"2024-04-16T13:06:27.326017+0000","last_clean":"2024-04-16T13:06:27.326017+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:27.326017+0000","last_undegraded":"2024-04-16T13:06:27.326017+0000","last_fullsized":"2024-04-16T13:06:27.326017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331436+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:28.331436+0000","last_peered":"2024-04-16T13:06:28.331436+0000","last_clean":"2024-04-16T13:06:28.331436+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:28.331436+0000","last_undegraded":"2024-04-16T13:06:28.331436+0000","last_fullsized":"2024-04-16T13:06:28.331436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328319+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:28.328319+0000","last_peered":"2024-04-16T13:06:28.328319+0000","last_clean":"2024-04-16T13:06:28.328319+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:28.328319+0000","last_undegraded":"2024-04-16T13:06:28.328319+0000","last_fullsized":"2024-04-16T13:06:28.328319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327481+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:28.327481+0000","last_peered":"2024-04-16T13:06:28.327481+0000","last_clean":"2024-04-16T13:06:28.327481+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:28.327481+0000","last_undegraded":"2024-04-16T13:06:28.327481+0000","last_fullsized":"2024-04-16T13:06:28.327481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:49.571417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330643+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:28.330643+0000","last_peered":"2024-04-16T13:06:28.330643+0000","last_clean":"2024-04-16T13:06:28.330643+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:28.330643+0000","last_undegraded":"2024-04-16T13:06:28.330643+0000","last_fullsized":"2024-04-16T13:06:28.330643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326321+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:27.326321+0000","last_peered":"2024-04-16T13:06:27.326321+0000","last_clean":"2024-04-16T13:06:27.326321+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:27.326321+0000","last_undegraded":"2024-04-16T13:06:27.326321+0000","last_fullsized":"2024-04-16T13:06:27.326321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324529+0000","last_change":"2024-04-16T13:06:23.268772+0000","last_active":"2024-04-16T13:06:28.324529+0000","last_peered":"2024-04-16T13:06:28.324529+0000","last_clean":"2024-04-16T13:06:28.324529+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:28.324529+0000","last_undegraded":"2024-04-16T13:06:28.324529+0000","last_fullsized":"2024-04-16T13:06:28.324529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606893+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:28.606893+0000","last_peered":"2024-04-16T13:06:28.606893+0000","last_clean":"2024-04-16T13:06:28.606893+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:28.606893+0000","last_undegraded":"2024-04-16T13:06:28.606893+0000","last_fullsized":"2024-04-16T13:06:28.606893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:53.084243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325131+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:27.325131+0000","last_peered":"2024-04-16T13:06:27.325131+0000","last_clean":"2024-04-16T13:06:27.325131+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:27.325131+0000","last_undegraded":"2024-04-16T13:06:27.325131+0000","last_fullsized":"2024-04-16T13:06:27.325131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061787+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:28.061787+0000","last_peered":"2024-04-16T13:06:28.061787+0000","last_clean":"2024-04-16T13:06:28.061787+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:28.061787+0000","last_undegraded":"2024-04-16T13:06:28.061787+0000","last_fullsized":"2024-04-16T13:06:28.061787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:26.276830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607756+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:28.607756+0000","last_peered":"2024-04-16T13:06:28.607756+0000","last_clean":"2024-04-16T13:06:28.607756+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:28.607756+0000","last_undegraded":"2024-04-16T13:06:28.607756+0000","last_fullsized":"2024-04-16T13:06:28.607756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:30.702356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330721+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:28.330721+0000","last_peered":"2024-04-16T13:06:28.330721+0000","last_clean":"2024-04-16T13:06:28.330721+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:28.330721+0000","last_undegraded":"2024-04-16T13:06:28.330721+0000","last_fullsized":"2024-04-16T13:06:28.330721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329445+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:28.329445+0000","last_peered":"2024-04-16T13:06:28.329445+0000","last_clean":"2024-04-16T13:06:28.329445+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:28.329445+0000","last_undegraded":"2024-04-16T13:06:28.329445+0000","last_fullsized":"2024-04-16T13:06:28.329445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331916+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:28.331916+0000","last_peered":"2024-04-16T13:06:28.331916+0000","last_clean":"2024-04-16T13:06:28.331916+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:28.331916+0000","last_undegraded":"2024-04-16T13:06:28.331916+0000","last_fullsized":"2024-04-16T13:06:28.331916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328786+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:28.328786+0000","last_peered":"2024-04-16T13:06:28.328786+0000","last_clean":"2024-04-16T13:06:28.328786+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:28.328786+0000","last_undegraded":"2024-04-16T13:06:28.328786+0000","last_fullsized":"2024-04-16T13:06:28.328786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326814+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:27.326814+0000","last_peered":"2024-04-16T13:06:27.326814+0000","last_clean":"2024-04-16T13:06:27.326814+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:27.326814+0000","last_undegraded":"2024-04-16T13:06:27.326814+0000","last_fullsized":"2024-04-16T13:06:27.326814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607420+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:28.607420+0000","last_peered":"2024-04-16T13:06:28.607420+0000","last_clean":"2024-04-16T13:06:28.607420+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:28.607420+0000","last_undegraded":"2024-04-16T13:06:28.607420+0000","last_fullsized":"2024-04-16T13:06:28.607420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:13.322320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331551+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:28.331551+0000","last_peered":"2024-04-16T13:06:28.331551+0000","last_clean":"2024-04-16T13:06:28.331551+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:28.331551+0000","last_undegraded":"2024-04-16T13:06:28.331551+0000","last_fullsized":"2024-04-16T13:06:28.331551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607113+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:28.607113+0000","last_peered":"2024-04-16T13:06:28.607113+0000","last_clean":"2024-04-16T13:06:28.607113+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:28.607113+0000","last_undegraded":"2024-04-16T13:06:28.607113+0000","last_fullsized":"2024-04-16T13:06:28.607113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:46.791311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606764+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:28.606764+0000","last_peered":"2024-04-16T13:06:28.606764+0000","last_clean":"2024-04-16T13:06:28.606764+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:28.606764+0000","last_undegraded":"2024-04-16T13:06:28.606764+0000","last_fullsized":"2024-04-16T13:06:28.606764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324548+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:28.324548+0000","last_peered":"2024-04-16T13:06:28.324548+0000","last_clean":"2024-04-16T13:06:28.324548+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:28.324548+0000","last_undegraded":"2024-04-16T13:06:28.324548+0000","last_fullsized":"2024-04-16T13:06:28.324548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330536+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:28.330536+0000","last_peered":"2024-04-16T13:06:28.330536+0000","last_clean":"2024-04-16T13:06:28.330536+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:28.330536+0000","last_undegraded":"2024-04-16T13:06:28.330536+0000","last_fullsized":"2024-04-16T13:06:28.330536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739722+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:28.739722+0000","last_peered":"2024-04-16T13:06:28.739722+0000","last_clean":"2024-04-16T13:06:28.739722+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:28.739722+0000","last_undegraded":"2024-04-16T13:06:28.739722+0000","last_fullsized":"2024-04-16T13:06:28.739722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606999+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:28.606999+0000","last_peered":"2024-04-16T13:06:28.606999+0000","last_clean":"2024-04-16T13:06:28.606999+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:28.606999+0000","last_undegraded":"2024-04-16T13:06:28.606999+0000","last_fullsized":"2024-04-16T13:06:28.606999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:35.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329993+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:28.329993+0000","last_peered":"2024-04-16T13:06:28.329993+0000","last_clean":"2024-04-16T13:06:28.329993+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:28.329993+0000","last_undegraded":"2024-04-16T13:06:28.329993+0000","last_fullsized":"2024-04-16T13:06:28.329993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607244+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:28.607244+0000","last_peered":"2024-04-16T13:06:28.607244+0000","last_clean":"2024-04-16T13:06:28.607244+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:28.607244+0000","last_undegraded":"2024-04-16T13:06:28.607244+0000","last_fullsized":"2024-04-16T13:06:28.607244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:23.242434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328876+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:28.328876+0000","last_peered":"2024-04-16T13:06:28.328876+0000","last_clean":"2024-04-16T13:06:28.328876+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:28.328876+0000","last_undegraded":"2024-04-16T13:06:28.328876+0000","last_fullsized":"2024-04-16T13:06:28.328876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328495+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:28.328495+0000","last_peered":"2024-04-16T13:06:28.328495+0000","last_clean":"2024-04-16T13:06:28.328495+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:28.328495+0000","last_undegraded":"2024-04-16T13:06:28.328495+0000","last_fullsized":"2024-04-16T13:06:28.328495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325863+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:27.325863+0000","last_peered":"2024-04-16T13:06:27.325863+0000","last_clean":"2024-04-16T13:06:27.325863+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:27.325863+0000","last_undegraded":"2024-04-16T13:06:27.325863+0000","last_fullsized":"2024-04-16T13:06:27.325863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325623+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:27.325623+0000","last_peered":"2024-04-16T13:06:27.325623+0000","last_clean":"2024-04-16T13:06:27.325623+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:27.325623+0000","last_undegraded":"2024-04-16T13:06:27.325623+0000","last_fullsized":"2024-04-16T13:06:27.325623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061847+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:28.061847+0000","last_peered":"2024-04-16T13:06:28.061847+0000","last_clean":"2024-04-16T13:06:28.061847+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:28.061847+0000","last_undegraded":"2024-04-16T13:06:28.061847+0000","last_fullsized":"2024-04-16T13:06:28.061847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:14.630151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062058+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:28.062058+0000","last_peered":"2024-04-16T13:06:28.062058+0000","last_clean":"2024-04-16T13:06:28.062058+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:28.062058+0000","last_undegraded":"2024-04-16T13:06:28.062058+0000","last_fullsized":"2024-04-16T13:06:28.062058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:50.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324921+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:28.324921+0000","last_peered":"2024-04-16T13:06:28.324921+0000","last_clean":"2024-04-16T13:06:28.324921+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:28.324921+0000","last_undegraded":"2024-04-16T13:06:28.324921+0000","last_fullsized":"2024-04-16T13:06:28.324921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330039+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:28.330039+0000","last_peered":"2024-04-16T13:06:28.330039+0000","last_clean":"2024-04-16T13:06:28.330039+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:28.330039+0000","last_undegraded":"2024-04-16T13:06:28.330039+0000","last_fullsized":"2024-04-16T13:06:28.330039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061592+0000","last_change":"2024-04-16T13:06:23.268372+0000","last_active":"2024-04-16T13:06:28.061592+0000","last_peered":"2024-04-16T13:06:28.061592+0000","last_clean":"2024-04-16T13:06:28.061592+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:28.061592+0000","last_undegraded":"2024-04-16T13:06:28.061592+0000","last_fullsized":"2024-04-16T13:06:28.061592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:12:28.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331732+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:28.331732+0000","last_peered":"2024-04-16T13:06:28.331732+0000","last_clean":"2024-04-16T13:06:28.331732+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:28.331732+0000","last_undegraded":"2024-04-16T13:06:28.331732+0000","last_fullsized":"2024-04-16T13:06:28.331732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061708+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:28.061708+0000","last_peered":"2024-04-16T13:06:28.061708+0000","last_clean":"2024-04-16T13:06:28.061708+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:28.061708+0000","last_undegraded":"2024-04-16T13:06:28.061708+0000","last_fullsized":"2024-04-16T13:06:28.061708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:46:00.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327885+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:28.327885+0000","last_peered":"2024-04-16T13:06:28.327885+0000","last_clean":"2024-04-16T13:06:28.327885+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:28.327885+0000","last_undegraded":"2024-04-16T13:06:28.327885+0000","last_fullsized":"2024-04-16T13:06:28.327885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330334+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:28.330334+0000","last_peered":"2024-04-16T13:06:28.330334+0000","last_clean":"2024-04-16T13:06:28.330334+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:28.330334+0000","last_undegraded":"2024-04-16T13:06:28.330334+0000","last_fullsized":"2024-04-16T13:06:28.330334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607055+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:28.607055+0000","last_peered":"2024-04-16T13:06:28.607055+0000","last_clean":"2024-04-16T13:06:28.607055+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:28.607055+0000","last_undegraded":"2024-04-16T13:06:28.607055+0000","last_fullsized":"2024-04-16T13:06:28.607055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:18.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061783+0000","last_change":"2024-04-16T13:06:23.263252+0000","last_active":"2024-04-16T13:06:28.061783+0000","last_peered":"2024-04-16T13:06:28.061783+0000","last_clean":"2024-04-16T13:06:28.061783+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:28.061783+0000","last_undegraded":"2024-04-16T13:06:28.061783+0000","last_fullsized":"2024-04-16T13:06:28.061783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:57:38.175317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324976+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:28.324976+0000","last_peered":"2024-04-16T13:06:28.324976+0000","last_clean":"2024-04-16T13:06:28.324976+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:28.324976+0000","last_undegraded":"2024-04-16T13:06:28.324976+0000","last_fullsized":"2024-04-16T13:06:28.324976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329035+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:28.329035+0000","last_peered":"2024-04-16T13:06:28.329035+0000","last_clean":"2024-04-16T13:06:28.329035+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:28.329035+0000","last_undegraded":"2024-04-16T13:06:28.329035+0000","last_fullsized":"2024-04-16T13:06:28.329035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330966+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:28.330966+0000","last_peered":"2024-04-16T13:06:28.330966+0000","last_clean":"2024-04-16T13:06:28.330966+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:28.330966+0000","last_undegraded":"2024-04-16T13:06:28.330966+0000","last_fullsized":"2024-04-16T13:06:28.330966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062171+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:28.062171+0000","last_peered":"2024-04-16T13:06:28.062171+0000","last_clean":"2024-04-16T13:06:28.062171+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:28.062171+0000","last_undegraded":"2024-04-16T13:06:28.062171+0000","last_fullsized":"2024-04-16T13:06:28.062171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:33.550187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607587+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:28.607587+0000","last_peered":"2024-04-16T13:06:28.607587+0000","last_clean":"2024-04-16T13:06:28.607587+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:28.607587+0000","last_undegraded":"2024-04-16T13:06:28.607587+0000","last_fullsized":"2024-04-16T13:06:28.607587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:08.145583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331759+0000","last_change":"2024-04-16T13:06:23.265745+0000","last_active":"2024-04-16T13:06:28.331759+0000","last_peered":"2024-04-16T13:06:28.331759+0000","last_clean":"2024-04-16T13:06:28.331759+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:28.331759+0000","last_undegraded":"2024-04-16T13:06:28.331759+0000","last_fullsized":"2024-04-16T13:06:28.331759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331565+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:28.331565+0000","last_peered":"2024-04-16T13:06:28.331565+0000","last_clean":"2024-04-16T13:06:28.331565+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:28.331565+0000","last_undegraded":"2024-04-16T13:06:28.331565+0000","last_fullsized":"2024-04-16T13:06:28.331565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331937+0000","last_change":"2024-04-16T13:06:23.279016+0000","last_active":"2024-04-16T13:06:28.331937+0000","last_peered":"2024-04-16T13:06:28.331937+0000","last_clean":"2024-04-16T13:06:28.331937+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:28.331937+0000","last_undegraded":"2024-04-16T13:06:28.331937+0000","last_fullsized":"2024-04-16T13:06:28.331937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324658+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:28.324658+0000","last_peered":"2024-04-16T13:06:28.324658+0000","last_clean":"2024-04-16T13:06:28.324658+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:28.324658+0000","last_undegraded":"2024-04-16T13:06:28.324658+0000","last_fullsized":"2024-04-16T13:06:28.324658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739847+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:28.739847+0000","last_peered":"2024-04-16T13:06:28.739847+0000","last_clean":"2024-04-16T13:06:28.739847+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:28.739847+0000","last_undegraded":"2024-04-16T13:06:28.739847+0000","last_fullsized":"2024-04-16T13:06:28.739847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325826+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:27.325826+0000","last_peered":"2024-04-16T13:06:27.325826+0000","last_clean":"2024-04-16T13:06:27.325826+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:27.325826+0000","last_undegraded":"2024-04-16T13:06:27.325826+0000","last_fullsized":"2024-04-16T13:06:27.325826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325135+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:27.325135+0000","last_peered":"2024-04-16T13:06:27.325135+0000","last_clean":"2024-04-16T13:06:27.325135+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:27.325135+0000","last_undegraded":"2024-04-16T13:06:27.325135+0000","last_fullsized":"2024-04-16T13:06:27.325135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331197+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:28.331197+0000","last_peered":"2024-04-16T13:06:28.331197+0000","last_clean":"2024-04-16T13:06:28.331197+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:28.331197+0000","last_undegraded":"2024-04-16T13:06:28.331197+0000","last_fullsized":"2024-04-16T13:06:28.331197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606738+0000","last_change":"2024-04-16T13:06:23.261663+0000","last_active":"2024-04-16T13:06:28.606738+0000","last_peered":"2024-04-16T13:06:28.606738+0000","last_clean":"2024-04-16T13:06:28.606738+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:28.606738+0000","last_undegraded":"2024-04-16T13:06:28.606738+0000","last_fullsized":"2024-04-16T13:06:28.606738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:14.752238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328591+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:28.328591+0000","last_peered":"2024-04-16T13:06:28.328591+0000","last_clean":"2024-04-16T13:06:28.328591+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:28.328591+0000","last_undegraded":"2024-04-16T13:06:28.328591+0000","last_fullsized":"2024-04-16T13:06:28.328591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330961+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:28.330961+0000","last_peered":"2024-04-16T13:06:28.330961+0000","last_clean":"2024-04-16T13:06:28.330961+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:28.330961+0000","last_undegraded":"2024-04-16T13:06:28.330961+0000","last_fullsized":"2024-04-16T13:06:28.330961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330305+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:28.330305+0000","last_peered":"2024-04-16T13:06:28.330305+0000","last_clean":"2024-04-16T13:06:28.330305+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:28.330305+0000","last_undegraded":"2024-04-16T13:06:28.330305+0000","last_fullsized":"2024-04-16T13:06:28.330305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1085440,"data_stored":801904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":210436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":209966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":204120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":211500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":209944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":800256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:32.948 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:33.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.204+0000 7fb51d000640 1 Processor -- start 2024-04-16T13:06:33.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.204+0000 7fb51d000640 1 -- start start 2024-04-16T13:06:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb51d000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5181449b0 0x7fb51806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb51d000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb51815fe40 0x7fb51806f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb51d000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51815c9b0 con 0x7fb51815bbc0 2024-04-16T13:06:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb51d000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fb51815c760 con 0x7fb51815fe40 2024-04-16T13:06:33.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb51d000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb51815f360 con 0x7fb5181449b0 2024-04-16T13:06:33.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.206+0000 7fb515400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb51815fe40 0x7fb51806f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb51815fe40 0x7fb51806f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43294/0 (socket says 172.21.15.67:43294) 2024-04-16T13:06:33.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 -- 172.21.15.67:0/4078898521 learned_addr learned my addr 172.21.15.67:0/4078898521 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515e00640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5181449b0 0x7fb51806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 -- 172.21.15.67:0/4078898521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5181449b0 msgr2=0x7fb51806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5181449b0 0x7fb51806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 -- 172.21.15.67:0/4078898521 >> v1:172.21.15.82:6789/0 conn(0x7fb51815bbc0 legacy=0x7fb51815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:33.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.207+0000 7fb515400640 1 -- 172.21.15.67:0/4078898521 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51815f640 con 0x7fb51815fe40 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.208+0000 7fb515400640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51815fe40 0x7fb51806f500 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d93f7ffe4af68a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.209+0000 7fb514a00640 1 -- 172.21.15.67:0/4078898521 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504035020 con 0x7fb51815fe40 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.209+0000 7fb514a00640 1 -- 172.21.15.67:0/4078898521 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb504031640 con 0x7fb51815fe40 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.209+0000 7fb514a00640 1 -- 172.21.15.67:0/4078898521 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50402d040 con 0x7fb51815fe40 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.209+0000 7fb51d000640 1 -- 172.21.15.67:0/4078898521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51815fe40 msgr2=0x7fb51806f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.209+0000 7fb51d000640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51815fe40 0x7fb51806f500 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb504009870 tx=0x7fb50402b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 -- 172.21.15.67:0/4078898521 shutdown_connections 2024-04-16T13:06:33.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb51815fe40 0x7fb51806f500 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 --2- 172.21.15.67:0/4078898521 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb5181449b0 0x7fb51806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 -- 172.21.15.67:0/4078898521 >> 172.21.15.67:0/4078898521 conn(0x7fb518067d90 msgr2=0x7fb51806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 -- 172.21.15.67:0/4078898521 shutdown_connections 2024-04-16T13:06:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.210+0000 7fb51d000640 1 -- 172.21.15.67:0/4078898521 wait complete. 2024-04-16T13:06:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.212+0000 7fb51d000640 1 Processor -- start 2024-04-16T13:06:33.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.212+0000 7fb51d000640 1 -- start start 2024-04-16T13:06:33.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb51815bbc0 0x7fb5180b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb51815fe40 0x7fb5180b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180cd0e0 con 0x7fb5181449b0 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180ccf60 con 0x7fb51815bbc0 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb51d000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180cd260 con 0x7fb51815fe40 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43308/0 (socket says 172.21.15.67:43308) 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 -- 172.21.15.67:0/2445185474 learned_addr learned my addr 172.21.15.67:0/2445185474 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515400640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb51815bbc0 0x7fb5180b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 -- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb51815fe40 msgr2=0x7fb5180b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb51815fe40 0x7fb5180b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 -- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb51815bbc0 msgr2=0x7fb5180b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb51815bbc0 0x7fb5180b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.213+0000 7fb515e00640 1 -- 172.21.15.67:0/2445185474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5180af280 con 0x7fb5181449b0 2024-04-16T13:06:33.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb515e00640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d800 tx=0x7fb50800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50800b6c0 con 0x7fb5181449b0 2024-04-16T13:06:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508019070 con 0x7fb5181449b0 2024-04-16T13:06:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51813b1c0 con 0x7fb5181449b0 2024-04-16T13:06:33.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50800ba80 con 0x7fb5181449b0 2024-04-16T13:06:33.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.214+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51813ba60 con 0x7fb5181449b0 2024-04-16T13:06:33.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.215+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb518075bd0 con 0x7fb5181449b0 2024-04-16T13:06:33.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.216+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb50800bc20 con 0x7fb5181449b0 2024-04-16T13:06:33.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.217+0000 7fb50e000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 0x7fb4f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.217+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fb50808c180 con 0x7fb5181449b0 2024-04-16T13:06:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.218+0000 7fb515400640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 0x7fb4f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.219+0000 7fb515400640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 0x7fb4f806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb504036000 tx=0x7fb50403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.221+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5180af280 con 0x7fb5181449b0 2024-04-16T13:06:33.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.423+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5180b4340 con 0x7fb4f806c8f0 2024-04-16T13:06:33.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.442+0000 7fb50e000640 1 -- 172.21.15.67:0/2445185474 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7fb5180b4340 con 0x7fb4f806c8f0 2024-04-16T13:06:33.448 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 msgr2=0x7fb4f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 0x7fb4f806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb504036000 tx=0x7fb50403c040 comp rx=0 tx=0).stop 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 msgr2=0x7fb5180b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d800 tx=0x7fb50800dcc0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 shutdown_connections 2024-04-16T13:06:33.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fb4f806c8f0 0x7fb4f806edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fb51815fe40 0x7fb5180b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb51815bbc0 0x7fb5180b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 --2- 172.21.15.67:0/2445185474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5181449b0 0x7fb5180b1140 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.448+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 >> 172.21.15.67:0/2445185474 conn(0x7fb518067d90 msgr2=0x7fb5180b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.449+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 shutdown_connections 2024-04-16T13:06:33.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.449+0000 7fb51d000640 1 -- 172.21.15.67:0/2445185474 wait complete. 2024-04-16T13:06:33.470 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-16T13:06:32.534759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5029888,"data_stored":2851712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.231254"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607696+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:28.607696+0000","last_peered":"2024-04-16T13:06:28.607696+0000","last_clean":"2024-04-16T13:06:28.607696+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:28.607696+0000","last_undegraded":"2024-04-16T13:06:28.607696+0000","last_fullsized":"2024-04-16T13:06:28.607696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:44.728162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607337+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:28.607337+0000","last_peered":"2024-04-16T13:06:28.607337+0000","last_clean":"2024-04-16T13:06:28.607337+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:28.607337+0000","last_undegraded":"2024-04-16T13:06:28.607337+0000","last_fullsized":"2024-04-16T13:06:28.607337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:25.025727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331683+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:28.331683+0000","last_peered":"2024-04-16T13:06:28.331683+0000","last_clean":"2024-04-16T13:06:28.331683+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:28.331683+0000","last_undegraded":"2024-04-16T13:06:28.331683+0000","last_fullsized":"2024-04-16T13:06:28.331683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061695+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:28.061695+0000","last_peered":"2024-04-16T13:06:28.061695+0000","last_clean":"2024-04-16T13:06:28.061695+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:28.061695+0000","last_undegraded":"2024-04-16T13:06:28.061695+0000","last_fullsized":"2024-04-16T13:06:28.061695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:44:17.566480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061458+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:28.061458+0000","last_peered":"2024-04-16T13:06:28.061458+0000","last_clean":"2024-04-16T13:06:28.061458+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:28.061458+0000","last_undegraded":"2024-04-16T13:06:28.061458+0000","last_fullsized":"2024-04-16T13:06:28.061458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:18.191612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324427+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:28.324427+0000","last_peered":"2024-04-16T13:06:28.324427+0000","last_clean":"2024-04-16T13:06:28.324427+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:28.324427+0000","last_undegraded":"2024-04-16T13:06:28.324427+0000","last_fullsized":"2024-04-16T13:06:28.324427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327163+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:28.327163+0000","last_peered":"2024-04-16T13:06:28.327163+0000","last_clean":"2024-04-16T13:06:28.327163+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:28.327163+0000","last_undegraded":"2024-04-16T13:06:28.327163+0000","last_fullsized":"2024-04-16T13:06:28.327163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606560+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:28.606560+0000","last_peered":"2024-04-16T13:06:28.606560+0000","last_clean":"2024-04-16T13:06:28.606560+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:28.606560+0000","last_undegraded":"2024-04-16T13:06:28.606560+0000","last_fullsized":"2024-04-16T13:06:28.606560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331998+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:28.331998+0000","last_peered":"2024-04-16T13:06:28.331998+0000","last_clean":"2024-04-16T13:06:28.331998+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:28.331998+0000","last_undegraded":"2024-04-16T13:06:28.331998+0000","last_fullsized":"2024-04-16T13:06:28.331998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329152+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:28.329152+0000","last_peered":"2024-04-16T13:06:28.329152+0000","last_clean":"2024-04-16T13:06:28.329152+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:28.329152+0000","last_undegraded":"2024-04-16T13:06:28.329152+0000","last_fullsized":"2024-04-16T13:06:28.329152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328808+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:28.328808+0000","last_peered":"2024-04-16T13:06:28.328808+0000","last_clean":"2024-04-16T13:06:28.328808+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:28.328808+0000","last_undegraded":"2024-04-16T13:06:28.328808+0000","last_fullsized":"2024-04-16T13:06:28.328808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332432+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:28.332432+0000","last_peered":"2024-04-16T13:06:28.332432+0000","last_clean":"2024-04-16T13:06:28.332432+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:28.332432+0000","last_undegraded":"2024-04-16T13:06:28.332432+0000","last_fullsized":"2024-04-16T13:06:28.332432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328023+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:28.328023+0000","last_peered":"2024-04-16T13:06:28.328023+0000","last_clean":"2024-04-16T13:06:28.328023+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:28.328023+0000","last_undegraded":"2024-04-16T13:06:28.328023+0000","last_fullsized":"2024-04-16T13:06:28.328023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325517+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:27.325517+0000","last_peered":"2024-04-16T13:06:27.325517+0000","last_clean":"2024-04-16T13:06:27.325517+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:27.325517+0000","last_undegraded":"2024-04-16T13:06:27.325517+0000","last_fullsized":"2024-04-16T13:06:27.325517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327377+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:28.327377+0000","last_peered":"2024-04-16T13:06:28.327377+0000","last_clean":"2024-04-16T13:06:28.327377+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:28.327377+0000","last_undegraded":"2024-04-16T13:06:28.327377+0000","last_fullsized":"2024-04-16T13:06:28.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329786+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:28.329786+0000","last_peered":"2024-04-16T13:06:28.329786+0000","last_clean":"2024-04-16T13:06:28.329786+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:28.329786+0000","last_undegraded":"2024-04-16T13:06:28.329786+0000","last_fullsized":"2024-04-16T13:06:28.329786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331058+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:28.331058+0000","last_peered":"2024-04-16T13:06:28.331058+0000","last_clean":"2024-04-16T13:06:28.331058+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:28.331058+0000","last_undegraded":"2024-04-16T13:06:28.331058+0000","last_fullsized":"2024-04-16T13:06:28.331058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740260+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:28.740260+0000","last_peered":"2024-04-16T13:06:28.740260+0000","last_clean":"2024-04-16T13:06:28.740260+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:28.740260+0000","last_undegraded":"2024-04-16T13:06:28.740260+0000","last_fullsized":"2024-04-16T13:06:28.740260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061795+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:28.061795+0000","last_peered":"2024-04-16T13:06:28.061795+0000","last_clean":"2024-04-16T13:06:28.061795+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:28.061795+0000","last_undegraded":"2024-04-16T13:06:28.061795+0000","last_fullsized":"2024-04-16T13:06:28.061795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:26.743151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739999+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:28.739999+0000","last_peered":"2024-04-16T13:06:28.739999+0000","last_clean":"2024-04-16T13:06:28.739999+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:28.739999+0000","last_undegraded":"2024-04-16T13:06:28.739999+0000","last_fullsized":"2024-04-16T13:06:28.739999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328029+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:28.328029+0000","last_peered":"2024-04-16T13:06:28.328029+0000","last_clean":"2024-04-16T13:06:28.328029+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:28.328029+0000","last_undegraded":"2024-04-16T13:06:28.328029+0000","last_fullsized":"2024-04-16T13:06:28.328029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326220+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:27.326220+0000","last_peered":"2024-04-16T13:06:27.326220+0000","last_clean":"2024-04-16T13:06:27.326220+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:27.326220+0000","last_undegraded":"2024-04-16T13:06:27.326220+0000","last_fullsized":"2024-04-16T13:06:27.326220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330022+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:28.330022+0000","last_peered":"2024-04-16T13:06:28.330022+0000","last_clean":"2024-04-16T13:06:28.330022+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:28.330022+0000","last_undegraded":"2024-04-16T13:06:28.330022+0000","last_fullsized":"2024-04-16T13:06:28.330022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061471+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:28.061471+0000","last_peered":"2024-04-16T13:06:28.061471+0000","last_clean":"2024-04-16T13:06:28.061471+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:28.061471+0000","last_undegraded":"2024-04-16T13:06:28.061471+0000","last_fullsized":"2024-04-16T13:06:28.061471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:56.223862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740428+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:28.740428+0000","last_peered":"2024-04-16T13:06:28.740428+0000","last_clean":"2024-04-16T13:06:28.740428+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:28.740428+0000","last_undegraded":"2024-04-16T13:06:28.740428+0000","last_fullsized":"2024-04-16T13:06:28.740428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324862+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:28.324862+0000","last_peered":"2024-04-16T13:06:28.324862+0000","last_clean":"2024-04-16T13:06:28.324862+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:28.324862+0000","last_undegraded":"2024-04-16T13:06:28.324862+0000","last_fullsized":"2024-04-16T13:06:28.324862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740255+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:28.740255+0000","last_peered":"2024-04-16T13:06:28.740255+0000","last_clean":"2024-04-16T13:06:28.740255+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:28.740255+0000","last_undegraded":"2024-04-16T13:06:28.740255+0000","last_fullsized":"2024-04-16T13:06:28.740255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.612903+0000","last_change":"2024-04-16T13:06:28.609312+0000","last_active":"2024-04-16T13:06:28.612903+0000","last_peered":"2024-04-16T13:06:28.612903+0000","last_clean":"2024-04-16T13:06:28.612903+0000","last_became_active":"2024-04-16T13:06:28.608582+0000","last_became_peered":"2024-04-16T13:06:28.608582+0000","last_unstale":"2024-04-16T13:06:28.612903+0000","last_undegraded":"2024-04-16T13:06:28.612903+0000","last_fullsized":"2024-04-16T13:06:28.612903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739857+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:28.739857+0000","last_peered":"2024-04-16T13:06:28.739857+0000","last_clean":"2024-04-16T13:06:28.739857+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:28.739857+0000","last_undegraded":"2024-04-16T13:06:28.739857+0000","last_fullsized":"2024-04-16T13:06:28.739857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739833+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:28.739833+0000","last_peered":"2024-04-16T13:06:28.739833+0000","last_clean":"2024-04-16T13:06:28.739833+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:28.739833+0000","last_undegraded":"2024-04-16T13:06:28.739833+0000","last_fullsized":"2024-04-16T13:06:28.739833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330245+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:28.330245+0000","last_peered":"2024-04-16T13:06:28.330245+0000","last_clean":"2024-04-16T13:06:28.330245+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:28.330245+0000","last_undegraded":"2024-04-16T13:06:28.330245+0000","last_fullsized":"2024-04-16T13:06:28.330245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324519+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:28.324519+0000","last_peered":"2024-04-16T13:06:28.324519+0000","last_clean":"2024-04-16T13:06:28.324519+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:28.324519+0000","last_undegraded":"2024-04-16T13:06:28.324519+0000","last_fullsized":"2024-04-16T13:06:28.324519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330380+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:28.330380+0000","last_peered":"2024-04-16T13:06:28.330380+0000","last_clean":"2024-04-16T13:06:28.330380+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:28.330380+0000","last_undegraded":"2024-04-16T13:06:28.330380+0000","last_fullsized":"2024-04-16T13:06:28.330380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740417+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:28.740417+0000","last_peered":"2024-04-16T13:06:28.740417+0000","last_clean":"2024-04-16T13:06:28.740417+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:28.740417+0000","last_undegraded":"2024-04-16T13:06:28.740417+0000","last_fullsized":"2024-04-16T13:06:28.740417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324999+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:28.324999+0000","last_peered":"2024-04-16T13:06:28.324999+0000","last_clean":"2024-04-16T13:06:28.324999+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:28.324999+0000","last_undegraded":"2024-04-16T13:06:28.324999+0000","last_fullsized":"2024-04-16T13:06:28.324999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332177+0000","last_change":"2024-04-16T13:06:23.273252+0000","last_active":"2024-04-16T13:06:28.332177+0000","last_peered":"2024-04-16T13:06:28.332177+0000","last_clean":"2024-04-16T13:06:28.332177+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:28.332177+0000","last_undegraded":"2024-04-16T13:06:28.332177+0000","last_fullsized":"2024-04-16T13:06:28.332177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325775+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:27.325775+0000","last_peered":"2024-04-16T13:06:27.325775+0000","last_clean":"2024-04-16T13:06:27.325775+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:27.325775+0000","last_undegraded":"2024-04-16T13:06:27.325775+0000","last_fullsized":"2024-04-16T13:06:27.325775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325196+0000","last_change":"2024-04-16T13:06:23.272459+0000","last_active":"2024-04-16T13:06:28.325196+0000","last_peered":"2024-04-16T13:06:28.325196+0000","last_clean":"2024-04-16T13:06:28.325196+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:28.325196+0000","last_undegraded":"2024-04-16T13:06:28.325196+0000","last_fullsized":"2024-04-16T13:06:28.325196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607491+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:28.607491+0000","last_peered":"2024-04-16T13:06:28.607491+0000","last_clean":"2024-04-16T13:06:28.607491+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:28.607491+0000","last_undegraded":"2024-04-16T13:06:28.607491+0000","last_fullsized":"2024-04-16T13:06:28.607491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:11.345104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326017+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:27.326017+0000","last_peered":"2024-04-16T13:06:27.326017+0000","last_clean":"2024-04-16T13:06:27.326017+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:27.326017+0000","last_undegraded":"2024-04-16T13:06:27.326017+0000","last_fullsized":"2024-04-16T13:06:27.326017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331436+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:28.331436+0000","last_peered":"2024-04-16T13:06:28.331436+0000","last_clean":"2024-04-16T13:06:28.331436+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:28.331436+0000","last_undegraded":"2024-04-16T13:06:28.331436+0000","last_fullsized":"2024-04-16T13:06:28.331436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328319+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:28.328319+0000","last_peered":"2024-04-16T13:06:28.328319+0000","last_clean":"2024-04-16T13:06:28.328319+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:28.328319+0000","last_undegraded":"2024-04-16T13:06:28.328319+0000","last_fullsized":"2024-04-16T13:06:28.328319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327481+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:28.327481+0000","last_peered":"2024-04-16T13:06:28.327481+0000","last_clean":"2024-04-16T13:06:28.327481+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:28.327481+0000","last_undegraded":"2024-04-16T13:06:28.327481+0000","last_fullsized":"2024-04-16T13:06:28.327481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:49.571417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330643+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:28.330643+0000","last_peered":"2024-04-16T13:06:28.330643+0000","last_clean":"2024-04-16T13:06:28.330643+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:28.330643+0000","last_undegraded":"2024-04-16T13:06:28.330643+0000","last_fullsized":"2024-04-16T13:06:28.330643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326321+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:27.326321+0000","last_peered":"2024-04-16T13:06:27.326321+0000","last_clean":"2024-04-16T13:06:27.326321+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:27.326321+0000","last_undegraded":"2024-04-16T13:06:27.326321+0000","last_fullsized":"2024-04-16T13:06:27.326321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324529+0000","last_change":"2024-04-16T13:06:23.268772+0000","last_active":"2024-04-16T13:06:28.324529+0000","last_peered":"2024-04-16T13:06:28.324529+0000","last_clean":"2024-04-16T13:06:28.324529+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:28.324529+0000","last_undegraded":"2024-04-16T13:06:28.324529+0000","last_fullsized":"2024-04-16T13:06:28.324529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606893+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:28.606893+0000","last_peered":"2024-04-16T13:06:28.606893+0000","last_clean":"2024-04-16T13:06:28.606893+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:28.606893+0000","last_undegraded":"2024-04-16T13:06:28.606893+0000","last_fullsized":"2024-04-16T13:06:28.606893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:53.084243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325131+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:27.325131+0000","last_peered":"2024-04-16T13:06:27.325131+0000","last_clean":"2024-04-16T13:06:27.325131+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:27.325131+0000","last_undegraded":"2024-04-16T13:06:27.325131+0000","last_fullsized":"2024-04-16T13:06:27.325131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061787+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:28.061787+0000","last_peered":"2024-04-16T13:06:28.061787+0000","last_clean":"2024-04-16T13:06:28.061787+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:28.061787+0000","last_undegraded":"2024-04-16T13:06:28.061787+0000","last_fullsized":"2024-04-16T13:06:28.061787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:26.276830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607756+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:28.607756+0000","last_peered":"2024-04-16T13:06:28.607756+0000","last_clean":"2024-04-16T13:06:28.607756+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:28.607756+0000","last_undegraded":"2024-04-16T13:06:28.607756+0000","last_fullsized":"2024-04-16T13:06:28.607756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:30.702356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330721+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:28.330721+0000","last_peered":"2024-04-16T13:06:28.330721+0000","last_clean":"2024-04-16T13:06:28.330721+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:28.330721+0000","last_undegraded":"2024-04-16T13:06:28.330721+0000","last_fullsized":"2024-04-16T13:06:28.330721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329445+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:28.329445+0000","last_peered":"2024-04-16T13:06:28.329445+0000","last_clean":"2024-04-16T13:06:28.329445+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:28.329445+0000","last_undegraded":"2024-04-16T13:06:28.329445+0000","last_fullsized":"2024-04-16T13:06:28.329445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331916+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:28.331916+0000","last_peered":"2024-04-16T13:06:28.331916+0000","last_clean":"2024-04-16T13:06:28.331916+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:28.331916+0000","last_undegraded":"2024-04-16T13:06:28.331916+0000","last_fullsized":"2024-04-16T13:06:28.331916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328786+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:28.328786+0000","last_peered":"2024-04-16T13:06:28.328786+0000","last_clean":"2024-04-16T13:06:28.328786+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:28.328786+0000","last_undegraded":"2024-04-16T13:06:28.328786+0000","last_fullsized":"2024-04-16T13:06:28.328786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326814+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:27.326814+0000","last_peered":"2024-04-16T13:06:27.326814+0000","last_clean":"2024-04-16T13:06:27.326814+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:27.326814+0000","last_undegraded":"2024-04-16T13:06:27.326814+0000","last_fullsized":"2024-04-16T13:06:27.326814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607420+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:28.607420+0000","last_peered":"2024-04-16T13:06:28.607420+0000","last_clean":"2024-04-16T13:06:28.607420+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:28.607420+0000","last_undegraded":"2024-04-16T13:06:28.607420+0000","last_fullsized":"2024-04-16T13:06:28.607420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:13.322320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331551+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:28.331551+0000","last_peered":"2024-04-16T13:06:28.331551+0000","last_clean":"2024-04-16T13:06:28.331551+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:28.331551+0000","last_undegraded":"2024-04-16T13:06:28.331551+0000","last_fullsized":"2024-04-16T13:06:28.331551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607113+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:28.607113+0000","last_peered":"2024-04-16T13:06:28.607113+0000","last_clean":"2024-04-16T13:06:28.607113+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:28.607113+0000","last_undegraded":"2024-04-16T13:06:28.607113+0000","last_fullsized":"2024-04-16T13:06:28.607113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:46.791311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606764+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:28.606764+0000","last_peered":"2024-04-16T13:06:28.606764+0000","last_clean":"2024-04-16T13:06:28.606764+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:28.606764+0000","last_undegraded":"2024-04-16T13:06:28.606764+0000","last_fullsized":"2024-04-16T13:06:28.606764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324548+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:28.324548+0000","last_peered":"2024-04-16T13:06:28.324548+0000","last_clean":"2024-04-16T13:06:28.324548+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:28.324548+0000","last_undegraded":"2024-04-16T13:06:28.324548+0000","last_fullsized":"2024-04-16T13:06:28.324548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330536+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:28.330536+0000","last_peered":"2024-04-16T13:06:28.330536+0000","last_clean":"2024-04-16T13:06:28.330536+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:28.330536+0000","last_undegraded":"2024-04-16T13:06:28.330536+0000","last_fullsized":"2024-04-16T13:06:28.330536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739722+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:28.739722+0000","last_peered":"2024-04-16T13:06:28.739722+0000","last_clean":"2024-04-16T13:06:28.739722+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:28.739722+0000","last_undegraded":"2024-04-16T13:06:28.739722+0000","last_fullsized":"2024-04-16T13:06:28.739722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606999+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:28.606999+0000","last_peered":"2024-04-16T13:06:28.606999+0000","last_clean":"2024-04-16T13:06:28.606999+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:28.606999+0000","last_undegraded":"2024-04-16T13:06:28.606999+0000","last_fullsized":"2024-04-16T13:06:28.606999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:35.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329993+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:28.329993+0000","last_peered":"2024-04-16T13:06:28.329993+0000","last_clean":"2024-04-16T13:06:28.329993+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:28.329993+0000","last_undegraded":"2024-04-16T13:06:28.329993+0000","last_fullsized":"2024-04-16T13:06:28.329993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607244+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:28.607244+0000","last_peered":"2024-04-16T13:06:28.607244+0000","last_clean":"2024-04-16T13:06:28.607244+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:28.607244+0000","last_undegraded":"2024-04-16T13:06:28.607244+0000","last_fullsized":"2024-04-16T13:06:28.607244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:23.242434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328876+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:28.328876+0000","last_peered":"2024-04-16T13:06:28.328876+0000","last_clean":"2024-04-16T13:06:28.328876+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:28.328876+0000","last_undegraded":"2024-04-16T13:06:28.328876+0000","last_fullsized":"2024-04-16T13:06:28.328876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328495+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:28.328495+0000","last_peered":"2024-04-16T13:06:28.328495+0000","last_clean":"2024-04-16T13:06:28.328495+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:28.328495+0000","last_undegraded":"2024-04-16T13:06:28.328495+0000","last_fullsized":"2024-04-16T13:06:28.328495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325863+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:27.325863+0000","last_peered":"2024-04-16T13:06:27.325863+0000","last_clean":"2024-04-16T13:06:27.325863+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:27.325863+0000","last_undegraded":"2024-04-16T13:06:27.325863+0000","last_fullsized":"2024-04-16T13:06:27.325863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325623+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:27.325623+0000","last_peered":"2024-04-16T13:06:27.325623+0000","last_clean":"2024-04-16T13:06:27.325623+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:27.325623+0000","last_undegraded":"2024-04-16T13:06:27.325623+0000","last_fullsized":"2024-04-16T13:06:27.325623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061847+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:28.061847+0000","last_peered":"2024-04-16T13:06:28.061847+0000","last_clean":"2024-04-16T13:06:28.061847+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:28.061847+0000","last_undegraded":"2024-04-16T13:06:28.061847+0000","last_fullsized":"2024-04-16T13:06:28.061847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:14.630151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062058+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:28.062058+0000","last_peered":"2024-04-16T13:06:28.062058+0000","last_clean":"2024-04-16T13:06:28.062058+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:28.062058+0000","last_undegraded":"2024-04-16T13:06:28.062058+0000","last_fullsized":"2024-04-16T13:06:28.062058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:50.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324921+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:28.324921+0000","last_peered":"2024-04-16T13:06:28.324921+0000","last_clean":"2024-04-16T13:06:28.324921+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:28.324921+0000","last_undegraded":"2024-04-16T13:06:28.324921+0000","last_fullsized":"2024-04-16T13:06:28.324921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330039+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:28.330039+0000","last_peered":"2024-04-16T13:06:28.330039+0000","last_clean":"2024-04-16T13:06:28.330039+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:28.330039+0000","last_undegraded":"2024-04-16T13:06:28.330039+0000","last_fullsized":"2024-04-16T13:06:28.330039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061592+0000","last_change":"2024-04-16T13:06:23.268372+0000","last_active":"2024-04-16T13:06:28.061592+0000","last_peered":"2024-04-16T13:06:28.061592+0000","last_clean":"2024-04-16T13:06:28.061592+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:28.061592+0000","last_undegraded":"2024-04-16T13:06:28.061592+0000","last_fullsized":"2024-04-16T13:06:28.061592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:12:28.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331732+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:28.331732+0000","last_peered":"2024-04-16T13:06:28.331732+0000","last_clean":"2024-04-16T13:06:28.331732+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:28.331732+0000","last_undegraded":"2024-04-16T13:06:28.331732+0000","last_fullsized":"2024-04-16T13:06:28.331732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061708+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:28.061708+0000","last_peered":"2024-04-16T13:06:28.061708+0000","last_clean":"2024-04-16T13:06:28.061708+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:28.061708+0000","last_undegraded":"2024-04-16T13:06:28.061708+0000","last_fullsized":"2024-04-16T13:06:28.061708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:46:00.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327885+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:28.327885+0000","last_peered":"2024-04-16T13:06:28.327885+0000","last_clean":"2024-04-16T13:06:28.327885+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:28.327885+0000","last_undegraded":"2024-04-16T13:06:28.327885+0000","last_fullsized":"2024-04-16T13:06:28.327885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330334+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:28.330334+0000","last_peered":"2024-04-16T13:06:28.330334+0000","last_clean":"2024-04-16T13:06:28.330334+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:28.330334+0000","last_undegraded":"2024-04-16T13:06:28.330334+0000","last_fullsized":"2024-04-16T13:06:28.330334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607055+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:28.607055+0000","last_peered":"2024-04-16T13:06:28.607055+0000","last_clean":"2024-04-16T13:06:28.607055+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:28.607055+0000","last_undegraded":"2024-04-16T13:06:28.607055+0000","last_fullsized":"2024-04-16T13:06:28.607055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:18.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061783+0000","last_change":"2024-04-16T13:06:23.263252+0000","last_active":"2024-04-16T13:06:28.061783+0000","last_peered":"2024-04-16T13:06:28.061783+0000","last_clean":"2024-04-16T13:06:28.061783+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:28.061783+0000","last_undegraded":"2024-04-16T13:06:28.061783+0000","last_fullsized":"2024-04-16T13:06:28.061783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:57:38.175317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324976+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:28.324976+0000","last_peered":"2024-04-16T13:06:28.324976+0000","last_clean":"2024-04-16T13:06:28.324976+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:28.324976+0000","last_undegraded":"2024-04-16T13:06:28.324976+0000","last_fullsized":"2024-04-16T13:06:28.324976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329035+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:28.329035+0000","last_peered":"2024-04-16T13:06:28.329035+0000","last_clean":"2024-04-16T13:06:28.329035+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:28.329035+0000","last_undegraded":"2024-04-16T13:06:28.329035+0000","last_fullsized":"2024-04-16T13:06:28.329035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330966+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:28.330966+0000","last_peered":"2024-04-16T13:06:28.330966+0000","last_clean":"2024-04-16T13:06:28.330966+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:28.330966+0000","last_undegraded":"2024-04-16T13:06:28.330966+0000","last_fullsized":"2024-04-16T13:06:28.330966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062171+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:28.062171+0000","last_peered":"2024-04-16T13:06:28.062171+0000","last_clean":"2024-04-16T13:06:28.062171+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:28.062171+0000","last_undegraded":"2024-04-16T13:06:28.062171+0000","last_fullsized":"2024-04-16T13:06:28.062171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:33.550187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607587+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:28.607587+0000","last_peered":"2024-04-16T13:06:28.607587+0000","last_clean":"2024-04-16T13:06:28.607587+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:28.607587+0000","last_undegraded":"2024-04-16T13:06:28.607587+0000","last_fullsized":"2024-04-16T13:06:28.607587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:08.145583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331759+0000","last_change":"2024-04-16T13:06:23.265745+0000","last_active":"2024-04-16T13:06:28.331759+0000","last_peered":"2024-04-16T13:06:28.331759+0000","last_clean":"2024-04-16T13:06:28.331759+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:28.331759+0000","last_undegraded":"2024-04-16T13:06:28.331759+0000","last_fullsized":"2024-04-16T13:06:28.331759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331565+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:28.331565+0000","last_peered":"2024-04-16T13:06:28.331565+0000","last_clean":"2024-04-16T13:06:28.331565+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:28.331565+0000","last_undegraded":"2024-04-16T13:06:28.331565+0000","last_fullsized":"2024-04-16T13:06:28.331565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331937+0000","last_change":"2024-04-16T13:06:23.279016+0000","last_active":"2024-04-16T13:06:28.331937+0000","last_peered":"2024-04-16T13:06:28.331937+0000","last_clean":"2024-04-16T13:06:28.331937+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:28.331937+0000","last_undegraded":"2024-04-16T13:06:28.331937+0000","last_fullsized":"2024-04-16T13:06:28.331937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324658+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:28.324658+0000","last_peered":"2024-04-16T13:06:28.324658+0000","last_clean":"2024-04-16T13:06:28.324658+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:28.324658+0000","last_undegraded":"2024-04-16T13:06:28.324658+0000","last_fullsized":"2024-04-16T13:06:28.324658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739847+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:28.739847+0000","last_peered":"2024-04-16T13:06:28.739847+0000","last_clean":"2024-04-16T13:06:28.739847+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:28.739847+0000","last_undegraded":"2024-04-16T13:06:28.739847+0000","last_fullsized":"2024-04-16T13:06:28.739847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325826+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:27.325826+0000","last_peered":"2024-04-16T13:06:27.325826+0000","last_clean":"2024-04-16T13:06:27.325826+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:27.325826+0000","last_undegraded":"2024-04-16T13:06:27.325826+0000","last_fullsized":"2024-04-16T13:06:27.325826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325135+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:27.325135+0000","last_peered":"2024-04-16T13:06:27.325135+0000","last_clean":"2024-04-16T13:06:27.325135+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:27.325135+0000","last_undegraded":"2024-04-16T13:06:27.325135+0000","last_fullsized":"2024-04-16T13:06:27.325135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331197+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:28.331197+0000","last_peered":"2024-04-16T13:06:28.331197+0000","last_clean":"2024-04-16T13:06:28.331197+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:28.331197+0000","last_undegraded":"2024-04-16T13:06:28.331197+0000","last_fullsized":"2024-04-16T13:06:28.331197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606738+0000","last_change":"2024-04-16T13:06:23.261663+0000","last_active":"2024-04-16T13:06:28.606738+0000","last_peered":"2024-04-16T13:06:28.606738+0000","last_clean":"2024-04-16T13:06:28.606738+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:28.606738+0000","last_undegraded":"2024-04-16T13:06:28.606738+0000","last_fullsized":"2024-04-16T13:06:28.606738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:14.752238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328591+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:28.328591+0000","last_peered":"2024-04-16T13:06:28.328591+0000","last_clean":"2024-04-16T13:06:28.328591+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:28.328591+0000","last_undegraded":"2024-04-16T13:06:28.328591+0000","last_fullsized":"2024-04-16T13:06:28.328591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330961+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:28.330961+0000","last_peered":"2024-04-16T13:06:28.330961+0000","last_clean":"2024-04-16T13:06:28.330961+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:28.330961+0000","last_undegraded":"2024-04-16T13:06:28.330961+0000","last_fullsized":"2024-04-16T13:06:28.330961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330305+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:28.330305+0000","last_peered":"2024-04-16T13:06:28.330305+0000","last_clean":"2024-04-16T13:06:28.330305+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:28.330305+0000","last_undegraded":"2024-04-16T13:06:28.330305+0000","last_fullsized":"2024-04-16T13:06:28.330305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1085440,"data_stored":801904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":210436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":209966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":204120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":211500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":209944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":800256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:33.473 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-16T13:06:33.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:33.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.730+0000 7f4c9cc00640 1 Processor -- start 2024-04-16T13:06:33.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.730+0000 7f4c9cc00640 1 -- start start 2024-04-16T13:06:33.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c9806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c9cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4c98071e50 0x7f4c980722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c9cc00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9806ede0 con 0x7f4c9815f9a0 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c9cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f4c98072800 con 0x7f4c98071e50 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c9cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9815fde0 con 0x7f4c981450b0 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c96800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4c98071e50 0x7f4c980722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c96800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4c98071e50 0x7f4c980722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43320/0 (socket says 172.21.15.67:43320) 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.732+0000 7f4c96800640 1 -- 172.21.15.67:0/372878079 learned_addr learned my addr 172.21.15.67:0/372878079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.733+0000 7f4c96800640 1 -- 172.21.15.67:0/372878079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 msgr2=0x7f4c9806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.733+0000 7f4c95e00640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c9806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.733+0000 7f4c96800640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c9806deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.733+0000 7f4c96800640 1 -- 172.21.15.67:0/372878079 >> v1:172.21.15.82:6789/0 conn(0x7f4c9815f9a0 legacy=0x7f4c981602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:33.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.733+0000 7f4c96800640 1 -- 172.21.15.67:0/372878079 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9806e540 con 0x7f4c98071e50 2024-04-16T13:06:33.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.734+0000 7f4c96800640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c98071e50 0x7f4c980722c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c98071ca0 tx=0x7f4c9002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1fb94bb0ff3d96 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.734+0000 7f4c95400640 1 -- 172.21.15.67:0/372878079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9002c9a0 con 0x7f4c98071e50 2024-04-16T13:06:33.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.734+0000 7f4c95400640 1 -- 172.21.15.67:0/372878079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9002cb40 con 0x7f4c98071e50 2024-04-16T13:06:33.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.734+0000 7f4c95400640 1 -- 172.21.15.67:0/372878079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c900343f0 con 0x7f4c98071e50 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 -- 172.21.15.67:0/372878079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c98071e50 msgr2=0x7f4c980722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c98071e50 0x7f4c980722c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c98071ca0 tx=0x7f4c9002be00 comp rx=0 tx=0).stop 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 -- 172.21.15.67:0/372878079 shutdown_connections 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c98071e50 0x7f4c980722c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/372878079 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c9806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 -- 172.21.15.67:0/372878079 >> 172.21.15.67:0/372878079 conn(0x7f4c98067d90 msgr2=0x7f4c9806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:33.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 -- 172.21.15.67:0/372878079 shutdown_connections 2024-04-16T13:06:33.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.735+0000 7f4c9cc00640 1 -- 172.21.15.67:0/372878079 wait complete. 2024-04-16T13:06:33.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.737+0000 7f4c9cc00640 1 Processor -- start 2024-04-16T13:06:33.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.737+0000 7f4c9cc00640 1 -- start start 2024-04-16T13:06:33.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c98071e50 0x7f4c981f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c980ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4c980aee60 con 0x7f4c9815f9a0 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9806eb00 con 0x7f4c98071e50 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c9cc00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f4c980af380 con 0x7f4c981450b0 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c96800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c96800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43334/0 (socket says 172.21.15.67:43334) 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.738+0000 7f4c96800640 1 -- 172.21.15.67:0/2623821630 learned_addr learned my addr 172.21.15.67:0/2623821630 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c8d400640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c980ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c95e00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c98071e50 0x7f4c981f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 -- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 msgr2=0x7f4c980ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c980ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 -- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c98071e50 msgr2=0x7f4c981f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c98071e50 0x7f4c981f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 -- 172.21.15.67:0/2623821630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981f4dc0 con 0x7f4c9815f9a0 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c96800640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009f40 tx=0x7f4c90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90043020 con 0x7f4c9815f9a0 2024-04-16T13:06:33.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9003e450 con 0x7f4c9815f9a0 2024-04-16T13:06:33.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9003e860 con 0x7f4c9815f9a0 2024-04-16T13:06:33.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.739+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981f5090 con 0x7f4c9815f9a0 2024-04-16T13:06:33.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.740+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981f5650 con 0x7f4c9815f9a0 2024-04-16T13:06:33.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.741+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98075bd0 con 0x7f4c9815f9a0 2024-04-16T13:06:33.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.742+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c90005d10 con 0x7f4c9815f9a0 2024-04-16T13:06:33.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.743+0000 7f4c8ea00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 0x7f4c7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:33.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.743+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f4c900ae9c0 con 0x7f4c9815f9a0 2024-04-16T13:06:33.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.743+0000 7f4c95e00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 0x7f4c7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:33.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.744+0000 7f4c95e00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 0x7f4c7406edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c88006fd0 tx=0x7f4c88008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:33.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.747+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c9007cba0 con 0x7f4c9815f9a0 2024-04-16T13:06:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.952+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c980b2b10 con 0x7f4c7406c8f0 2024-04-16T13:06:33.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.971+0000 7f4c8ea00640 1 -- 172.21.15.67:0/2623821630 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251949 (secure 0 0 0) 0x7f4c980b2b10 con 0x7f4c7406c8f0 2024-04-16T13:06:33.976 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:33.978 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:33.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 msgr2=0x7f4c7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 0x7f4c7406edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c88006fd0 tx=0x7f4c88008040 comp rx=0 tx=0).stop 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 msgr2=0x7f4c98160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009f40 tx=0x7f4c90004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 shutdown_connections 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f4c7406c8f0 0x7f4c7406edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c9815f9a0 0x7f4c98160ca0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f4c981450b0 0x7f4c980ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 --2- 172.21.15.67:0/2623821630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c98071e50 0x7f4c981f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:33.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 >> 172.21.15.67:0/2623821630 conn(0x7f4c98067d90 msgr2=0x7f4c98143840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:33.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 shutdown_connections 2024-04-16T13:06:33.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:33.976+0000 7f4c9cc00640 1 -- 172.21.15.67:0/2623821630 wait complete. 2024-04-16T13:06:33.999 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-16T13:06:32.534759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5029888,"data_stored":2851712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.231254"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607696+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:28.607696+0000","last_peered":"2024-04-16T13:06:28.607696+0000","last_clean":"2024-04-16T13:06:28.607696+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:28.607696+0000","last_undegraded":"2024-04-16T13:06:28.607696+0000","last_fullsized":"2024-04-16T13:06:28.607696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:29:44.728162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607337+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:28.607337+0000","last_peered":"2024-04-16T13:06:28.607337+0000","last_clean":"2024-04-16T13:06:28.607337+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:28.607337+0000","last_undegraded":"2024-04-16T13:06:28.607337+0000","last_fullsized":"2024-04-16T13:06:28.607337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:25.025727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331683+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:28.331683+0000","last_peered":"2024-04-16T13:06:28.331683+0000","last_clean":"2024-04-16T13:06:28.331683+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:28.331683+0000","last_undegraded":"2024-04-16T13:06:28.331683+0000","last_fullsized":"2024-04-16T13:06:28.331683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061695+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:28.061695+0000","last_peered":"2024-04-16T13:06:28.061695+0000","last_clean":"2024-04-16T13:06:28.061695+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:28.061695+0000","last_undegraded":"2024-04-16T13:06:28.061695+0000","last_fullsized":"2024-04-16T13:06:28.061695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:44:17.566480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061458+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:28.061458+0000","last_peered":"2024-04-16T13:06:28.061458+0000","last_clean":"2024-04-16T13:06:28.061458+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:28.061458+0000","last_undegraded":"2024-04-16T13:06:28.061458+0000","last_fullsized":"2024-04-16T13:06:28.061458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:18.191612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324427+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:28.324427+0000","last_peered":"2024-04-16T13:06:28.324427+0000","last_clean":"2024-04-16T13:06:28.324427+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:28.324427+0000","last_undegraded":"2024-04-16T13:06:28.324427+0000","last_fullsized":"2024-04-16T13:06:28.324427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:36.557843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327163+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:28.327163+0000","last_peered":"2024-04-16T13:06:28.327163+0000","last_clean":"2024-04-16T13:06:28.327163+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:28.327163+0000","last_undegraded":"2024-04-16T13:06:28.327163+0000","last_fullsized":"2024-04-16T13:06:28.327163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606560+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:28.606560+0000","last_peered":"2024-04-16T13:06:28.606560+0000","last_clean":"2024-04-16T13:06:28.606560+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:28.606560+0000","last_undegraded":"2024-04-16T13:06:28.606560+0000","last_fullsized":"2024-04-16T13:06:28.606560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331998+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:28.331998+0000","last_peered":"2024-04-16T13:06:28.331998+0000","last_clean":"2024-04-16T13:06:28.331998+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:28.331998+0000","last_undegraded":"2024-04-16T13:06:28.331998+0000","last_fullsized":"2024-04-16T13:06:28.331998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329152+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:28.329152+0000","last_peered":"2024-04-16T13:06:28.329152+0000","last_clean":"2024-04-16T13:06:28.329152+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:28.329152+0000","last_undegraded":"2024-04-16T13:06:28.329152+0000","last_fullsized":"2024-04-16T13:06:28.329152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328808+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:28.328808+0000","last_peered":"2024-04-16T13:06:28.328808+0000","last_clean":"2024-04-16T13:06:28.328808+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:28.328808+0000","last_undegraded":"2024-04-16T13:06:28.328808+0000","last_fullsized":"2024-04-16T13:06:28.328808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332432+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:28.332432+0000","last_peered":"2024-04-16T13:06:28.332432+0000","last_clean":"2024-04-16T13:06:28.332432+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:28.332432+0000","last_undegraded":"2024-04-16T13:06:28.332432+0000","last_fullsized":"2024-04-16T13:06:28.332432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328023+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:28.328023+0000","last_peered":"2024-04-16T13:06:28.328023+0000","last_clean":"2024-04-16T13:06:28.328023+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:28.328023+0000","last_undegraded":"2024-04-16T13:06:28.328023+0000","last_fullsized":"2024-04-16T13:06:28.328023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325517+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:27.325517+0000","last_peered":"2024-04-16T13:06:27.325517+0000","last_clean":"2024-04-16T13:06:27.325517+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:27.325517+0000","last_undegraded":"2024-04-16T13:06:27.325517+0000","last_fullsized":"2024-04-16T13:06:27.325517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327377+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:28.327377+0000","last_peered":"2024-04-16T13:06:28.327377+0000","last_clean":"2024-04-16T13:06:28.327377+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:28.327377+0000","last_undegraded":"2024-04-16T13:06:28.327377+0000","last_fullsized":"2024-04-16T13:06:28.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329786+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:28.329786+0000","last_peered":"2024-04-16T13:06:28.329786+0000","last_clean":"2024-04-16T13:06:28.329786+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:28.329786+0000","last_undegraded":"2024-04-16T13:06:28.329786+0000","last_fullsized":"2024-04-16T13:06:28.329786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331058+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:28.331058+0000","last_peered":"2024-04-16T13:06:28.331058+0000","last_clean":"2024-04-16T13:06:28.331058+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:28.331058+0000","last_undegraded":"2024-04-16T13:06:28.331058+0000","last_fullsized":"2024-04-16T13:06:28.331058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740260+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:28.740260+0000","last_peered":"2024-04-16T13:06:28.740260+0000","last_clean":"2024-04-16T13:06:28.740260+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:28.740260+0000","last_undegraded":"2024-04-16T13:06:28.740260+0000","last_fullsized":"2024-04-16T13:06:28.740260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061795+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:28.061795+0000","last_peered":"2024-04-16T13:06:28.061795+0000","last_clean":"2024-04-16T13:06:28.061795+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:28.061795+0000","last_undegraded":"2024-04-16T13:06:28.061795+0000","last_fullsized":"2024-04-16T13:06:28.061795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:13:26.743151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739999+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:28.739999+0000","last_peered":"2024-04-16T13:06:28.739999+0000","last_clean":"2024-04-16T13:06:28.739999+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:28.739999+0000","last_undegraded":"2024-04-16T13:06:28.739999+0000","last_fullsized":"2024-04-16T13:06:28.739999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328029+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:28.328029+0000","last_peered":"2024-04-16T13:06:28.328029+0000","last_clean":"2024-04-16T13:06:28.328029+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:28.328029+0000","last_undegraded":"2024-04-16T13:06:28.328029+0000","last_fullsized":"2024-04-16T13:06:28.328029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326220+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:27.326220+0000","last_peered":"2024-04-16T13:06:27.326220+0000","last_clean":"2024-04-16T13:06:27.326220+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:27.326220+0000","last_undegraded":"2024-04-16T13:06:27.326220+0000","last_fullsized":"2024-04-16T13:06:27.326220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330022+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:28.330022+0000","last_peered":"2024-04-16T13:06:28.330022+0000","last_clean":"2024-04-16T13:06:28.330022+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:28.330022+0000","last_undegraded":"2024-04-16T13:06:28.330022+0000","last_fullsized":"2024-04-16T13:06:28.330022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061471+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:28.061471+0000","last_peered":"2024-04-16T13:06:28.061471+0000","last_clean":"2024-04-16T13:06:28.061471+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:28.061471+0000","last_undegraded":"2024-04-16T13:06:28.061471+0000","last_fullsized":"2024-04-16T13:06:28.061471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:36:56.223862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740428+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:28.740428+0000","last_peered":"2024-04-16T13:06:28.740428+0000","last_clean":"2024-04-16T13:06:28.740428+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:28.740428+0000","last_undegraded":"2024-04-16T13:06:28.740428+0000","last_fullsized":"2024-04-16T13:06:28.740428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324862+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:28.324862+0000","last_peered":"2024-04-16T13:06:28.324862+0000","last_clean":"2024-04-16T13:06:28.324862+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:28.324862+0000","last_undegraded":"2024-04-16T13:06:28.324862+0000","last_fullsized":"2024-04-16T13:06:28.324862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740255+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:28.740255+0000","last_peered":"2024-04-16T13:06:28.740255+0000","last_clean":"2024-04-16T13:06:28.740255+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:28.740255+0000","last_undegraded":"2024-04-16T13:06:28.740255+0000","last_fullsized":"2024-04-16T13:06:28.740255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.612903+0000","last_change":"2024-04-16T13:06:28.609312+0000","last_active":"2024-04-16T13:06:28.612903+0000","last_peered":"2024-04-16T13:06:28.612903+0000","last_clean":"2024-04-16T13:06:28.612903+0000","last_became_active":"2024-04-16T13:06:28.608582+0000","last_became_peered":"2024-04-16T13:06:28.608582+0000","last_unstale":"2024-04-16T13:06:28.612903+0000","last_undegraded":"2024-04-16T13:06:28.612903+0000","last_fullsized":"2024-04-16T13:06:28.612903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739857+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:28.739857+0000","last_peered":"2024-04-16T13:06:28.739857+0000","last_clean":"2024-04-16T13:06:28.739857+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:28.739857+0000","last_undegraded":"2024-04-16T13:06:28.739857+0000","last_fullsized":"2024-04-16T13:06:28.739857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739833+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:28.739833+0000","last_peered":"2024-04-16T13:06:28.739833+0000","last_clean":"2024-04-16T13:06:28.739833+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:28.739833+0000","last_undegraded":"2024-04-16T13:06:28.739833+0000","last_fullsized":"2024-04-16T13:06:28.739833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330245+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:28.330245+0000","last_peered":"2024-04-16T13:06:28.330245+0000","last_clean":"2024-04-16T13:06:28.330245+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:28.330245+0000","last_undegraded":"2024-04-16T13:06:28.330245+0000","last_fullsized":"2024-04-16T13:06:28.330245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324519+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:28.324519+0000","last_peered":"2024-04-16T13:06:28.324519+0000","last_clean":"2024-04-16T13:06:28.324519+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:28.324519+0000","last_undegraded":"2024-04-16T13:06:28.324519+0000","last_fullsized":"2024-04-16T13:06:28.324519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330380+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:28.330380+0000","last_peered":"2024-04-16T13:06:28.330380+0000","last_clean":"2024-04-16T13:06:28.330380+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:28.330380+0000","last_undegraded":"2024-04-16T13:06:28.330380+0000","last_fullsized":"2024-04-16T13:06:28.330380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740417+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:28.740417+0000","last_peered":"2024-04-16T13:06:28.740417+0000","last_clean":"2024-04-16T13:06:28.740417+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:28.740417+0000","last_undegraded":"2024-04-16T13:06:28.740417+0000","last_fullsized":"2024-04-16T13:06:28.740417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324999+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:28.324999+0000","last_peered":"2024-04-16T13:06:28.324999+0000","last_clean":"2024-04-16T13:06:28.324999+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:28.324999+0000","last_undegraded":"2024-04-16T13:06:28.324999+0000","last_fullsized":"2024-04-16T13:06:28.324999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332177+0000","last_change":"2024-04-16T13:06:23.273252+0000","last_active":"2024-04-16T13:06:28.332177+0000","last_peered":"2024-04-16T13:06:28.332177+0000","last_clean":"2024-04-16T13:06:28.332177+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:28.332177+0000","last_undegraded":"2024-04-16T13:06:28.332177+0000","last_fullsized":"2024-04-16T13:06:28.332177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325775+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:27.325775+0000","last_peered":"2024-04-16T13:06:27.325775+0000","last_clean":"2024-04-16T13:06:27.325775+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:27.325775+0000","last_undegraded":"2024-04-16T13:06:27.325775+0000","last_fullsized":"2024-04-16T13:06:27.325775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325196+0000","last_change":"2024-04-16T13:06:23.272459+0000","last_active":"2024-04-16T13:06:28.325196+0000","last_peered":"2024-04-16T13:06:28.325196+0000","last_clean":"2024-04-16T13:06:28.325196+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:28.325196+0000","last_undegraded":"2024-04-16T13:06:28.325196+0000","last_fullsized":"2024-04-16T13:06:28.325196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607491+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:28.607491+0000","last_peered":"2024-04-16T13:06:28.607491+0000","last_clean":"2024-04-16T13:06:28.607491+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:28.607491+0000","last_undegraded":"2024-04-16T13:06:28.607491+0000","last_fullsized":"2024-04-16T13:06:28.607491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:11.345104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326017+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:27.326017+0000","last_peered":"2024-04-16T13:06:27.326017+0000","last_clean":"2024-04-16T13:06:27.326017+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:27.326017+0000","last_undegraded":"2024-04-16T13:06:27.326017+0000","last_fullsized":"2024-04-16T13:06:27.326017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331436+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:28.331436+0000","last_peered":"2024-04-16T13:06:28.331436+0000","last_clean":"2024-04-16T13:06:28.331436+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:28.331436+0000","last_undegraded":"2024-04-16T13:06:28.331436+0000","last_fullsized":"2024-04-16T13:06:28.331436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328319+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:28.328319+0000","last_peered":"2024-04-16T13:06:28.328319+0000","last_clean":"2024-04-16T13:06:28.328319+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:28.328319+0000","last_undegraded":"2024-04-16T13:06:28.328319+0000","last_fullsized":"2024-04-16T13:06:28.328319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327481+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:28.327481+0000","last_peered":"2024-04-16T13:06:28.327481+0000","last_clean":"2024-04-16T13:06:28.327481+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:28.327481+0000","last_undegraded":"2024-04-16T13:06:28.327481+0000","last_fullsized":"2024-04-16T13:06:28.327481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:49.571417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330643+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:28.330643+0000","last_peered":"2024-04-16T13:06:28.330643+0000","last_clean":"2024-04-16T13:06:28.330643+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:28.330643+0000","last_undegraded":"2024-04-16T13:06:28.330643+0000","last_fullsized":"2024-04-16T13:06:28.330643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326321+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:27.326321+0000","last_peered":"2024-04-16T13:06:27.326321+0000","last_clean":"2024-04-16T13:06:27.326321+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:27.326321+0000","last_undegraded":"2024-04-16T13:06:27.326321+0000","last_fullsized":"2024-04-16T13:06:27.326321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324529+0000","last_change":"2024-04-16T13:06:23.268772+0000","last_active":"2024-04-16T13:06:28.324529+0000","last_peered":"2024-04-16T13:06:28.324529+0000","last_clean":"2024-04-16T13:06:28.324529+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:28.324529+0000","last_undegraded":"2024-04-16T13:06:28.324529+0000","last_fullsized":"2024-04-16T13:06:28.324529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606893+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:28.606893+0000","last_peered":"2024-04-16T13:06:28.606893+0000","last_clean":"2024-04-16T13:06:28.606893+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:28.606893+0000","last_undegraded":"2024-04-16T13:06:28.606893+0000","last_fullsized":"2024-04-16T13:06:28.606893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:53.084243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325131+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:27.325131+0000","last_peered":"2024-04-16T13:06:27.325131+0000","last_clean":"2024-04-16T13:06:27.325131+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:27.325131+0000","last_undegraded":"2024-04-16T13:06:27.325131+0000","last_fullsized":"2024-04-16T13:06:27.325131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061787+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:28.061787+0000","last_peered":"2024-04-16T13:06:28.061787+0000","last_clean":"2024-04-16T13:06:28.061787+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:28.061787+0000","last_undegraded":"2024-04-16T13:06:28.061787+0000","last_fullsized":"2024-04-16T13:06:28.061787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:26.276830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607756+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:28.607756+0000","last_peered":"2024-04-16T13:06:28.607756+0000","last_clean":"2024-04-16T13:06:28.607756+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:28.607756+0000","last_undegraded":"2024-04-16T13:06:28.607756+0000","last_fullsized":"2024-04-16T13:06:28.607756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:30.702356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330721+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:28.330721+0000","last_peered":"2024-04-16T13:06:28.330721+0000","last_clean":"2024-04-16T13:06:28.330721+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:28.330721+0000","last_undegraded":"2024-04-16T13:06:28.330721+0000","last_fullsized":"2024-04-16T13:06:28.330721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329445+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:28.329445+0000","last_peered":"2024-04-16T13:06:28.329445+0000","last_clean":"2024-04-16T13:06:28.329445+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:28.329445+0000","last_undegraded":"2024-04-16T13:06:28.329445+0000","last_fullsized":"2024-04-16T13:06:28.329445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331916+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:28.331916+0000","last_peered":"2024-04-16T13:06:28.331916+0000","last_clean":"2024-04-16T13:06:28.331916+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:28.331916+0000","last_undegraded":"2024-04-16T13:06:28.331916+0000","last_fullsized":"2024-04-16T13:06:28.331916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328786+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:28.328786+0000","last_peered":"2024-04-16T13:06:28.328786+0000","last_clean":"2024-04-16T13:06:28.328786+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:28.328786+0000","last_undegraded":"2024-04-16T13:06:28.328786+0000","last_fullsized":"2024-04-16T13:06:28.328786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.326814+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:27.326814+0000","last_peered":"2024-04-16T13:06:27.326814+0000","last_clean":"2024-04-16T13:06:27.326814+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:27.326814+0000","last_undegraded":"2024-04-16T13:06:27.326814+0000","last_fullsized":"2024-04-16T13:06:27.326814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607420+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:28.607420+0000","last_peered":"2024-04-16T13:06:28.607420+0000","last_clean":"2024-04-16T13:06:28.607420+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:28.607420+0000","last_undegraded":"2024-04-16T13:06:28.607420+0000","last_fullsized":"2024-04-16T13:06:28.607420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:13.322320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331551+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:28.331551+0000","last_peered":"2024-04-16T13:06:28.331551+0000","last_clean":"2024-04-16T13:06:28.331551+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:28.331551+0000","last_undegraded":"2024-04-16T13:06:28.331551+0000","last_fullsized":"2024-04-16T13:06:28.331551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607113+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:28.607113+0000","last_peered":"2024-04-16T13:06:28.607113+0000","last_clean":"2024-04-16T13:06:28.607113+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:28.607113+0000","last_undegraded":"2024-04-16T13:06:28.607113+0000","last_fullsized":"2024-04-16T13:06:28.607113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:46.791311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606764+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:28.606764+0000","last_peered":"2024-04-16T13:06:28.606764+0000","last_clean":"2024-04-16T13:06:28.606764+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:28.606764+0000","last_undegraded":"2024-04-16T13:06:28.606764+0000","last_fullsized":"2024-04-16T13:06:28.606764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324548+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:28.324548+0000","last_peered":"2024-04-16T13:06:28.324548+0000","last_clean":"2024-04-16T13:06:28.324548+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:28.324548+0000","last_undegraded":"2024-04-16T13:06:28.324548+0000","last_fullsized":"2024-04-16T13:06:28.324548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330536+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:28.330536+0000","last_peered":"2024-04-16T13:06:28.330536+0000","last_clean":"2024-04-16T13:06:28.330536+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:28.330536+0000","last_undegraded":"2024-04-16T13:06:28.330536+0000","last_fullsized":"2024-04-16T13:06:28.330536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739722+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:28.739722+0000","last_peered":"2024-04-16T13:06:28.739722+0000","last_clean":"2024-04-16T13:06:28.739722+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:28.739722+0000","last_undegraded":"2024-04-16T13:06:28.739722+0000","last_fullsized":"2024-04-16T13:06:28.739722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606999+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:28.606999+0000","last_peered":"2024-04-16T13:06:28.606999+0000","last_clean":"2024-04-16T13:06:28.606999+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:28.606999+0000","last_undegraded":"2024-04-16T13:06:28.606999+0000","last_fullsized":"2024-04-16T13:06:28.606999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:35.230507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329993+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:28.329993+0000","last_peered":"2024-04-16T13:06:28.329993+0000","last_clean":"2024-04-16T13:06:28.329993+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:28.329993+0000","last_undegraded":"2024-04-16T13:06:28.329993+0000","last_fullsized":"2024-04-16T13:06:28.329993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607244+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:28.607244+0000","last_peered":"2024-04-16T13:06:28.607244+0000","last_clean":"2024-04-16T13:06:28.607244+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:28.607244+0000","last_undegraded":"2024-04-16T13:06:28.607244+0000","last_fullsized":"2024-04-16T13:06:28.607244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:23.242434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328876+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:28.328876+0000","last_peered":"2024-04-16T13:06:28.328876+0000","last_clean":"2024-04-16T13:06:28.328876+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:28.328876+0000","last_undegraded":"2024-04-16T13:06:28.328876+0000","last_fullsized":"2024-04-16T13:06:28.328876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328495+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:28.328495+0000","last_peered":"2024-04-16T13:06:28.328495+0000","last_clean":"2024-04-16T13:06:28.328495+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:28.328495+0000","last_undegraded":"2024-04-16T13:06:28.328495+0000","last_fullsized":"2024-04-16T13:06:28.328495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325863+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:27.325863+0000","last_peered":"2024-04-16T13:06:27.325863+0000","last_clean":"2024-04-16T13:06:27.325863+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:27.325863+0000","last_undegraded":"2024-04-16T13:06:27.325863+0000","last_fullsized":"2024-04-16T13:06:27.325863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325623+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:27.325623+0000","last_peered":"2024-04-16T13:06:27.325623+0000","last_clean":"2024-04-16T13:06:27.325623+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:27.325623+0000","last_undegraded":"2024-04-16T13:06:27.325623+0000","last_fullsized":"2024-04-16T13:06:27.325623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061847+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:28.061847+0000","last_peered":"2024-04-16T13:06:28.061847+0000","last_clean":"2024-04-16T13:06:28.061847+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:28.061847+0000","last_undegraded":"2024-04-16T13:06:28.061847+0000","last_fullsized":"2024-04-16T13:06:28.061847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:14.630151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062058+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:28.062058+0000","last_peered":"2024-04-16T13:06:28.062058+0000","last_clean":"2024-04-16T13:06:28.062058+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:28.062058+0000","last_undegraded":"2024-04-16T13:06:28.062058+0000","last_fullsized":"2024-04-16T13:06:28.062058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:50.743240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324921+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:28.324921+0000","last_peered":"2024-04-16T13:06:28.324921+0000","last_clean":"2024-04-16T13:06:28.324921+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:28.324921+0000","last_undegraded":"2024-04-16T13:06:28.324921+0000","last_fullsized":"2024-04-16T13:06:28.324921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330039+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:28.330039+0000","last_peered":"2024-04-16T13:06:28.330039+0000","last_clean":"2024-04-16T13:06:28.330039+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:28.330039+0000","last_undegraded":"2024-04-16T13:06:28.330039+0000","last_fullsized":"2024-04-16T13:06:28.330039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061592+0000","last_change":"2024-04-16T13:06:23.268372+0000","last_active":"2024-04-16T13:06:28.061592+0000","last_peered":"2024-04-16T13:06:28.061592+0000","last_clean":"2024-04-16T13:06:28.061592+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:28.061592+0000","last_undegraded":"2024-04-16T13:06:28.061592+0000","last_fullsized":"2024-04-16T13:06:28.061592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:12:28.516429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331732+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:28.331732+0000","last_peered":"2024-04-16T13:06:28.331732+0000","last_clean":"2024-04-16T13:06:28.331732+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:28.331732+0000","last_undegraded":"2024-04-16T13:06:28.331732+0000","last_fullsized":"2024-04-16T13:06:28.331732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061708+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:28.061708+0000","last_peered":"2024-04-16T13:06:28.061708+0000","last_clean":"2024-04-16T13:06:28.061708+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:28.061708+0000","last_undegraded":"2024-04-16T13:06:28.061708+0000","last_fullsized":"2024-04-16T13:06:28.061708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:46:00.936015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327885+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:28.327885+0000","last_peered":"2024-04-16T13:06:28.327885+0000","last_clean":"2024-04-16T13:06:28.327885+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:28.327885+0000","last_undegraded":"2024-04-16T13:06:28.327885+0000","last_fullsized":"2024-04-16T13:06:28.327885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330334+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:28.330334+0000","last_peered":"2024-04-16T13:06:28.330334+0000","last_clean":"2024-04-16T13:06:28.330334+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:28.330334+0000","last_undegraded":"2024-04-16T13:06:28.330334+0000","last_fullsized":"2024-04-16T13:06:28.330334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607055+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:28.607055+0000","last_peered":"2024-04-16T13:06:28.607055+0000","last_clean":"2024-04-16T13:06:28.607055+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:28.607055+0000","last_undegraded":"2024-04-16T13:06:28.607055+0000","last_fullsized":"2024-04-16T13:06:28.607055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:18.496550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.061783+0000","last_change":"2024-04-16T13:06:23.263252+0000","last_active":"2024-04-16T13:06:28.061783+0000","last_peered":"2024-04-16T13:06:28.061783+0000","last_clean":"2024-04-16T13:06:28.061783+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:28.061783+0000","last_undegraded":"2024-04-16T13:06:28.061783+0000","last_fullsized":"2024-04-16T13:06:28.061783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:57:38.175317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324976+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:28.324976+0000","last_peered":"2024-04-16T13:06:28.324976+0000","last_clean":"2024-04-16T13:06:28.324976+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:28.324976+0000","last_undegraded":"2024-04-16T13:06:28.324976+0000","last_fullsized":"2024-04-16T13:06:28.324976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329035+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:28.329035+0000","last_peered":"2024-04-16T13:06:28.329035+0000","last_clean":"2024-04-16T13:06:28.329035+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:28.329035+0000","last_undegraded":"2024-04-16T13:06:28.329035+0000","last_fullsized":"2024-04-16T13:06:28.329035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330966+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:28.330966+0000","last_peered":"2024-04-16T13:06:28.330966+0000","last_clean":"2024-04-16T13:06:28.330966+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:28.330966+0000","last_undegraded":"2024-04-16T13:06:28.330966+0000","last_fullsized":"2024-04-16T13:06:28.330966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.062171+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:28.062171+0000","last_peered":"2024-04-16T13:06:28.062171+0000","last_clean":"2024-04-16T13:06:28.062171+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:28.062171+0000","last_undegraded":"2024-04-16T13:06:28.062171+0000","last_fullsized":"2024-04-16T13:06:28.062171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:28:33.550187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607587+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:28.607587+0000","last_peered":"2024-04-16T13:06:28.607587+0000","last_clean":"2024-04-16T13:06:28.607587+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:28.607587+0000","last_undegraded":"2024-04-16T13:06:28.607587+0000","last_fullsized":"2024-04-16T13:06:28.607587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:08.145583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331759+0000","last_change":"2024-04-16T13:06:23.265745+0000","last_active":"2024-04-16T13:06:28.331759+0000","last_peered":"2024-04-16T13:06:28.331759+0000","last_clean":"2024-04-16T13:06:28.331759+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:28.331759+0000","last_undegraded":"2024-04-16T13:06:28.331759+0000","last_fullsized":"2024-04-16T13:06:28.331759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331565+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:28.331565+0000","last_peered":"2024-04-16T13:06:28.331565+0000","last_clean":"2024-04-16T13:06:28.331565+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:28.331565+0000","last_undegraded":"2024-04-16T13:06:28.331565+0000","last_fullsized":"2024-04-16T13:06:28.331565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331937+0000","last_change":"2024-04-16T13:06:23.279016+0000","last_active":"2024-04-16T13:06:28.331937+0000","last_peered":"2024-04-16T13:06:28.331937+0000","last_clean":"2024-04-16T13:06:28.331937+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:28.331937+0000","last_undegraded":"2024-04-16T13:06:28.331937+0000","last_fullsized":"2024-04-16T13:06:28.331937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324658+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:28.324658+0000","last_peered":"2024-04-16T13:06:28.324658+0000","last_clean":"2024-04-16T13:06:28.324658+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:28.324658+0000","last_undegraded":"2024-04-16T13:06:28.324658+0000","last_fullsized":"2024-04-16T13:06:28.324658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:26.175658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739847+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:28.739847+0000","last_peered":"2024-04-16T13:06:28.739847+0000","last_clean":"2024-04-16T13:06:28.739847+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:28.739847+0000","last_undegraded":"2024-04-16T13:06:28.739847+0000","last_fullsized":"2024-04-16T13:06:28.739847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325826+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:27.325826+0000","last_peered":"2024-04-16T13:06:27.325826+0000","last_clean":"2024-04-16T13:06:27.325826+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:27.325826+0000","last_undegraded":"2024-04-16T13:06:27.325826+0000","last_fullsized":"2024-04-16T13:06:27.325826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:15.757364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T13:06:27.325135+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:27.325135+0000","last_peered":"2024-04-16T13:06:27.325135+0000","last_clean":"2024-04-16T13:06:27.325135+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:27.325135+0000","last_undegraded":"2024-04-16T13:06:27.325135+0000","last_fullsized":"2024-04-16T13:06:27.325135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331197+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:28.331197+0000","last_peered":"2024-04-16T13:06:28.331197+0000","last_clean":"2024-04-16T13:06:28.331197+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:28.331197+0000","last_undegraded":"2024-04-16T13:06:28.331197+0000","last_fullsized":"2024-04-16T13:06:28.331197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606738+0000","last_change":"2024-04-16T13:06:23.261663+0000","last_active":"2024-04-16T13:06:28.606738+0000","last_peered":"2024-04-16T13:06:28.606738+0000","last_clean":"2024-04-16T13:06:28.606738+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:28.606738+0000","last_undegraded":"2024-04-16T13:06:28.606738+0000","last_fullsized":"2024-04-16T13:06:28.606738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:14.752238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328591+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:28.328591+0000","last_peered":"2024-04-16T13:06:28.328591+0000","last_clean":"2024-04-16T13:06:28.328591+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:28.328591+0000","last_undegraded":"2024-04-16T13:06:28.328591+0000","last_fullsized":"2024-04-16T13:06:28.328591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330961+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:28.330961+0000","last_peered":"2024-04-16T13:06:28.330961+0000","last_clean":"2024-04-16T13:06:28.330961+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:28.330961+0000","last_undegraded":"2024-04-16T13:06:28.330961+0000","last_fullsized":"2024-04-16T13:06:28.330961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330305+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:28.330305+0000","last_peered":"2024-04-16T13:06:28.330305+0000","last_clean":"2024-04-16T13:06:28.330305+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:28.330305+0000","last_undegraded":"2024-04-16T13:06:28.330305+0000","last_fullsized":"2024-04-16T13:06:28.330305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1085440,"data_stored":801904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":210436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":209966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":204120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":211500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":209944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":800256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:34.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T13:06:34.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.268+0000 7f2a61600640 1 Processor -- start 2024-04-16T13:06:34.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.268+0000 7f2a61600640 1 -- start start 2024-04-16T13:06:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.269+0000 7f2a61600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c15e990 0x7f2a5c0d5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.269+0000 7f2a61600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.269+0000 7f2a61600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c0d05f0 con 0x7f2a5c0d0f50 2024-04-16T13:06:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.269+0000 7f2a61600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c0d22f0 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.269+0000 7f2a61600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d25d0 con 0x7f2a5c15e990 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a60c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2a5c0d0f50 0x7f2a5c06cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60406/0 (socket says 172.21.15.67:60406) 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43342/0 (socket says 172.21.15.67:43342) 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a60c00640 1 -- 172.21.15.67:0/2103528605 learned_addr learned my addr 172.21.15.67:0/2103528605 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5be00640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c15e990 0x7f2a5c0d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 -- 172.21.15.67:0/2103528605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c15e990 msgr2=0x7f2a5c0d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c15e990 0x7f2a5c0d5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 -- 172.21.15.67:0/2103528605 >> v1:172.21.15.67:6789/0 conn(0x7f2a5c0d0f50 legacy=0x7f2a5c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.270+0000 7f2a5b400640 1 -- 172.21.15.67:0/2103528605 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c0d28b0 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.271+0000 7f2a5b400640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097a0 tx=0x7f2a4402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf5223e0f65b72d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a5aa00640 1 -- 172.21.15.67:0/2103528605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44035020 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a5aa00640 1 -- 172.21.15.67:0/2103528605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a44031810 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a5aa00640 1 -- 172.21.15.67:0/2103528605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44031be0 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 -- 172.21.15.67:0/2103528605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c0d30b0 msgr2=0x7f2a5c0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097a0 tx=0x7f2a4402b8b0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 -- 172.21.15.67:0/2103528605 shutdown_connections 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0cfda0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 --2- 172.21.15.67:0/2103528605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c15e990 0x7f2a5c0d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.272+0000 7f2a61600640 1 -- 172.21.15.67:0/2103528605 >> 172.21.15.67:0/2103528605 conn(0x7f2a5c08c000 msgr2=0x7f2a5c0d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.273+0000 7f2a61600640 1 -- 172.21.15.67:0/2103528605 shutdown_connections 2024-04-16T13:06:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.273+0000 7f2a61600640 1 -- 172.21.15.67:0/2103528605 wait complete. 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.274+0000 7f2a61600640 1 Processor -- start 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 -- start start 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0d0f50 0x7f2a5c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15ed70 con 0x7f2a5c15e990 2024-04-16T13:06:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d02e0 con 0x7f2a5c0d30b0 2024-04-16T13:06:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.275+0000 7f2a61600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c0d34f0 con 0x7f2a5c0d0f50 2024-04-16T13:06:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43346/0 (socket says 172.21.15.67:43346) 2024-04-16T13:06:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 -- 172.21.15.67:0/3235658080 learned_addr learned my addr 172.21.15.67:0/3235658080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a5be00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0d0f50 0x7f2a5c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a5b400640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 -- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0d0f50 msgr2=0x7f2a5c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0d0f50 0x7f2a5c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 -- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0d30b0 msgr2=0x7f2a5c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.276+0000 7f2a60c00640 1 -- 172.21.15.67:0/3235658080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c0cc7a0 con 0x7f2a5c15e990 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a60c00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c420 tx=0x7f2a5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54017070 con 0x7f2a5c15e990 2024-04-16T13:06:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a54005ce0 con 0x7f2a5c15e990 2024-04-16T13:06:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a540072d0 con 0x7f2a5c15e990 2024-04-16T13:06:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c0c93d0 con 0x7f2a5c15e990 2024-04-16T13:06:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.277+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c0ccd40 con 0x7f2a5c15e990 2024-04-16T13:06:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.278+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c075bd0 con 0x7f2a5c15e990 2024-04-16T13:06:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.279+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a5401a070 con 0x7f2a5c15e990 2024-04-16T13:06:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.280+0000 7f2a53e00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.280+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f2a5408af30 con 0x7f2a5c15e990 2024-04-16T13:06:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.281+0000 7f2a5be00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:34.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.282+0000 7f2a5be00640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 0x7f2a3806edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0099c0 tx=0x7f2a4c003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:34.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.285+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a54058bf0 con 0x7f2a5c15e990 2024-04-16T13:06:34.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.493+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a5c0d1de0 con 0x7f2a5c15e990 2024-04-16T13:06:34.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.495+0000 7f2a53e00640 1 -- 172.21.15.67:0/3235658080 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16839 (secure 0 0 0) 0x7f2a5405cef0 con 0x7f2a5c15e990 2024-04-16T13:06:34.498 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:34.498 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":41,"fsid":"dc50e499-96cc-43d1-bcde-ee8dfcd0732f","created":"2024-04-16T13:04:21.111315+0000","modified":"2024-04-16T13:06:28.316697+0000","last_up_change":"2024-04-16T13:04:33.815451+0000","last_in_change":"2024-04-16T13:04:24.569896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T13:04:34.521995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-16T13:06:21.935846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-16T13:06:22.716875+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9486d07d-0d40-41cf-ac91-fcfdd272ec36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6809","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6811","nonce":943685359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6816","nonce":943685359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6824","nonce":943685359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":943685359},{"type":"v1","addr":"172.21.15.67:6821","nonce":943685359}]},"public_addr":"172.21.15.67:6811/943685359","cluster_addr":"172.21.15.67:6816/943685359","heartbeat_back_addr":"172.21.15.67:6824/943685359","heartbeat_front_addr":"172.21.15.67:6821/943685359","state":["exists","up"]},{"osd":1,"uuid":"e39e9244-6912-44cc-9392-73c5cc0e865e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6801","nonce":1865615230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6803","nonce":1865615230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6807","nonce":1865615230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1865615230},{"type":"v1","addr":"172.21.15.67:6805","nonce":1865615230}]},"public_addr":"172.21.15.67:6801/1865615230","cluster_addr":"172.21.15.67:6803/1865615230","heartbeat_back_addr":"172.21.15.67:6807/1865615230","heartbeat_front_addr":"172.21.15.67:6805/1865615230","state":["exists","up"]},{"osd":2,"uuid":"a2df53ff-36f0-4109-86e0-5b3148230cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6810","nonce":2646355718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6813","nonce":2646355718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6819","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6820","nonce":2646355718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6815","nonce":2646355718},{"type":"v1","addr":"172.21.15.67:6817","nonce":2646355718}]},"public_addr":"172.21.15.67:6810/2646355718","cluster_addr":"172.21.15.67:6813/2646355718","heartbeat_back_addr":"172.21.15.67:6820/2646355718","heartbeat_front_addr":"172.21.15.67:6817/2646355718","state":["exists","up"]},{"osd":3,"uuid":"923b85c0-7d7b-436e-84d8-12773be890d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6825","nonce":2159316217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6827","nonce":2159316217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6831","nonce":2159316217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2159316217},{"type":"v1","addr":"172.21.15.67:6829","nonce":2159316217}]},"public_addr":"172.21.15.67:6825/2159316217","cluster_addr":"172.21.15.67:6827/2159316217","heartbeat_back_addr":"172.21.15.67:6831/2159316217","heartbeat_front_addr":"172.21.15.67:6829/2159316217","state":["exists","up"]},{"osd":4,"uuid":"cf4036b5-bfaf-451f-8137-0c55c0ac6042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6817","nonce":3746718267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6820","nonce":3746718267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6828","nonce":3746718267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3746718267},{"type":"v1","addr":"172.21.15.82:6823","nonce":3746718267}]},"public_addr":"172.21.15.82:6817/3746718267","cluster_addr":"172.21.15.82:6820/3746718267","heartbeat_back_addr":"172.21.15.82:6828/3746718267","heartbeat_front_addr":"172.21.15.82:6823/3746718267","state":["exists","up"]},{"osd":5,"uuid":"bd54c71c-646b-45e0-a915-142317b0a0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6801","nonce":2359128195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6803","nonce":2359128195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6807","nonce":2359128195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2359128195},{"type":"v1","addr":"172.21.15.82:6805","nonce":2359128195}]},"public_addr":"172.21.15.82:6801/2359128195","cluster_addr":"172.21.15.82:6803/2359128195","heartbeat_back_addr":"172.21.15.82:6807/2359128195","heartbeat_front_addr":"172.21.15.82:6805/2359128195","state":["exists","up"]},{"osd":6,"uuid":"7e6b26de-02fb-4f77-9448-20fac484ce8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6822","nonce":87066875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6825","nonce":87066875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6831","nonce":87066875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":87066875},{"type":"v1","addr":"172.21.15.82:6829","nonce":87066875}]},"public_addr":"172.21.15.82:6822/87066875","cluster_addr":"172.21.15.82:6825/87066875","heartbeat_back_addr":"172.21.15.82:6831/87066875","heartbeat_front_addr":"172.21.15.82:6829/87066875","state":["exists","up"]},{"osd":7,"uuid":"5949c571-cb73-42e7-a9b8-cc1aa3534ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6809","nonce":43297624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6811","nonce":43297624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6815","nonce":43297624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43297624},{"type":"v1","addr":"172.21.15.82:6813","nonce":43297624}]},"public_addr":"172.21.15.82:6809/43297624","cluster_addr":"172.21.15.82:6811/43297624","heartbeat_back_addr":"172.21.15.82:6815/43297624","heartbeat_front_addr":"172.21.15.82:6813/43297624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.083572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.956561+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.018064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.014386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.947956+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.069250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:30.040304+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T13:04:29.941053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 msgr2=0x7f2a3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 0x7f2a3806edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0099c0 tx=0x7f2a4c003990 comp rx=0 tx=0).stop 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 msgr2=0x7f2a5c0b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400c420 tx=0x7f2a5400c8e0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 shutdown_connections 2024-04-16T13:06:34.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a5c15e990 0x7f2a5c0b74d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a5c0d30b0 0x7f2a5c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 --2- 172.21.15.67:0/3235658080 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a5c0d0f50 0x7f2a5c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 >> 172.21.15.67:0/3235658080 conn(0x7f2a5c08c000 msgr2=0x7f2a5c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 shutdown_connections 2024-04-16T13:06:34.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:34.498+0000 7f2a61600640 1 -- 172.21.15.67:0/3235658080 wait complete. 2024-04-16T13:06:35.520 INFO:tasks.ceph:Scrubbing osd.0 2024-04-16T13:06:35.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.755+0000 7fa557000640 1 Processor -- start 2024-04-16T13:06:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.756+0000 7fa557000640 1 -- start start 2024-04-16T13:06:35.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.757+0000 7fa557000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa55015b3f0 0x7fa55015f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.757+0000 7fa557000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5500cffb0 con 0x7fa5500cc960 2024-04-16T13:06:35.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa557000640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5500c5670 con 0x7fa55015af90 2024-04-16T13:06:35.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa557000640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fa5500b3f10 con 0x7fa55015b3f0 2024-04-16T13:06:35.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa54fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa5500cc960 0x7fa5500b3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60420/0 (socket says 172.21.15.67:60420) 2024-04-16T13:06:35.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa54fe00640 1 -- 172.21.15.67:0/1100722198 learned_addr learned my addr 172.21.15.67:0/1100722198 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa555000640 1 --2- 172.21.15.67:0/1100722198 >> v2:172.21.15.82:3300/0 conn(0x7fa55015b3f0 0x7fa55015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891107808 0 0) 0x7fa5500cffb0 con 0x7fa5500cc960 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.758+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa534003520 con 0x7fa5500cc960 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 127326119 0 0) 0x7fa534003520 con 0x7fa5500cc960 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 >> v2:172.21.15.82:3300/0 conn(0x7fa55015b3f0 msgr2=0x7fa55015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:35.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 --2- 172.21.15.67:0/1100722198 >> v2:172.21.15.82:3300/0 conn(0x7fa55015b3f0 0x7fa55015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 >> v1:172.21.15.82:6789/0 conn(0x7fa55015af90 legacy=0x7fa55015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5500c5950 con 0x7fa5500cc960 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7fa538001670 con 0x7fa5500cc960 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 >> v1:172.21.15.67:6789/0 conn(0x7fa5500cc960 legacy=0x7fa5500b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa534003a00 0x7fa534003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 0x7fa534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340052e0 0x7fa53400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5500b3f10 con 0x7fa534004800 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa53400c200 con 0x7fa534003a00 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa53400c400 con 0x7fa5340052e0 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa555000640 1 --2- 172.21.15.67:0/1100722198 >> v2:172.21.15.82:3300/0 conn(0x7fa55015b3f0 0x7fa55015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.759+0000 7fa54f400640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 0x7fa534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54fe00640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa534003a00 0x7fa534003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54f400640 1 -- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340052e0 msgr2=0x7fa53400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54f400640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa5340052e0 0x7fa53400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54f400640 1 -- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa534003a00 msgr2=0x7fa534003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:35.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54f400640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa534003a00 0x7fa534003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa54f400640 1 -- 172.21.15.67:0/1100722198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa534003520 con 0x7fa534004800 2024-04-16T13:06:35.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.760+0000 7fa555000640 1 -- 172.21.15.67:0/1100722198 reap_dead start 2024-04-16T13:06:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.761+0000 7fa54f400640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 0x7fa534004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa540001e50 tx=0x7fa534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e237115111cb2e97 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.761+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540001a70 con 0x7fa534004800 2024-04-16T13:06:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.761+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa540003b70 con 0x7fa534004800 2024-04-16T13:06:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.761+0000 7fa54ea00640 1 -- 172.21.15.67:0/1100722198 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5400050d0 con 0x7fa534004800 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 -- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 msgr2=0x7fa534004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 0x7fa534004c80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa540001e50 tx=0x7fa534005830 comp rx=0 tx=0).stop 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 -- 172.21.15.67:0/1100722198 shutdown_connections 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 --2- 172.21.15.67:0/1100722198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa534004800 0x7fa534004c80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 -- 172.21.15.67:0/1100722198 >> 172.21.15.67:0/1100722198 conn(0x7fa550067d90 msgr2=0x7fa55006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 -- 172.21.15.67:0/1100722198 shutdown_connections 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.762+0000 7fa557000640 1 -- 172.21.15.67:0/1100722198 wait complete. 2024-04-16T13:06:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.764+0000 7fa557000640 1 Processor -- start 2024-04-16T13:06:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.764+0000 7fa557000640 1 -- start start 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa534004800 0x7fa550150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa550073100 0x7fa550073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 0x7fa5500c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa5500ccd40 con 0x7fa5500c8ee0 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5500cd8d0 con 0x7fa550073100 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa557000640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fa5500c5c30 con 0x7fa534004800 2024-04-16T13:06:35.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa555000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 0x7fa5500c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa555000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 0x7fa5500c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43376/0 (socket says 172.21.15.67:43376) 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.765+0000 7fa555000640 1 -- 172.21.15.67:0/3817748978 learned_addr learned my addr 172.21.15.67:0/3817748978 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa54f400640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa550073100 0x7fa550073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa54fe00640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa534004800 0x7fa550150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 -- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa534004800 msgr2=0x7fa550150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fa534004800 0x7fa550150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 -- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa550073100 msgr2=0x7fa550073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa550073100 0x7fa550073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5500caf80 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa54f400640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa550073100 0x7fa550073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.766+0000 7fa555000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 0x7fa5500c9360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa54800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.767+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54801a070 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.767+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548004230 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.767+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54800f040 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.767+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5500cb220 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.767+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5500cb7e0 con 0x7fa5500c8ee0 2024-04-16T13:06:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.768+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa550068a70 con 0x7fa5500c8ee0 2024-04-16T13:06:35.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.769+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa54801d070 con 0x7fa5500c8ee0 2024-04-16T13:06:35.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa547e00640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa52c06c920 0x7fa52c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa54808abb0 con 0x7fa5500c8ee0 2024-04-16T13:06:35.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa547e00640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7fa52c0751e0 0x7fa52c077640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa52c077d10 con 0x7fa52c0751e0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa54808f2a0 con 0x7fa5500c8ee0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa54f400640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7fa52c0751e0 0x7fa52c077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.770+0000 7fa54fe00640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa52c06c920 0x7fa52c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.771+0000 7fa54f400640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7fa52c0751e0 0x7fa52c077640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.772+0000 7fa54fe00640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa52c06c920 0x7fa52c06ede0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa538001050 tx=0x7fa538001dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.772+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== osd.0 v2:172.21.15.67:6809/943685359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa52c077d10 con 0x7fa52c0751e0 2024-04-16T13:06:35.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.787+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 --> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa550072be0 con 0x7fa52c0751e0 2024-04-16T13:06:35.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.787+0000 7fa547e00640 1 -- 172.21.15.67:0/3817748978 <== osd.0 v2:172.21.15.67:6809/943685359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa550072be0 con 0x7fa52c0751e0 2024-04-16T13:06:35.789 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:35.790 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:35.790 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7fa52c0751e0 msgr2=0x7fa52c077640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:6809/943685359,v1:172.21.15.67:6811/943685359] conn(0x7fa52c0751e0 0x7fa52c077640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa52c06c920 msgr2=0x7fa52c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fa52c06c920 0x7fa52c06ede0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa538001050 tx=0x7fa538001dd0 comp rx=0 tx=0).stop 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 msgr2=0x7fa5500c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 --2- 172.21.15.67:0/3817748978 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5500c8ee0 0x7fa5500c9360 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa54800e830 comp rx=0 tx=0).stop 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa555000640 1 -- 172.21.15.67:0/3817748978 reap_dead start 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 shutdown_connections 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 >> 172.21.15.67:0/3817748978 conn(0x7fa550067d90 msgr2=0x7fa5500b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 shutdown_connections 2024-04-16T13:06:35.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:35.788+0000 7fa557000640 1 -- 172.21.15.67:0/3817748978 wait complete. 2024-04-16T13:06:35.808 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-16T13:06:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.031+0000 7f5383200640 1 Processor -- start 2024-04-16T13:06:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.031+0000 7f5383200640 1 -- start start 2024-04-16T13:06:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5383200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53840ce990 0x7f538406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5383200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5384071de0 0x7f5384072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5383200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538406dec0 con 0x7f538415cdc0 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5383200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f5384072780 con 0x7f53840ce990 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5383200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f538406e7f0 con 0x7f5384071de0 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.033+0000 7f5381e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53840ce990 0x7f538406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53840ce990 0x7f538406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43390/0 (socket says 172.21.15.67:43390) 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 -- 172.21.15.67:0/3414844414 learned_addr learned my addr 172.21.15.67:0/3414844414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 -- 172.21.15.67:0/3414844414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5384071de0 msgr2=0x7f5384072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 --2- 172.21.15.67:0/3414844414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5384071de0 0x7f5384072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 -- 172.21.15.67:0/3414844414 >> v1:172.21.15.82:6789/0 conn(0x7f538415cdc0 legacy=0x7f538415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.034+0000 7f5381e00640 1 -- 172.21.15.67:0/3414844414 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538406e1a0 con 0x7f53840ce990 2024-04-16T13:06:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.035+0000 7f5381e00640 1 --2- 172.21.15.67:0/3414844414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f538406ec80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5374009870 tx=0x7f537402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1534724677a37348 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5380a00640 1 -- 172.21.15.67:0/3414844414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740317c0 con 0x7f53840ce990 2024-04-16T13:06:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5380a00640 1 -- 172.21.15.67:0/3414844414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374037070 con 0x7f53840ce990 2024-04-16T13:06:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5380a00640 1 -- 172.21.15.67:0/3414844414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374031b80 con 0x7f53840ce990 2024-04-16T13:06:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 -- 172.21.15.67:0/3414844414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 msgr2=0x7f538406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 --2- 172.21.15.67:0/3414844414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f538406ec80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5374009870 tx=0x7f537402b860 comp rx=0 tx=0).stop 2024-04-16T13:06:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 -- 172.21.15.67:0/3414844414 shutdown_connections 2024-04-16T13:06:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 --2- 172.21.15.67:0/3414844414 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5384071de0 0x7f5384072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 --2- 172.21.15.67:0/3414844414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f538406ec80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 -- 172.21.15.67:0/3414844414 >> 172.21.15.67:0/3414844414 conn(0x7f5384067d90 msgr2=0x7f538406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.036+0000 7f5383200640 1 -- 172.21.15.67:0/3414844414 shutdown_connections 2024-04-16T13:06:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.037+0000 7f5383200640 1 -- 172.21.15.67:0/3414844414 wait complete. 2024-04-16T13:06:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.038+0000 7f5383200640 1 Processor -- start 2024-04-16T13:06:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.038+0000 7f5383200640 1 -- start start 2024-04-16T13:06:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 0x7f538414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538415cdc0 0x7f53840cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f538415db10 con 0x7f53840ce990 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53840ced70 con 0x7f5384071de0 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.039+0000 7f5383200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f538415ddc0 con 0x7f538415cdc0 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43392/0 (socket says 172.21.15.67:43392) 2024-04-16T13:06:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 -- 172.21.15.67:0/756557642 learned_addr learned my addr 172.21.15.67:0/756557642 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5382800640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538415cdc0 0x7f53840cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381e00640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 0x7f538414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 -- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538415cdc0 msgr2=0x7f53840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538415cdc0 0x7f53840cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 -- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 msgr2=0x7f538414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 0x7f538414ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381400640 1 -- 172.21.15.67:0/756557642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538414b250 con 0x7f53840ce990 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.040+0000 7f5381e00640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 0x7f538414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f5381400640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f537000b4d0 tx=0x7f537000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370014070 con 0x7f53840ce990 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370010870 con 0x7f53840ce990 2024-04-16T13:06:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370010c60 con 0x7f53840ce990 2024-04-16T13:06:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5384158eb0 con 0x7f53840ce990 2024-04-16T13:06:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.041+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5384159470 con 0x7f53840ce990 2024-04-16T13:06:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.043+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5384075bd0 con 0x7f53840ce990 2024-04-16T13:06:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.043+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5370017070 con 0x7f53840ce990 2024-04-16T13:06:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.044+0000 7f537a000640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.044+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f537008ba30 con 0x7f53840ce990 2024-04-16T13:06:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.045+0000 7f5381e00640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.046+0000 7f5381e00640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 0x7f536406edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5374036000 tx=0x7f5374008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.049+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f538414b250 con 0x7f53840ce990 2024-04-16T13:06:36.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.252+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f53840cf640 con 0x7f536406c8f0 2024-04-16T13:06:36.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.254+0000 7f537a000640 1 -- 172.21.15.67:0/756557642 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f53840cf640 con 0x7f536406c8f0 2024-04-16T13:06:36.256 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.256+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 msgr2=0x7f536406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.256+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 0x7f536406edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5374036000 tx=0x7f5374008030 comp rx=0 tx=0).stop 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.256+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 msgr2=0x7f53841583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.256+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f537000b4d0 tx=0x7f537000b990 comp rx=0 tx=0).stop 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 shutdown_connections 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f538415cdc0 0x7f53840cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53840ce990 0x7f53841583f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 --2- 172.21.15.67:0/756557642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5384071de0 0x7f538414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 >> 172.21.15.67:0/756557642 conn(0x7f5384067d90 msgr2=0x7f538415a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:36.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 shutdown_connections 2024-04-16T13:06:36.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.257+0000 7f5383200640 1 -- 172.21.15.67:0/756557642 wait complete. 2024-04-16T13:06:36.277 INFO:tasks.ceph:Scrubbing osd.1 2024-04-16T13:06:36.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.502+0000 7f5bc3200640 1 Processor -- start 2024-04-16T13:06:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.502+0000 7f5bc3200640 1 -- start start 2024-04-16T13:06:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.503+0000 7f5bc3200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5bc415e890 0x7f5bc40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.503+0000 7f5bc3200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc40b4aa0 0x7f5bc40d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.503+0000 7f5bc3200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc40cf7d0 con 0x7f5bc40d4660 2024-04-16T13:06:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.503+0000 7f5bc3200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc40d1300 con 0x7f5bc415e890 2024-04-16T13:06:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.503+0000 7f5bc3200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc40b4fa0 con 0x7f5bc40b4aa0 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.504+0000 7f5bc1e00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5bc415e890 0x7f5bc40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.504+0000 7f5bc1400640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5bc40d4660 0x7f5bc40b4390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:35960/0 (socket says 172.21.15.67:35960) 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.504+0000 7f5bc1400640 1 -- 172.21.15.67:0/3654258052 learned_addr learned my addr 172.21.15.67:0/3654258052 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.504+0000 7f5bc2800640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc40b4aa0 0x7f5bc40d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.505+0000 7f5bc1e00640 1 -- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc40b4aa0 msgr2=0x7f5bc40d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.505+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc40b4aa0 0x7f5bc40d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.505+0000 7f5bc1e00640 1 -- 172.21.15.67:0/3654258052 >> v1:172.21.15.82:6789/0 conn(0x7f5bc40d4660 legacy=0x7f5bc40b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.505+0000 7f5bc1e00640 1 -- 172.21.15.67:0/3654258052 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc40b5280 con 0x7f5bc415e890 2024-04-16T13:06:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.507+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc415e890 0x7f5bc40cf290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009d90 tx=0x7f5bb402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b16d7c545052f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.507+0000 7f5bc0a00640 1 -- 172.21.15.67:0/3654258052 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4039070 con 0x7f5bc415e890 2024-04-16T13:06:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.507+0000 7f5bc0a00640 1 -- 172.21.15.67:0/3654258052 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb402cc50 con 0x7f5bc415e890 2024-04-16T13:06:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.507+0000 7f5bc0a00640 1 -- 172.21.15.67:0/3654258052 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4034440 con 0x7f5bc415e890 2024-04-16T13:06:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 -- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc415e890 msgr2=0x7f5bc40cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc415e890 0x7f5bc40cf290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009d90 tx=0x7f5bb402bea0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 -- 172.21.15.67:0/3654258052 shutdown_connections 2024-04-16T13:06:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc40b4aa0 0x7f5bc40d4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 --2- 172.21.15.67:0/3654258052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc415e890 0x7f5bc40cf290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 -- 172.21.15.67:0/3654258052 >> 172.21.15.67:0/3654258052 conn(0x7f5bc409da80 msgr2=0x7f5bc408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 -- 172.21.15.67:0/3654258052 shutdown_connections 2024-04-16T13:06:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.508+0000 7f5bc3200640 1 -- 172.21.15.67:0/3654258052 wait complete. 2024-04-16T13:06:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.510+0000 7f5bc3200640 1 Processor -- start 2024-04-16T13:06:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.511+0000 7f5bc3200640 1 -- start start 2024-04-16T13:06:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40b4aa0 0x7f5bc4147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 0x7f5bc4149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc415e890 0x7f5bc41e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc415ec70 con 0x7f5bc40d4660 2024-04-16T13:06:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc40d24f0 con 0x7f5bc40b4aa0 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc3200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc40d2a10 con 0x7f5bc415e890 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 0x7f5bc4149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 0x7f5bc4149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43406/0 (socket says 172.21.15.67:43406) 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.512+0000 7f5bc1400640 1 -- 172.21.15.67:0/1022239226 learned_addr learned my addr 172.21.15.67:0/1022239226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40b4aa0 0x7f5bc4147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc2800640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc415e890 0x7f5bc41e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 -- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc415e890 msgr2=0x7f5bc41e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f5bc415e890 0x7f5bc41e7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 -- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40b4aa0 msgr2=0x7f5bc4147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40b4aa0 0x7f5bc4147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc41483b0 con 0x7f5bc40d4660 2024-04-16T13:06:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5bc40b4aa0 0x7f5bc4147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T13:06:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.513+0000 7f5bc1400640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 0x7f5bc4149450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c400 tx=0x7f5bac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.514+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac017070 con 0x7f5bc40d4660 2024-04-16T13:06:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.514+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac005ce0 con 0x7f5bc40d4660 2024-04-16T13:06:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.514+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0072f0 con 0x7f5bc40d4660 2024-04-16T13:06:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.514+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc4148690 con 0x7f5bc40d4660 2024-04-16T13:06:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.514+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc4148c50 con 0x7f5bc40d4660 2024-04-16T13:06:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.515+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bc4075bd0 con 0x7f5bc40d4660 2024-04-16T13:06:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.516+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bac01a070 con 0x7f5bc40d4660 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.517+0000 7f5bba000640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ba006c8f0 0x7f5ba006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.517+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f5bac08b0e0 con 0x7f5bc40d4660 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.517+0000 7f5bba000640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7f5ba00751c0 0x7f5ba0077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.517+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ba0077cf0 con 0x7f5ba00751c0 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.517+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f5bac092050 con 0x7f5bc40d4660 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.518+0000 7f5bc2800640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7f5ba00751c0 0x7f5ba0077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.518+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ba006c8f0 0x7f5ba006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.518+0000 7f5bc2800640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7f5ba00751c0 0x7f5ba0077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.519+0000 7f5bc1e00640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ba006c8f0 0x7f5ba006edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4036000 tx=0x7f5bb4030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.520+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== osd.1 v2:172.21.15.67:6800/1865615230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ba0077cf0 con 0x7f5ba00751c0 2024-04-16T13:06:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.535+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 --> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5bc40b4170 con 0x7f5ba00751c0 2024-04-16T13:06:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.536+0000 7f5bba000640 1 -- 172.21.15.67:0/1022239226 <== osd.1 v2:172.21.15.67:6800/1865615230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5bc40b4170 con 0x7f5ba00751c0 2024-04-16T13:06:36.538 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:36.538 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:36.538 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:36.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.536+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7f5ba00751c0 msgr2=0x7f5ba0077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.536+0000 7f5bc3200640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:6800/1865615230,v1:172.21.15.67:6801/1865615230] conn(0x7f5ba00751c0 0x7f5ba0077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ba006c8f0 msgr2=0x7f5ba006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f5ba006c8f0 0x7f5ba006edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4036000 tx=0x7f5bb4030000 comp rx=0 tx=0).stop 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 msgr2=0x7f5bc4149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 --2- 172.21.15.67:0/1022239226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bc40d4660 0x7f5bc4149450 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c400 tx=0x7f5bac00c8c0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc2800640 1 -- 172.21.15.67:0/1022239226 reap_dead start 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 shutdown_connections 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 >> 172.21.15.67:0/1022239226 conn(0x7f5bc409da80 msgr2=0x7f5bc406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 shutdown_connections 2024-04-16T13:06:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.537+0000 7f5bc3200640 1 -- 172.21.15.67:0/1022239226 wait complete. 2024-04-16T13:06:36.559 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-16T13:06:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.778+0000 7f3c9f200640 1 Processor -- start 2024-04-16T13:06:36.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.779+0000 7f3c9f200640 1 -- start start 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.780+0000 7f3c9f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ca0072050 0x7f3ca00b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.780+0000 7f3c9f200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 0x7f3ca006e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca006e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca00b3970 con 0x7f3ca0072050 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9f200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca01641f0 con 0x7f3ca006f040 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca01635e0 con 0x7f3ca006f9d0 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ca0072050 0x7f3ca00b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ca0072050 0x7f3ca00b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43414/0 (socket says 172.21.15.67:43414) 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 -- 172.21.15.67:0/3766132993 learned_addr learned my addr 172.21.15.67:0/3766132993 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9d400640 1 --2- 172.21.15.67:0/3766132993 >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 0x7f3ca006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 -- 172.21.15.67:0/3766132993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 msgr2=0x7f3ca006e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9e800640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca006e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca006e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 -- 172.21.15.67:0/3766132993 >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 msgr2=0x7f3ca006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 --2- 172.21.15.67:0/3766132993 >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 0x7f3ca006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9de00640 1 -- 172.21.15.67:0/3766132993 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca01638c0 con 0x7f3ca0072050 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9d400640 1 --2- 172.21.15.67:0/3766132993 >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 0x7f3ca006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.781+0000 7f3c9e800640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca006e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9de00640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b3430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ca01637f0 tx=0x7f3c9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d333cae48ee32d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9ca00640 1 -- 172.21.15.67:0/3766132993 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90035020 con 0x7f3ca0072050 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9ca00640 1 -- 172.21.15.67:0/3766132993 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c90031640 con 0x7f3ca0072050 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9ca00640 1 -- 172.21.15.67:0/3766132993 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9002d040 con 0x7f3ca0072050 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9f200640 1 -- 172.21.15.67:0/3766132993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 msgr2=0x7f3ca00b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.783+0000 7f3c9f200640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b3430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ca01637f0 tx=0x7f3c9002b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 -- 172.21.15.67:0/3766132993 shutdown_connections 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca006e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 --2- 172.21.15.67:0/3766132993 >> v2:172.21.15.82:3300/0 conn(0x7f3ca006f040 0x7f3ca006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 --2- 172.21.15.67:0/3766132993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b3430 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 -- 172.21.15.67:0/3766132993 >> 172.21.15.67:0/3766132993 conn(0x7f3ca0067d90 msgr2=0x7f3ca006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 -- 172.21.15.67:0/3766132993 shutdown_connections 2024-04-16T13:06:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.784+0000 7f3c9f200640 1 -- 172.21.15.67:0/3766132993 wait complete. 2024-04-16T13:06:36.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.785+0000 7f3c9f200640 1 Processor -- start 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.786+0000 7f3c9f200640 1 -- start start 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.786+0000 7f3c9f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca006f040 0x7f3ca01426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.786+0000 7f3c9f200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca00b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.786+0000 7f3c9f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca006eb80 con 0x7f3ca0072050 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0163e80 con 0x7f3ca006f040 2024-04-16T13:06:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9f200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca006ed00 con 0x7f3ca006f9d0 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43424/0 (socket says 172.21.15.67:43424) 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 -- 172.21.15.67:0/2729516113 learned_addr learned my addr 172.21.15.67:0/2729516113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9de00640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca006f040 0x7f3ca01426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9d400640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca00b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 -- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 msgr2=0x7f3ca00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca00b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 -- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca006f040 msgr2=0x7f3ca01426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca006f040 0x7f3ca01426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.787+0000 7f3c9e800640 1 -- 172.21.15.67:0/2729516113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca0142be0 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c9e800640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800cef0 tx=0x7f3c9800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9801a070 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9800d860 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca00cf130 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800dc50 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.788+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca0143270 con 0x7f3ca0072050 2024-04-16T13:06:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.789+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0075bd0 con 0x7f3ca0072050 2024-04-16T13:06:36.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.790+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c9801d070 con 0x7f3ca0072050 2024-04-16T13:06:36.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.791+0000 7f3c96000640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 0x7f3c8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.791+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f3c9808c630 con 0x7f3ca0072050 2024-04-16T13:06:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.792+0000 7f3c9de00640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 0x7f3c8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.793+0000 7f3c9de00640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 0x7f3c8006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c90036000 tx=0x7f3c9003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:36.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:36.796+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c9805a8d0 con 0x7f3ca0072050 2024-04-16T13:06:37.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.000+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3ca0167700 con 0x7f3c8006c8f0 2024-04-16T13:06:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.002+0000 7f3c96000640 1 -- 172.21.15.67:0/2729516113 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3ca0167700 con 0x7f3c8006c8f0 2024-04-16T13:06:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T13:06:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 msgr2=0x7f3c8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 0x7f3c8006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c90036000 tx=0x7f3c9003c040 comp rx=0 tx=0).stop 2024-04-16T13:06:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 msgr2=0x7f3ca00b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800cef0 tx=0x7f3c9800a710 comp rx=0 tx=0).stop 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 shutdown_connections 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f3c8006c8f0 0x7f3c8006edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ca0072050 0x7f3ca00b1420 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f3ca006f9d0 0x7f3ca00b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 --2- 172.21.15.67:0/2729516113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca006f040 0x7f3ca01426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 >> 172.21.15.67:0/2729516113 conn(0x7f3ca0067d90 msgr2=0x7f3ca00af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 shutdown_connections 2024-04-16T13:06:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.005+0000 7f3c9f200640 1 -- 172.21.15.67:0/2729516113 wait complete. 2024-04-16T13:06:37.026 INFO:tasks.ceph:Scrubbing osd.2 2024-04-16T13:06:37.026 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.251+0000 7f378d600640 1 Processor -- start 2024-04-16T13:06:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.251+0000 7f378d600640 1 -- start start 2024-04-16T13:06:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378d600640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37880ce990 0x7f378806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378d600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f378815d4d0 0x7f3788072270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378d600640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378806dec0 con 0x7f3788071de0 2024-04-16T13:06:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378d600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f378806e7f0 con 0x7f378815d4d0 2024-04-16T13:06:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378d600640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f378806e1a0 con 0x7f37880ce990 2024-04-16T13:06:37.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f378815d4d0 0x7f3788072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f378815d4d0 0x7f3788072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43426/0 (socket says 172.21.15.67:43426) 2024-04-16T13:06:37.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.253+0000 7f378cc00640 1 -- 172.21.15.67:0/340720172 learned_addr learned my addr 172.21.15.67:0/340720172 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.254+0000 7f378cc00640 1 -- 172.21.15.67:0/340720172 >> v2:172.21.15.82:3300/0 conn(0x7f37880ce990 msgr2=0x7f378806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.254+0000 7f3787e00640 1 --2- 172.21.15.67:0/340720172 >> v2:172.21.15.82:3300/0 conn(0x7f37880ce990 0x7f378806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.254+0000 7f378cc00640 1 --2- 172.21.15.67:0/340720172 >> v2:172.21.15.82:3300/0 conn(0x7f37880ce990 0x7f378806ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.254+0000 7f378cc00640 1 -- 172.21.15.67:0/340720172 >> v1:172.21.15.82:6789/0 conn(0x7f3788071de0 legacy=0x7f378815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.254+0000 7f378cc00640 1 -- 172.21.15.67:0/340720172 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378806e480 con 0x7f378815d4d0 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.255+0000 7f378cc00640 1 --2- 172.21.15.67:0/340720172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f378815d4d0 0x7f3788072270 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f378806c570 tx=0x7f378002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3754deb8ec81c888 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.256+0000 7f3786a00640 1 -- 172.21.15.67:0/340720172 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378002c9f0 con 0x7f378815d4d0 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.256+0000 7f3786a00640 1 -- 172.21.15.67:0/340720172 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378002cb90 con 0x7f378815d4d0 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.256+0000 7f3786a00640 1 -- 172.21.15.67:0/340720172 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37800343f0 con 0x7f378815d4d0 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 -- 172.21.15.67:0/340720172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f378815d4d0 msgr2=0x7f3788072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 --2- 172.21.15.67:0/340720172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f378815d4d0 0x7f3788072270 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f378806c570 tx=0x7f378002be50 comp rx=0 tx=0).stop 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 -- 172.21.15.67:0/340720172 shutdown_connections 2024-04-16T13:06:37.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 --2- 172.21.15.67:0/340720172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f378815d4d0 0x7f3788072270 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 --2- 172.21.15.67:0/340720172 >> v2:172.21.15.82:3300/0 conn(0x7f37880ce990 0x7f378806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 -- 172.21.15.67:0/340720172 >> 172.21.15.67:0/340720172 conn(0x7f3788067d90 msgr2=0x7f378806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 -- 172.21.15.67:0/340720172 shutdown_connections 2024-04-16T13:06:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.257+0000 7f378d600640 1 -- 172.21.15.67:0/340720172 wait complete. 2024-04-16T13:06:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.259+0000 7f378d600640 1 Processor -- start 2024-04-16T13:06:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.259+0000 7f378d600640 1 -- start start 2024-04-16T13:06:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 0x7f3788151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37880ce990 0x7f37880b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378815d4d0 0x7f3788158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f378815ddc0 con 0x7f3788071de0 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f378815db10 con 0x7f378815d4d0 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378d600640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f378815df40 con 0x7f37880ce990 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f3787e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 0x7f3788151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f3787e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 0x7f3788151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43436/0 (socket says 172.21.15.67:43436) 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f3787e00640 1 -- 172.21.15.67:0/3359481609 learned_addr learned my addr 172.21.15.67:0/3359481609 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f3787400640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37880ce990 0x7f37880b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.260+0000 7f378cc00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378815d4d0 0x7f3788158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 -- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37880ce990 msgr2=0x7f37880b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f37880ce990 0x7f37880b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 -- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378815d4d0 msgr2=0x7f3788158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378815d4d0 0x7f3788158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37880b2480 con 0x7f3788071de0 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f378cc00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378815d4d0 0x7f3788158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f3787e00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 0x7f3788151550 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f377800c7f0 tx=0x7f377800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778015070 con 0x7f3788071de0 2024-04-16T13:06:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3778004240 con 0x7f3788071de0 2024-04-16T13:06:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778007620 con 0x7f3788071de0 2024-04-16T13:06:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37880b2760 con 0x7f3788071de0 2024-04-16T13:06:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.261+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37880b2d20 con 0x7f3788071de0 2024-04-16T13:06:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.262+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3788075bd0 con 0x7f3788071de0 2024-04-16T13:06:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.263+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37780079d0 con 0x7f3788071de0 2024-04-16T13:06:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.264+0000 7f377fe00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f376806c8f0 0x7f376806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.264+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f377808bdd0 con 0x7f3788071de0 2024-04-16T13:06:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.265+0000 7f377fe00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f37680751c0 0x7f3768077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.265+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3778021e50 con 0x7f37680751c0 2024-04-16T13:06:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.265+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f377808e390 con 0x7f3788071de0 2024-04-16T13:06:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.265+0000 7f378cc00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f37680751c0 0x7f3768077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.265+0000 7f3787400640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f376806c8f0 0x7f376806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.266+0000 7f378cc00640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f37680751c0 0x7f3768077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.266+0000 7f3787400640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f376806c8f0 0x7f376806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f378815b490 tx=0x7f3774009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.267+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== osd.2 v2:172.21.15.67:6808/2646355718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3778021e50 con 0x7f37680751c0 2024-04-16T13:06:37.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.281+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 --> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3788156d00 con 0x7f37680751c0 2024-04-16T13:06:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f377fe00640 1 -- 172.21.15.67:0/3359481609 <== osd.2 v2:172.21.15.67:6808/2646355718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3788156d00 con 0x7f37680751c0 2024-04-16T13:06:37.284 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:37.284 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:37.284 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f37680751c0 msgr2=0x7f3768077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:6808/2646355718,v1:172.21.15.67:6810/2646355718] conn(0x7f37680751c0 0x7f3768077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f376806c8f0 msgr2=0x7f376806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f376806c8f0 0x7f376806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f378815b490 tx=0x7f3774009040 comp rx=0 tx=0).stop 2024-04-16T13:06:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 msgr2=0x7f3788151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378d600640 1 --2- 172.21.15.67:0/3359481609 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3788071de0 0x7f3788151550 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f377800c7f0 tx=0x7f377800ccb0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.282+0000 7f378cc00640 1 -- 172.21.15.67:0/3359481609 reap_dead start 2024-04-16T13:06:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.283+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 shutdown_connections 2024-04-16T13:06:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.283+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 >> 172.21.15.67:0/3359481609 conn(0x7f3788067d90 msgr2=0x7f37880b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.283+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 shutdown_connections 2024-04-16T13:06:37.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.283+0000 7f378d600640 1 -- 172.21.15.67:0/3359481609 wait complete. 2024-04-16T13:06:37.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-16T13:06:37.335 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:06:37.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:06:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.508+0000 7f52dd400640 1 Processor -- start 2024-04-16T13:06:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.508+0000 7f52dd400640 1 -- start start 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dd400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f52d815c560 0x7f52d8071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dd400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80ceee0 0x7f52d80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dd400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80cfa30 con 0x7f52d80d0510 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dd400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f52d80cfd10 con 0x7f52d815c560 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dd400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80cfff0 con 0x7f52d80ceee0 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52d7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f52d815c560 0x7f52d8071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52d7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f52d815c560 0x7f52d8071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43448/0 (socket says 172.21.15.67:43448) 2024-04-16T13:06:37.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52d7e00640 1 -- 172.21.15.67:0/3121513903 learned_addr learned my addr 172.21.15.67:0/3121513903 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52dca00640 1 --1- 172.21.15.67:0/3121513903 >> v1:172.21.15.67:6789/0 conn(0x7f52d80d0510 0x7f52d806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60426/0 (socket says 172.21.15.67:60426) 2024-04-16T13:06:37.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.510+0000 7f52d7400640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80ceee0 0x7f52d80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.511+0000 7f52d7e00640 1 -- 172.21.15.67:0/3121513903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80ceee0 msgr2=0x7f52d80cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.511+0000 7f52d7e00640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80ceee0 0x7f52d80cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.511+0000 7f52d7e00640 1 -- 172.21.15.67:0/3121513903 >> v1:172.21.15.67:6789/0 conn(0x7f52d80d0510 legacy=0x7f52d806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.511+0000 7f52d7e00640 1 -- 172.21.15.67:0/3121513903 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d806e870 con 0x7f52d815c560 2024-04-16T13:06:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.512+0000 7f52d7e00640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d815c560 0x7f52d8071d50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e361560e8953ede server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.512+0000 7f52d6a00640 1 -- 172.21.15.67:0/3121513903 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8034070 con 0x7f52d815c560 2024-04-16T13:06:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.512+0000 7f52d6a00640 1 -- 172.21.15.67:0/3121513903 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c8030840 con 0x7f52d815c560 2024-04-16T13:06:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.512+0000 7f52d6a00640 1 -- 172.21.15.67:0/3121513903 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8030c10 con 0x7f52d815c560 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 -- 172.21.15.67:0/3121513903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d815c560 msgr2=0x7f52d8071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d815c560 0x7f52d8071d50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c802b980 comp rx=0 tx=0).stop 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 -- 172.21.15.67:0/3121513903 shutdown_connections 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d80ceee0 0x7f52d80cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 --2- 172.21.15.67:0/3121513903 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d815c560 0x7f52d8071d50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 -- 172.21.15.67:0/3121513903 >> 172.21.15.67:0/3121513903 conn(0x7f52d806bc00 msgr2=0x7f52d806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 -- 172.21.15.67:0/3121513903 shutdown_connections 2024-04-16T13:06:37.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.513+0000 7f52dd400640 1 -- 172.21.15.67:0/3121513903 wait complete. 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.515+0000 7f52dd400640 1 Processor -- start 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.515+0000 7f52dd400640 1 -- start start 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 0x7f52d80cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815c560 0x7f52d80ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f52d815c940 con 0x7f52d80d0510 2024-04-16T13:06:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8072290 con 0x7f52d80ceee0 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52dd400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80b4340 con 0x7f52d815c560 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52d7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52d7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43464/0 (socket says 172.21.15.67:43464) 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.516+0000 7f52d7400640 1 -- 172.21.15.67:0/4083182571 learned_addr learned my addr 172.21.15.67:0/4083182571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7e00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 0x7f52d80cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52dca00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815c560 0x7f52d80ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 -- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815c560 msgr2=0x7f52d80ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815c560 0x7f52d80ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 -- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 msgr2=0x7f52d80cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 0x7f52d80cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 -- 172.21.15.67:0/4083182571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80ca9a0 con 0x7f52d80d0510 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7e00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 0x7f52d80cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.517+0000 7f52d7400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d800 tx=0x7f52c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.518+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c400b6c0 con 0x7f52d80d0510 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.518+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4019070 con 0x7f52d80d0510 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.518+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c400ba80 con 0x7f52d80d0510 2024-04-16T13:06:37.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.518+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d80cac80 con 0x7f52d80d0510 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.518+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d80cb240 con 0x7f52d80d0510 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.519+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8075bd0 con 0x7f52d80d0510 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.520+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52c400bc20 con 0x7f52d80d0510 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.521+0000 7f52cfe00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 0x7f52b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.521+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f52c408c200 con 0x7f52d80d0510 2024-04-16T13:06:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.522+0000 7f52d7e00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 0x7f52b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.523+0000 7f52d7e00640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 0x7f52b806edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f52c8036000 tx=0x7f52c803b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.525+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52c405a470 con 0x7f52d80d0510 2024-04-16T13:06:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.730+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f52d8074010 con 0x7f52b806c8f0 2024-04-16T13:06:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.731+0000 7f52cfe00640 1 -- 172.21.15.67:0/4083182571 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f52d8074010 con 0x7f52b806c8f0 2024-04-16T13:06:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T13:06:37.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 msgr2=0x7f52b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 0x7f52b806edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f52c8036000 tx=0x7f52c803b040 comp rx=0 tx=0).stop 2024-04-16T13:06:37.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 msgr2=0x7f52d80cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d800 tx=0x7f52c400dcc0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 shutdown_connections 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f52b806c8f0 0x7f52b806edb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f52d815c560 0x7f52d80ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52d80d0510 0x7f52d80cbf80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 --2- 172.21.15.67:0/4083182571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52d80ceee0 0x7f52d80cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 >> 172.21.15.67:0/4083182571 conn(0x7f52d806bc00 msgr2=0x7f52d815b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 shutdown_connections 2024-04-16T13:06:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.734+0000 7f52dd400640 1 -- 172.21.15.67:0/4083182571 wait complete. 2024-04-16T13:06:37.755 INFO:tasks.ceph:Scrubbing osd.3 2024-04-16T13:06:37.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.979+0000 7f9fce400640 1 Processor -- start 2024-04-16T13:06:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.979+0000 7f9fce400640 1 -- start start 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fce400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fc80724f0 0x7f9fc806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fce400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc815cdc0 0x7f9fc815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fce400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc806dec0 con 0x7f9fc80ce990 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fce400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc806e7f0 con 0x7f9fc80724f0 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fce400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc806e1a0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fc80724f0 0x7f9fc806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9fc80724f0 0x7f9fc806ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43472/0 (socket says 172.21.15.67:43472) 2024-04-16T13:06:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 -- 172.21.15.67:0/12102199 learned_addr learned my addr 172.21.15.67:0/12102199 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fcda00640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc815cdc0 0x7f9fc815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 -- 172.21.15.67:0/12102199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc815cdc0 msgr2=0x7f9fc815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc815cdc0 0x7f9fc815d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 -- 172.21.15.67:0/12102199 >> v1:172.21.15.82:6789/0 conn(0x7f9fc80ce990 legacy=0x7f9fc8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.982+0000 7f9fc7e00640 1 -- 172.21.15.67:0/12102199 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc806e480 con 0x7f9fc80724f0 2024-04-16T13:06:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.983+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc80724f0 0x7f9fc806ec80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009870 tx=0x7f9fb002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb1e2b0c86de14a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.983+0000 7f9fc7400640 1 -- 172.21.15.67:0/12102199 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00317c0 con 0x7f9fc80724f0 2024-04-16T13:06:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.983+0000 7f9fc7400640 1 -- 172.21.15.67:0/12102199 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb0037070 con 0x7f9fc80724f0 2024-04-16T13:06:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.983+0000 7f9fc7400640 1 -- 172.21.15.67:0/12102199 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0031b80 con 0x7f9fc80724f0 2024-04-16T13:06:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 -- 172.21.15.67:0/12102199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc80724f0 msgr2=0x7f9fc806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc80724f0 0x7f9fc806ec80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009870 tx=0x7f9fb002b860 comp rx=0 tx=0).stop 2024-04-16T13:06:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 -- 172.21.15.67:0/12102199 shutdown_connections 2024-04-16T13:06:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc815cdc0 0x7f9fc815d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 --2- 172.21.15.67:0/12102199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc80724f0 0x7f9fc806ec80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 -- 172.21.15.67:0/12102199 >> 172.21.15.67:0/12102199 conn(0x7f9fc8067d90 msgr2=0x7f9fc806ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 -- 172.21.15.67:0/12102199 shutdown_connections 2024-04-16T13:06:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.984+0000 7f9fce400640 1 -- 172.21.15.67:0/12102199 wait complete. 2024-04-16T13:06:37.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.986+0000 7f9fce400640 1 Processor -- start 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.986+0000 7f9fce400640 1 -- start start 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc80724f0 0x7f9fc8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc80ce990 0x7f9fc80cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 0x7f9fc80cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc815d790 con 0x7f9fc815cdc0 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc815db10 con 0x7f9fc80ce990 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fce400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc815ddc0 con 0x7f9fc80724f0 2024-04-16T13:06:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fcda00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 0x7f9fc80cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fcda00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 0x7f9fc80cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43486/0 (socket says 172.21.15.67:43486) 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.987+0000 7f9fcda00640 1 -- 172.21.15.67:0/3094591533 learned_addr learned my addr 172.21.15.67:0/3094591533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcd000640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc80724f0 0x7f9fc8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc80ce990 0x7f9fc80cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 -- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc80724f0 msgr2=0x7f9fc8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f9fc80724f0 0x7f9fc8154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 -- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc80ce990 msgr2=0x7f9fc80cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc80ce990 0x7f9fc80cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc80c9b00 con 0x7f9fc815cdc0 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fc80ce990 0x7f9fc80cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fcda00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 0x7f9fc80cb750 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c550 tx=0x7f9fb800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8015070 con 0x7f9fc815cdc0 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb8004220 con 0x7f9fc815cdc0 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc80c9de0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.988+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8003610 con 0x7f9fc815cdc0 2024-04-16T13:06:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.989+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc80ca3a0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.989+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fc8075bd0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.991+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fb80037b0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc4c00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9fa406c8f0 0x7f9fa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f9fb808bb70 con 0x7f9fc815cdc0 2024-04-16T13:06:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc4c00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f9fa40751c0 0x7f9fa4077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fa4077cf0 con 0x7f9fa40751c0 2024-04-16T13:06:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9fb80902a0 con 0x7f9fc815cdc0 2024-04-16T13:06:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fcd000640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9fa406c8f0 0x7f9fa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.992+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f9fa40751c0 0x7f9fa4077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.993+0000 7f9fc7e00640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f9fa40751c0 0x7f9fa4077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.994+0000 7f9fcd000640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9fa406c8f0 0x7f9fa406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005520 tx=0x7f9fc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:37.994+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== osd.3 v2:172.21.15.67:6823/2159316217 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9fa4077cf0 con 0x7f9fa40751c0 2024-04-16T13:06:38.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.009+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 --> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9fc80ca890 con 0x7f9fa40751c0 2024-04-16T13:06:38.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fc4c00640 1 -- 172.21.15.67:0/3094591533 <== osd.3 v2:172.21.15.67:6823/2159316217 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9fc80ca890 con 0x7f9fa40751c0 2024-04-16T13:06:38.012 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:38.012 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:38.012 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f9fa40751c0 msgr2=0x7f9fa4077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:6823/2159316217,v1:172.21.15.67:6825/2159316217] conn(0x7f9fa40751c0 0x7f9fa4077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9fa406c8f0 msgr2=0x7f9fa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f9fa406c8f0 0x7f9fa406edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0005520 tx=0x7f9fc0009040 comp rx=0 tx=0).stop 2024-04-16T13:06:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 msgr2=0x7f9fc80cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 --2- 172.21.15.67:0/3094591533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fc815cdc0 0x7f9fc80cb750 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c550 tx=0x7f9fb800ca10 comp rx=0 tx=0).stop 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fcda00640 1 -- 172.21.15.67:0/3094591533 reap_dead start 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 shutdown_connections 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.010+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 >> 172.21.15.67:0/3094591533 conn(0x7f9fc8067d90 msgr2=0x7f9fc80cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.011+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 shutdown_connections 2024-04-16T13:06:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.011+0000 7f9fce400640 1 -- 172.21.15.67:0/3094591533 wait complete. 2024-04-16T13:06:38.031 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-16T13:06:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.244+0000 7f78d9400640 1 Processor -- start 2024-04-16T13:06:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.244+0000 7f78d9400640 1 -- start start 2024-04-16T13:06:38.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d9400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78d415bc60 0x7f78d40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78d40b56e0 0x7f78d413f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d9400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d415c290 con 0x7f78d413e880 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d9400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f78d40b5b10 con 0x7f78d40b56e0 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d9400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f78d415c570 con 0x7f78d415bc60 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78d40b56e0 0x7f78d413f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d3200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f78d40b56e0 0x7f78d413f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43488/0 (socket says 172.21.15.67:43488) 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.245+0000 7f78d3200640 1 -- 172.21.15.67:0/1504797227 learned_addr learned my addr 172.21.15.67:0/1504797227 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:38.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.246+0000 7f78d3200640 1 -- 172.21.15.67:0/1504797227 >> v2:172.21.15.82:3300/0 conn(0x7f78d415bc60 msgr2=0x7f78d40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.246+0000 7f78d3200640 1 --2- 172.21.15.67:0/1504797227 >> v2:172.21.15.82:3300/0 conn(0x7f78d415bc60 0x7f78d40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.246+0000 7f78d3200640 1 -- 172.21.15.67:0/1504797227 >> v1:172.21.15.82:6789/0 conn(0x7f78d413e880 legacy=0x7f78d41418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.246+0000 7f78d3200640 1 -- 172.21.15.67:0/1504797227 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d415c850 con 0x7f78d40b56e0 2024-04-16T13:06:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.247+0000 7f78d3200640 1 --2- 172.21.15.67:0/1504797227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d40b56e0 0x7f78d413f360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f78d40b34c0 tx=0x7f78cc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce39e5293eeffa server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.247+0000 7f78d1400640 1 -- 172.21.15.67:0/1504797227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc02ca80 con 0x7f78d40b56e0 2024-04-16T13:06:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.247+0000 7f78d1400640 1 -- 172.21.15.67:0/1504797227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc02cc20 con 0x7f78d40b56e0 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.247+0000 7f78d1400640 1 -- 172.21.15.67:0/1504797227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0343f0 con 0x7f78d40b56e0 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 -- 172.21.15.67:0/1504797227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d40b56e0 msgr2=0x7f78d413f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 --2- 172.21.15.67:0/1504797227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d40b56e0 0x7f78d413f360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f78d40b34c0 tx=0x7f78cc02bee0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 -- 172.21.15.67:0/1504797227 shutdown_connections 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 --2- 172.21.15.67:0/1504797227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d40b56e0 0x7f78d413f360 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 --2- 172.21.15.67:0/1504797227 >> v2:172.21.15.82:3300/0 conn(0x7f78d415bc60 0x7f78d40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 -- 172.21.15.67:0/1504797227 >> 172.21.15.67:0/1504797227 conn(0x7f78d4067d90 msgr2=0x7f78d406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 -- 172.21.15.67:0/1504797227 shutdown_connections 2024-04-16T13:06:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.248+0000 7f78d9400640 1 -- 172.21.15.67:0/1504797227 wait complete. 2024-04-16T13:06:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.250+0000 7f78d9400640 1 Processor -- start 2024-04-16T13:06:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.250+0000 7f78d9400640 1 -- start start 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d40b56e0 0x7f78d41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d413e880 0x7f78d413aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f78d413fa20 con 0x7f78d415bc60 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f78d413f8a0 con 0x7f78d40b56e0 2024-04-16T13:06:38.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d9400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f78d413fba0 con 0x7f78d413e880 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d3200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43504/0 (socket says 172.21.15.67:43504) 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.251+0000 7f78d3200640 1 -- 172.21.15.67:0/2173029308 learned_addr learned my addr 172.21.15.67:0/2173029308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 -- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d413e880 msgr2=0x7f78d413aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d413e880 0x7f78d413aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d2800640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d40b56e0 0x7f78d41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 -- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d40b56e0 msgr2=0x7f78d41584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d40b56e0 0x7f78d41584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 -- 172.21.15.67:0/2173029308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d41f5820 con 0x7f78d415bc60 2024-04-16T13:06:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d3200640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009f40 tx=0x7f78cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc043020 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc03e450 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc009510 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.252+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d4158b70 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.253+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d4159130 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.254+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d4068a70 con 0x7f78d415bc60 2024-04-16T13:06:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.255+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78cc046020 con 0x7f78d415bc60 2024-04-16T13:06:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.256+0000 7f78caa00640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 0x7f78b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.256+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f78cc0ae720 con 0x7f78d415bc60 2024-04-16T13:06:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.256+0000 7f78d2800640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 0x7f78b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.258+0000 7f78d2800640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 0x7f78b406edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003d90 tx=0x7f78c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.262+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78cc04d030 con 0x7f78d415bc60 2024-04-16T13:06:38.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.470+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f78d4156620 con 0x7f78b406c8f0 2024-04-16T13:06:38.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.472+0000 7f78caa00640 1 -- 172.21.15.67:0/2173029308 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78d4156620 con 0x7f78b406c8f0 2024-04-16T13:06:38.473 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T13:06:38.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 msgr2=0x7f78b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 0x7f78b406edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78c4003d90 tx=0x7f78c4009040 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 msgr2=0x7f78d4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009f40 tx=0x7f78cc004a40 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 shutdown_connections 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f78b406c8f0 0x7f78b406edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d415bc60 0x7f78d4157410 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f78d413e880 0x7f78d413aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 --2- 172.21.15.67:0/2173029308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78d40b56e0 0x7f78d41584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 >> 172.21.15.67:0/2173029308 conn(0x7f78d4067d90 msgr2=0x7f78d406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:38.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 shutdown_connections 2024-04-16T13:06:38.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.474+0000 7f78d9400640 1 -- 172.21.15.67:0/2173029308 wait complete. 2024-04-16T13:06:38.497 INFO:tasks.ceph:Scrubbing osd.4 2024-04-16T13:06:38.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 Processor -- start 2024-04-16T13:06:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 -- start start 2024-04-16T13:06:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f8006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8006dec0 con 0x7f0f80071de0 2024-04-16T13:06:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8006e1a0 con 0x7f0f8015d4d0 2024-04-16T13:06:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.721+0000 7f0f84a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8006e7f0 con 0x7f0f800ce990 2024-04-16T13:06:38.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.722+0000 7f0f7de00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0f80071de0 0x7f0f8015cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60436/0 (socket says 172.21.15.67:60436) 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.722+0000 7f0f7de00640 1 -- 172.21.15.67:0/465121870 learned_addr learned my addr 172.21.15.67:0/465121870 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.722+0000 7f0f7e800640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f8006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.722+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722387766 0 0) 0x7f0f8006dec0 con 0x7f0f80071de0 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.722+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f64003520 con 0x7f0f80071de0 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 727064276 0 0) 0x7f0f64003520 con 0x7f0f80071de0 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 msgr2=0x7f0f8006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f8006ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 >> v1:172.21.15.82:6789/0 conn(0x7f0f8015d4d0 legacy=0x7f0f8015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8006e480 con 0x7f0f80071de0 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f0f6c001670 con 0x7f0f80071de0 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 >> v1:172.21.15.67:6789/0 conn(0x7f0f80071de0 legacy=0x7f0f8015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640039e0 0x7f0f64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f64004d40 0x7f0f640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8006e7f0 con 0x7f0f64004d40 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6400bb50 con 0x7f0f640039e0 2024-04-16T13:06:38.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6400bd50 con 0x7f0f800ce990 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f64004d40 0x7f0f640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7de00640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7e800640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640039e0 0x7f0f64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 -- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 msgr2=0x7f0f64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f800ce990 0x7f0f64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 -- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640039e0 msgr2=0x7f0f64003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f640039e0 0x7f0f64003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.724+0000 7f0f7f200640 1 -- 172.21.15.67:0/465121870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f64003520 con 0x7f0f64004d40 2024-04-16T13:06:38.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f7f200640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f64004d40 0x7f0f640051c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0f78001e50 tx=0x7f0f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682ae3840ed40340 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78001a70 con 0x7f0f64004d40 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78003b70 con 0x7f0f64004d40 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f7d400640 1 -- 172.21.15.67:0/465121870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f780050d0 con 0x7f0f64004d40 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f84a00640 1 -- 172.21.15.67:0/465121870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f64004d40 msgr2=0x7f0f640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f84a00640 1 --2- 172.21.15.67:0/465121870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f64004d40 0x7f0f640051c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0f78001e50 tx=0x7f0f64005830 comp rx=0 tx=0).stop 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.725+0000 7f0f7f200640 1 -- 172.21.15.67:0/465121870 reap_dead start 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.726+0000 7f0f84a00640 1 -- 172.21.15.67:0/465121870 shutdown_connections 2024-04-16T13:06:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.726+0000 7f0f84a00640 1 -- 172.21.15.67:0/465121870 >> 172.21.15.67:0/465121870 conn(0x7f0f80067d90 msgr2=0x7f0f8006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.726+0000 7f0f84a00640 1 -- 172.21.15.67:0/465121870 shutdown_connections 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.726+0000 7f0f84a00640 1 -- 172.21.15.67:0/465121870 wait complete. 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.727+0000 7f0f84a00640 1 Processor -- start 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 -- start start 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f80141df0 0x7f0f80152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 0x7f0f800b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f80151820 0x7f0f800b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8006ec80 con 0x7f0f80153980 2024-04-16T13:06:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8015db10 con 0x7f0f80141df0 2024-04-16T13:06:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.728+0000 7f0f84a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8006ee00 con 0x7f0f80151820 2024-04-16T13:06:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 0x7f0f800b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 0x7f0f800b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43522/0 (socket says 172.21.15.67:43522) 2024-04-16T13:06:38.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 -- 172.21.15.67:0/278416573 learned_addr learned my addr 172.21.15.67:0/278416573 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:38.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 -- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f80151820 msgr2=0x7f0f800b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7f200640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f80151820 0x7f0f800b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7e800640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f80141df0 0x7f0f80152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f80151820 0x7f0f800b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 -- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f80141df0 msgr2=0x7f0f80152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f80141df0 0x7f0f80152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f801421d0 con 0x7f0f80153980 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7f200640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f0f80151820 0x7f0f800b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f7de00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 0x7f0f800b0930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00eb20 tx=0x7f0f6c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00c8d0 con 0x7f0f80153980 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c018070 con 0x7f0f80153980 2024-04-16T13:06:38.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00ccd0 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f801528e0 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.730+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f80152ea0 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.731+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f80075bd0 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.732+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f6c01d460 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.733+0000 7f0f76a00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f6006c8f0 0x7f0f6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.733+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f0f6c08be20 con 0x7f0f80153980 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.733+0000 7f0f76a00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f0f600751c0 0x7f0f60077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:38.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.733+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f6c008e50 con 0x7f0f600751c0 2024-04-16T13:06:38.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.733+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0f6c08e3e0 con 0x7f0f80153980 2024-04-16T13:06:38.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.735+0000 7f0f7e800640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f6006c8f0 0x7f0f6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.735+0000 7f0f7f200640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f0f600751c0 0x7f0f60077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:38.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.736+0000 7f0f7f200640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f0f600751c0 0x7f0f60077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.736+0000 7f0f7e800640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f6006c8f0 0x7f0f6006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009910 tx=0x7f0f70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:38.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.738+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== osd.4 v2:172.21.15.82:6816/3746718267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f6c008e50 con 0x7f0f600751c0 2024-04-16T13:06:38.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.752+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 --> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0f801530a0 con 0x7f0f600751c0 2024-04-16T13:06:38.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.754+0000 7f0f76a00640 1 -- 172.21.15.67:0/278416573 <== osd.4 v2:172.21.15.82:6816/3746718267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0f801530a0 con 0x7f0f600751c0 2024-04-16T13:06:38.755 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:38.756 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:38.756 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f0f600751c0 msgr2=0x7f0f60077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6816/3746718267,v1:172.21.15.82:6817/3746718267] conn(0x7f0f600751c0 0x7f0f60077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f6006c8f0 msgr2=0x7f0f6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f0f6006c8f0 0x7f0f6006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009910 tx=0x7f0f70008040 comp rx=0 tx=0).stop 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 msgr2=0x7f0f800b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 --2- 172.21.15.67:0/278416573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f80153980 0x7f0f800b0930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00eb20 tx=0x7f0f6c001690 comp rx=0 tx=0).stop 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f7f200640 1 -- 172.21.15.67:0/278416573 reap_dead start 2024-04-16T13:06:38.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 shutdown_connections 2024-04-16T13:06:38.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 >> 172.21.15.67:0/278416573 conn(0x7f0f80067d90 msgr2=0x7f0f8015a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:38.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 shutdown_connections 2024-04-16T13:06:38.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.755+0000 7f0f84a00640 1 -- 172.21.15.67:0/278416573 wait complete. 2024-04-16T13:06:38.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-16T13:06:38.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.998+0000 7fbdc9200640 1 Processor -- start 2024-04-16T13:06:38.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.998+0000 7fbdc9200640 1 -- start start 2024-04-16T13:06:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc9200640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbdc40724f0 0x7fbdc406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc9200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbdc415cdc0 0x7fbdc415d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc9200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc406dec0 con 0x7fbdc40ce990 2024-04-16T13:06:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc9200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc406e7f0 con 0x7fbdc415cdc0 2024-04-16T13:06:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc9200640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc406e1a0 con 0x7fbdc40724f0 2024-04-16T13:06:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc3400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbdc40ce990 0x7fbdc4071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60440/0 (socket says 172.21.15.67:60440) 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc3400640 1 -- 172.21.15.67:0/2545438091 learned_addr learned my addr 172.21.15.67:0/2545438091 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:38.999+0000 7fbdc3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbdc415cdc0 0x7fbdc415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc2a00640 1 --2- 172.21.15.67:0/2545438091 >> v2:172.21.15.82:3300/0 conn(0x7fbdc40724f0 0x7fbdc406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc3e00640 1 -- 172.21.15.67:0/2545438091 >> v2:172.21.15.82:3300/0 conn(0x7fbdc40724f0 msgr2=0x7fbdc406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc3e00640 1 --2- 172.21.15.67:0/2545438091 >> v2:172.21.15.82:3300/0 conn(0x7fbdc40724f0 0x7fbdc406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc2000640 1 -- 172.21.15.67:0/2545438091 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279529422 0 0) 0x7fbdc406dec0 con 0x7fbdc40ce990 2024-04-16T13:06:39.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc3e00640 1 -- 172.21.15.67:0/2545438091 >> v1:172.21.15.67:6789/0 conn(0x7fbdc40ce990 legacy=0x7fbdc4071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.000+0000 7fbdc3e00640 1 -- 172.21.15.67:0/2545438091 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc406e480 con 0x7fbdc415cdc0 2024-04-16T13:06:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.001+0000 7fbdc3e00640 1 --2- 172.21.15.67:0/2545438091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc415cdc0 0x7fbdc415d230 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4072b40 tx=0x7fbdbc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41ef0f5e6424f0f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.001+0000 7fbdc2000640 1 -- 172.21.15.67:0/2545438091 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0315a0 con 0x7fbdc415cdc0 2024-04-16T13:06:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.001+0000 7fbdc2000640 1 -- 172.21.15.67:0/2545438091 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc037070 con 0x7fbdc415cdc0 2024-04-16T13:06:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.001+0000 7fbdc2000640 1 -- 172.21.15.67:0/2545438091 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc031960 con 0x7fbdc415cdc0 2024-04-16T13:06:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 -- 172.21.15.67:0/2545438091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc415cdc0 msgr2=0x7fbdc415d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 --2- 172.21.15.67:0/2545438091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc415cdc0 0x7fbdc415d230 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4072b40 tx=0x7fbdbc02b840 comp rx=0 tx=0).stop 2024-04-16T13:06:39.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 -- 172.21.15.67:0/2545438091 shutdown_connections 2024-04-16T13:06:39.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 --2- 172.21.15.67:0/2545438091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc415cdc0 0x7fbdc415d230 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 --2- 172.21.15.67:0/2545438091 >> v2:172.21.15.82:3300/0 conn(0x7fbdc40724f0 0x7fbdc406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 -- 172.21.15.67:0/2545438091 >> 172.21.15.67:0/2545438091 conn(0x7fbdc4067d90 msgr2=0x7fbdc406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 -- 172.21.15.67:0/2545438091 shutdown_connections 2024-04-16T13:06:39.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.002+0000 7fbdc9200640 1 -- 172.21.15.67:0/2545438091 wait complete. 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.004+0000 7fbdc9200640 1 Processor -- start 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.004+0000 7fbdc9200640 1 -- start start 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 0x7fbdc4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 0x7fbdc40b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc415d770 con 0x7fbdc40724f0 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc415db10 con 0x7fbdc415cdc0 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc9200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc415d8f0 con 0x7fbdc40ce990 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43548/0 (socket says 172.21.15.67:43548) 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.005+0000 7fbdc3400640 1 -- 172.21.15.67:0/642292605 learned_addr learned my addr 172.21.15.67:0/642292605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc2a00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 0x7fbdc4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3e00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 0x7fbdc40b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 -- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 msgr2=0x7fbdc4155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 0x7fbdc4155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 -- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 msgr2=0x7fbdc40b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 0x7fbdc40b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 -- 172.21.15.67:0/642292605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40b5540 con 0x7fbdc40724f0 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc2a00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 0x7fbdc4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3e00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 0x7fbdc40b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc3400640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c8c0 tx=0x7fbdb400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4018070 con 0x7fbdc40724f0 2024-04-16T13:06:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb400a640 con 0x7fbdc40724f0 2024-04-16T13:06:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400aa30 con 0x7fbdc40724f0 2024-04-16T13:06:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.006+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc40b3f60 con 0x7fbdc40724f0 2024-04-16T13:06:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.007+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc40b4520 con 0x7fbdc40724f0 2024-04-16T13:06:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.008+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc4075bd0 con 0x7fbdc40724f0 2024-04-16T13:06:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.009+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdb401b070 con 0x7fbdc40724f0 2024-04-16T13:06:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.010+0000 7fbdbb400640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 0x7fbda406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.010+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fbdb408b390 con 0x7fbdc40724f0 2024-04-16T13:06:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.011+0000 7fbdc2a00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 0x7fbda406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.012+0000 7fbdc2a00640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 0x7fbda406ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbdc41eb400 tx=0x7fbdb0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.015+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdb4059610 con 0x7fbdc40724f0 2024-04-16T13:06:39.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.220+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fbdc41599d0 con 0x7fbda406c920 2024-04-16T13:06:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.222+0000 7fbdbb400640 1 -- 172.21.15.67:0/642292605 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbdc41599d0 con 0x7fbda406c920 2024-04-16T13:06:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T13:06:39.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 msgr2=0x7fbda406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 0x7fbda406ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbdc41eb400 tx=0x7fbdb0008040 comp rx=0 tx=0).stop 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 msgr2=0x7fbdc40b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c8c0 tx=0x7fbdb400cd80 comp rx=0 tx=0).stop 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 shutdown_connections 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbda406c920 0x7fbda406ede0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbdc415cdc0 0x7fbdc40b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbdc40ce990 0x7fbdc4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 --2- 172.21.15.67:0/642292605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdc40724f0 0x7fbdc40b5000 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.225+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 >> 172.21.15.67:0/642292605 conn(0x7fbdc4067d90 msgr2=0x7fbdc415aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.226+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 shutdown_connections 2024-04-16T13:06:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.226+0000 7fbdc9200640 1 -- 172.21.15.67:0/642292605 wait complete. 2024-04-16T13:06:39.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2024-04-16T13:06:39.246 INFO:tasks.ceph:Scrubbing osd.5 2024-04-16T13:06:39.246 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:39.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.474+0000 7f3029400640 1 Processor -- start 2024-04-16T13:06:39.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.474+0000 7f3029400640 1 -- start start 2024-04-16T13:06:39.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.476+0000 7f3029400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.476+0000 7f3029400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30240cbc10 0x7f30240cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.476+0000 7f3029400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30240b0d80 con 0x7f30240b3b00 2024-04-16T13:06:39.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.476+0000 7f3029400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f30240b1060 con 0x7f30240cbc10 2024-04-16T13:06:39.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.476+0000 7f3029400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f30240b1340 con 0x7f302415ebc0 2024-04-16T13:06:39.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.477+0000 7f3022800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.477+0000 7f3022800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:36736/0 (socket says 172.21.15.67:36736) 2024-04-16T13:06:39.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.477+0000 7f3022800640 1 -- 172.21.15.67:0/3955871738 learned_addr learned my addr 172.21.15.67:0/3955871738 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:39.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.477+0000 7f3023200640 1 --2- 172.21.15.67:0/3955871738 >> v2:172.21.15.82:3300/0 conn(0x7f30240cbc10 0x7f30240cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.478+0000 7f3022800640 1 -- 172.21.15.67:0/3955871738 >> v2:172.21.15.82:3300/0 conn(0x7f30240cbc10 msgr2=0x7f30240cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.478+0000 7f3022800640 1 --2- 172.21.15.67:0/3955871738 >> v2:172.21.15.82:3300/0 conn(0x7f30240cbc10 0x7f30240cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.478+0000 7f3022800640 1 -- 172.21.15.67:0/3955871738 >> v1:172.21.15.82:6789/0 conn(0x7f30240b3b00 legacy=0x7f30240b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.478+0000 7f3022800640 1 -- 172.21.15.67:0/3955871738 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240b1620 con 0x7f302415ebc0 2024-04-16T13:06:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.479+0000 7f3022800640 1 --2- 172.21.15.67:0/3955871738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3014009870 tx=0x7f301402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecef1e6659b1024d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.479+0000 7f3021400640 1 -- 172.21.15.67:0/3955871738 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014034070 con 0x7f302415ebc0 2024-04-16T13:06:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3021400640 1 -- 172.21.15.67:0/3955871738 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3014030840 con 0x7f302415ebc0 2024-04-16T13:06:39.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3021400640 1 -- 172.21.15.67:0/3955871738 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014030c10 con 0x7f302415ebc0 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 -- 172.21.15.67:0/3955871738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 msgr2=0x7f302406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 --2- 172.21.15.67:0/3955871738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3014009870 tx=0x7f301402b980 comp rx=0 tx=0).stop 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 -- 172.21.15.67:0/3955871738 shutdown_connections 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 --2- 172.21.15.67:0/3955871738 >> v2:172.21.15.82:3300/0 conn(0x7f30240cbc10 0x7f30240cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 --2- 172.21.15.67:0/3955871738 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f302406ba20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 -- 172.21.15.67:0/3955871738 >> 172.21.15.67:0/3955871738 conn(0x7f302409aa70 msgr2=0x7f30240b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 -- 172.21.15.67:0/3955871738 shutdown_connections 2024-04-16T13:06:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.480+0000 7f3029400640 1 -- 172.21.15.67:0/3955871738 wait complete. 2024-04-16T13:06:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.482+0000 7f3029400640 1 Processor -- start 2024-04-16T13:06:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.482+0000 7f3029400640 1 -- start start 2024-04-16T13:06:39.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 0x7f30240b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30240cbc10 0x7f3024150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f30240d1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f30240b2250 con 0x7f30240b3b00 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f302406c320 con 0x7f30240cbc10 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.483+0000 7f3029400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f302406bf60 con 0x7f302415ebc0 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 0x7f30240b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 0x7f30240b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43552/0 (socket says 172.21.15.67:43552) 2024-04-16T13:06:39.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 -- 172.21.15.67:0/4052087126 learned_addr learned my addr 172.21.15.67:0/4052087126 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:39.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3021e00640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30240cbc10 0x7f3024150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 -- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 msgr2=0x7f30240d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f302415ebc0 0x7f30240d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 -- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30240cbc10 msgr2=0x7f3024150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30240cbc10 0x7f3024150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.484+0000 7f3022800640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240b6850 con 0x7f30240b3b00 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f3022800640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 0x7f30240b6020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3014000c00 tx=0x7f3014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014048070 con 0x7f30240b3b00 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3014030640 con 0x7f30240b3b00 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30240b6b30 con 0x7f30240b3b00 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014034040 con 0x7f30240b3b00 2024-04-16T13:06:39.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.485+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30240b70f0 con 0x7f30240b3b00 2024-04-16T13:06:39.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.486+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30240cee60 con 0x7f30240b3b00 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.487+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f301404b070 con 0x7f30240b3b00 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.488+0000 7f301aa00640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f300406c920 0x7f300406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.488+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f30140adbc0 con 0x7f30240b3b00 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.488+0000 7f301aa00640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f30040751e0 0x7f3004077640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.489+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3004077d10 con 0x7f30040751e0 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.489+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f30140b22a0 con 0x7f30240b3b00 2024-04-16T13:06:39.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.489+0000 7f3021e00640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f300406c920 0x7f300406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.489+0000 7f3023200640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f30040751e0 0x7f3004077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.490+0000 7f3021e00640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f300406c920 0x7f300406ede0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3010007fd0 tx=0x7f3010009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.491+0000 7f3023200640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f30040751e0 0x7f3004077640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.493+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== osd.5 v2:172.21.15.82:6800/2359128195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3004077d10 con 0x7f30040751e0 2024-04-16T13:06:39.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.508+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 --> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3024068290 con 0x7f30040751e0 2024-04-16T13:06:39.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.509+0000 7f301aa00640 1 -- 172.21.15.67:0/4052087126 <== osd.5 v2:172.21.15.82:6800/2359128195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3024068290 con 0x7f30040751e0 2024-04-16T13:06:39.510 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:39.510 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:39.510 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.509+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f30040751e0 msgr2=0x7f3004077640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.509+0000 7f3029400640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6800/2359128195,v1:172.21.15.82:6801/2359128195] conn(0x7f30040751e0 0x7f3004077640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.509+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f300406c920 msgr2=0x7f300406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f300406c920 0x7f300406ede0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3010007fd0 tx=0x7f3010009040 comp rx=0 tx=0).stop 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 msgr2=0x7f30240b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 --2- 172.21.15.67:0/4052087126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f30240b3b00 0x7f30240b6020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3014000c00 tx=0x7f3014004730 comp rx=0 tx=0).stop 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3023200640 1 -- 172.21.15.67:0/4052087126 reap_dead start 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 shutdown_connections 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 >> 172.21.15.67:0/4052087126 conn(0x7f302409aa70 msgr2=0x7f302406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 shutdown_connections 2024-04-16T13:06:39.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.510+0000 7f3029400640 1 -- 172.21.15.67:0/4052087126 wait complete. 2024-04-16T13:06:39.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-16T13:06:39.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.751+0000 7fc83e800640 1 Processor -- start 2024-04-16T13:06:39.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.752+0000 7fc83e800640 1 -- start start 2024-04-16T13:06:39.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc83815ec10 0x7fc8380d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83e800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8380d2e20 con 0x7fc8380d4380 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83e800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fc8380cf630 con 0x7fc83815ec10 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc8380d30c0 con 0x7fc83815e830 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83ca00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc83815ec10 0x7fc8380d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83ca00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc83815ec10 0x7fc8380d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43554/0 (socket says 172.21.15.67:43554) 2024-04-16T13:06:39.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.753+0000 7fc83ca00640 1 -- 172.21.15.67:0/714315206 learned_addr learned my addr 172.21.15.67:0/714315206 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.754+0000 7fc83d400640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.754+0000 7fc83ca00640 1 -- 172.21.15.67:0/714315206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 msgr2=0x7fc8380d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.754+0000 7fc83ca00640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.754+0000 7fc83ca00640 1 -- 172.21.15.67:0/714315206 >> v1:172.21.15.67:6789/0 conn(0x7fc8380d4380 legacy=0x7fc8380d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.754+0000 7fc83ca00640 1 -- 172.21.15.67:0/714315206 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8380d3380 con 0x7fc83815ec10 2024-04-16T13:06:39.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.755+0000 7fc83ca00640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc83815ec10 0x7fc8380d27e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc8380d2ff0 tx=0x7fc82c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04c21016ae9178e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.755+0000 7fc837e00640 1 -- 172.21.15.67:0/714315206 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c034070 con 0x7fc83815ec10 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.755+0000 7fc837e00640 1 -- 172.21.15.67:0/714315206 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c030840 con 0x7fc83815ec10 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.755+0000 7fc837e00640 1 -- 172.21.15.67:0/714315206 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c030c10 con 0x7fc83815ec10 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 -- 172.21.15.67:0/714315206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc83815ec10 msgr2=0x7fc8380d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc83815ec10 0x7fc8380d27e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc8380d2ff0 tx=0x7fc82c02b980 comp rx=0 tx=0).stop 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 -- 172.21.15.67:0/714315206 shutdown_connections 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc83815ec10 0x7fc8380d27e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 --2- 172.21.15.67:0/714315206 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 -- 172.21.15.67:0/714315206 >> 172.21.15.67:0/714315206 conn(0x7fc83809da40 msgr2=0x7fc83808c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 -- 172.21.15.67:0/714315206 shutdown_connections 2024-04-16T13:06:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.756+0000 7fc83e800640 1 -- 172.21.15.67:0/714315206 wait complete. 2024-04-16T13:06:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.758+0000 7fc83e800640 1 Processor -- start 2024-04-16T13:06:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.758+0000 7fc83e800640 1 -- start start 2024-04-16T13:06:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83815ec10 0x7fc8380cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc83806d2c0 con 0x7fc8380d4380 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc83806cda0 con 0x7fc83815ec10 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83e800640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fc83806d440 con 0x7fc83815e830 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43560/0 (socket says 172.21.15.67:43560) 2024-04-16T13:06:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.759+0000 7fc83d400640 1 -- 172.21.15.67:0/3388715532 learned_addr learned my addr 172.21.15.67:0/3388715532 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:39.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83ca00640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 -- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 msgr2=0x7fc8380b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380b95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 -- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83815ec10 msgr2=0x7fc8380cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83815ec10 0x7fc8380cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 -- 172.21.15.67:0/3388715532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8380ba0a0 con 0x7fc8380d4380 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc83d400640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c820 tx=0x7fc82800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828015070 con 0x7fc8380d4380 2024-04-16T13:06:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828004240 con 0x7fc8380d4380 2024-04-16T13:06:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.760+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82800ce10 con 0x7fc8380d4380 2024-04-16T13:06:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.761+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8380ba380 con 0x7fc8380d4380 2024-04-16T13:06:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.761+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83815f790 con 0x7fc8380d4380 2024-04-16T13:06:39.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.762+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83815f2a0 con 0x7fc8380d4380 2024-04-16T13:06:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.763+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc828007830 con 0x7fc8380d4380 2024-04-16T13:06:39.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.764+0000 7fc835600640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 0x7fc81c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.764+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc82808bcc0 con 0x7fc8380d4380 2024-04-16T13:06:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.764+0000 7fc83ca00640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 0x7fc81c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.765+0000 7fc83ca00640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 0x7fc81c06edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:39.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.768+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc828092080 con 0x7fc8380d4380 2024-04-16T13:06:39.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.977+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc8380ba550 con 0x7fc81c06c8f0 2024-04-16T13:06:39.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.979+0000 7fc835600640 1 -- 172.21.15.67:0/3388715532 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc82c0308e0 con 0x7fc81c06c8f0 2024-04-16T13:06:39.980 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T13:06:39.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 msgr2=0x7fc81c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 0x7fc81c06edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc82c036000 tx=0x7fc82c008030 comp rx=0 tx=0).stop 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 msgr2=0x7fc838152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c820 tx=0x7fc82800cce0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 shutdown_connections 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fc81c06c8f0 0x7fc81c06edb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc83815ec10 0x7fc8380cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fc83815e830 0x7fc8380b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 --2- 172.21.15.67:0/3388715532 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8380d4380 0x7fc838152ac0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:39.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 >> 172.21.15.67:0/3388715532 conn(0x7fc83809da40 msgr2=0x7fc8380cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:39.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 shutdown_connections 2024-04-16T13:06:39.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:39.982+0000 7fc83e800640 1 -- 172.21.15.67:0/3388715532 wait complete. 2024-04-16T13:06:40.002 INFO:tasks.ceph:Scrubbing osd.6 2024-04-16T13:06:40.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:40.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.230+0000 7f2a03200640 1 Processor -- start 2024-04-16T13:06:40.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.231+0000 7f2a03200640 1 -- start start 2024-04-16T13:06:40.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.232+0000 7f2a03200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a040d17f0 0x7f2a041694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.232+0000 7f2a03200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a040d2b10 con 0x7f2a040d0240 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.232+0000 7f2a03200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a040d2df0 con 0x7f2a0415e7e0 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.232+0000 7f2a03200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f2a040d30d0 con 0x7f2a040d17f0 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.233+0000 7f29fbe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2a040d0240 0x7f2a040d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60466/0 (socket says 172.21.15.67:60466) 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.233+0000 7f29fbe00640 1 -- 172.21.15.67:0/686115763 learned_addr learned my addr 172.21.15.67:0/686115763 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:06:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.233+0000 7f2a02800640 1 --2- 172.21.15.67:0/686115763 >> v2:172.21.15.67:3300/0 conn(0x7f2a040d17f0 0x7f2a041694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.233+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324702886 0 0) 0x7f2a040d2b10 con 0x7f2a040d0240 2024-04-16T13:06:40.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.233+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e8003520 con 0x7f2a040d0240 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2402019127 0 0) 0x7f29e8003520 con 0x7f2a040d0240 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 >> v2:172.21.15.67:3300/0 conn(0x7f2a040d17f0 msgr2=0x7f2a041694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 --2- 172.21.15.67:0/686115763 >> v2:172.21.15.67:3300/0 conn(0x7f2a040d17f0 0x7f2a041694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 >> v1:172.21.15.82:6789/0 conn(0x7f2a0415e7e0 legacy=0x7f2a040d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a040d33b0 con 0x7f2a040d0240 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f29ec001670 con 0x7f2a040d0240 2024-04-16T13:06:40.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 >> v1:172.21.15.67:6789/0 conn(0x7f2a040d0240 legacy=0x7f2a040d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29e80039b0 0x7f29e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2a040d30d0 con 0x7f29e8004800 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29e800c060 con 0x7f29e80039b0 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f29e800c260 con 0x7f29e80051c0 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.234+0000 7f29fbe00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f2a01e00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29e80039b0 0x7f29e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f2a02800640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f29fbe00640 1 -- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29e80051c0 msgr2=0x7f29e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f29fbe00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f29e80051c0 0x7f29e800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f29fbe00640 1 -- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29e80039b0 msgr2=0x7f29e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f29fbe00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29e80039b0 0x7f29e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f29fbe00640 1 -- 172.21.15.67:0/686115763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e8003520 con 0x7f29e8004800 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f2a01e00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29e80039b0 0x7f29e8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.235+0000 7f2a02800640 1 -- 172.21.15.67:0/686115763 reap_dead start 2024-04-16T13:06:40.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.236+0000 7f29fbe00640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00c240 tx=0x7f29e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba30f918e1aa49e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.236+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec007d10 con 0x7f29e8004800 2024-04-16T13:06:40.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.236+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec030070 con 0x7f29e8004800 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.236+0000 7f2a01400640 1 -- 172.21.15.67:0/686115763 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec005d70 con 0x7f29e8004800 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 -- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 msgr2=0x7f29e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00c240 tx=0x7f29e8005830 comp rx=0 tx=0).stop 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 -- 172.21.15.67:0/686115763 shutdown_connections 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 --2- 172.21.15.67:0/686115763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f29e8004c80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 -- 172.21.15.67:0/686115763 >> 172.21.15.67:0/686115763 conn(0x7f2a0409da60 msgr2=0x7f2a0408c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 -- 172.21.15.67:0/686115763 shutdown_connections 2024-04-16T13:06:40.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.237+0000 7f2a03200640 1 -- 172.21.15.67:0/686115763 wait complete. 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.239+0000 7f2a03200640 1 Processor -- start 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.239+0000 7f2a03200640 1 -- start start 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f2a040cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a040cc400 0x7f2a04160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a04160e40 0x7f2a041612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0415ed40 con 0x7f29e8004800 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0415ebc0 con 0x7f2a040cc400 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a03200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2a040d10e0 con 0x7f2a04160e40 2024-04-16T13:06:40.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a01e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f2a040cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a01e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f2a040cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43578/0 (socket says 172.21.15.67:43578) 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.240+0000 7f2a01e00640 1 -- 172.21.15.67:0/1355221368 learned_addr learned my addr 172.21.15.67:0/1355221368 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 -- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a04160e40 msgr2=0x7f2a041612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2a04160e40 0x7f2a041612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 -- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a040cc400 msgr2=0x7f2a04160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a040cc400 0x7f2a04160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a040cc9c0 con 0x7f29e8004800 2024-04-16T13:06:40.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f2a01e00640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f2a040cab60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d470 tx=0x7f29f400d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4018070 con 0x7f29e8004800 2024-04-16T13:06:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.241+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f40054e0 con 0x7f29e8004800 2024-04-16T13:06:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.242+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4003880 con 0x7f29e8004800 2024-04-16T13:06:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.242+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a040ccca0 con 0x7f29e8004800 2024-04-16T13:06:40.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.242+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a040cd260 con 0x7f29e8004800 2024-04-16T13:06:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.243+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a04075bd0 con 0x7f29e8004800 2024-04-16T13:06:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.244+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29f401b070 con 0x7f29e8004800 2024-04-16T13:06:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fa000640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f29e006c8f0 0x7f29e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f29f408b3e0 con 0x7f29e8004800 2024-04-16T13:06:40.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fa000640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f29e00751c0 0x7f29e0077620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f401ae50 con 0x7f29e00751c0 2024-04-16T13:06:40.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f29f4092050 con 0x7f29e8004800 2024-04-16T13:06:40.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.245+0000 7f29fbe00640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f29e006c8f0 0x7f29e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.246+0000 7f2a02800640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f29e00751c0 0x7f29e0077620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.247+0000 7f29fbe00640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f29e006c8f0 0x7f29e006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f29ec034000 tx=0x7f29ec007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.247+0000 7f2a02800640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f29e00751c0 0x7f29e0077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.249+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== osd.6 v2:172.21.15.82:6819/87066875 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f401ae50 con 0x7f29e00751c0 2024-04-16T13:06:40.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.264+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 --> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2a041f1a40 con 0x7f29e00751c0 2024-04-16T13:06:40.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.265+0000 7f29fa000640 1 -- 172.21.15.67:0/1355221368 <== osd.6 v2:172.21.15.82:6819/87066875 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2a041f1a40 con 0x7f29e00751c0 2024-04-16T13:06:40.267 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:40.267 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:40.267 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f29e00751c0 msgr2=0x7f29e0077620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6819/87066875,v1:172.21.15.82:6822/87066875] conn(0x7f29e00751c0 0x7f29e0077620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f29e006c8f0 msgr2=0x7f29e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f29e006c8f0 0x7f29e006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f29ec034000 tx=0x7f29ec007000 comp rx=0 tx=0).stop 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 msgr2=0x7f2a040cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 --2- 172.21.15.67:0/1355221368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29e8004800 0x7f2a040cab60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d470 tx=0x7f29f400d930 comp rx=0 tx=0).stop 2024-04-16T13:06:40.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a02800640 1 -- 172.21.15.67:0/1355221368 reap_dead start 2024-04-16T13:06:40.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.266+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 shutdown_connections 2024-04-16T13:06:40.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.267+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 >> 172.21.15.67:0/1355221368 conn(0x7f2a0409da60 msgr2=0x7f2a040b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:40.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.267+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 shutdown_connections 2024-04-16T13:06:40.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.267+0000 7f2a03200640 1 -- 172.21.15.67:0/1355221368 wait complete. 2024-04-16T13:06:40.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-16T13:06:40.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.497+0000 7effb8a00640 1 Processor -- start 2024-04-16T13:06:40.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.497+0000 7effb8a00640 1 -- start start 2024-04-16T13:06:40.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.498+0000 7effb8a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effb4072050 0x7effb40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.498+0000 7effb8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effb8a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb41641f0 con 0x7effb406f9d0 2024-04-16T13:06:40.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effb8a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7effb40b3970 con 0x7effb4072050 2024-04-16T13:06:40.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effb8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb41635e0 con 0x7effb406f040 2024-04-16T13:06:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effabe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effabe00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:36810/0 (socket says 172.21.15.67:36810) 2024-04-16T13:06:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effabe00640 1 -- 172.21.15.67:0/2495166451 learned_addr learned my addr 172.21.15.67:0/2495166451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.499+0000 7effb2800640 1 --2- 172.21.15.67:0/2495166451 >> v2:172.21.15.82:3300/0 conn(0x7effb4072050 0x7effb40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.500+0000 7effabe00640 1 -- 172.21.15.67:0/2495166451 >> v2:172.21.15.82:3300/0 conn(0x7effb4072050 msgr2=0x7effb40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.500+0000 7effabe00640 1 --2- 172.21.15.67:0/2495166451 >> v2:172.21.15.82:3300/0 conn(0x7effb4072050 0x7effb40b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.500+0000 7effabe00640 1 -- 172.21.15.67:0/2495166451 >> v1:172.21.15.82:6789/0 conn(0x7effb406f9d0 legacy=0x7effb406e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.500+0000 7effb1e00640 1 -- 172.21.15.67:0/2495166451 <== mon.1 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948982137 0 0) 0x7effb41641f0 con 0x7effb406f9d0 2024-04-16T13:06:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.500+0000 7effabe00640 1 -- 172.21.15.67:0/2495166451 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb406ed50 con 0x7effb406f040 2024-04-16T13:06:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.502+0000 7effabe00640 1 --2- 172.21.15.67:0/2495166451 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0098a0 tx=0x7eff9c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96edbefa4975ca45 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.502+0000 7effb1e00640 1 -- 172.21.15.67:0/2495166451 <== mon.2 v2:172.21.15.82:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c034070 con 0x7effb406f040 2024-04-16T13:06:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.502+0000 7effb1e00640 1 -- 172.21.15.67:0/2495166451 <== mon.2 v2:172.21.15.82:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c030840 con 0x7effb406f040 2024-04-16T13:06:40.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.502+0000 7effb1e00640 1 -- 172.21.15.67:0/2495166451 <== mon.2 v2:172.21.15.82:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c030c10 con 0x7effb406f040 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 -- 172.21.15.67:0/2495166451 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 msgr2=0x7effb406e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 --2- 172.21.15.67:0/2495166451 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0098a0 tx=0x7eff9c02b980 comp rx=0 tx=0).stop 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 -- 172.21.15.67:0/2495166451 shutdown_connections 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 --2- 172.21.15.67:0/2495166451 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb406f040 0x7effb406e100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 --2- 172.21.15.67:0/2495166451 >> v2:172.21.15.82:3300/0 conn(0x7effb4072050 0x7effb40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 -- 172.21.15.67:0/2495166451 >> 172.21.15.67:0/2495166451 conn(0x7effb4067d90 msgr2=0x7effb406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 -- 172.21.15.67:0/2495166451 shutdown_connections 2024-04-16T13:06:40.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.503+0000 7effb8a00640 1 -- 172.21.15.67:0/2495166451 wait complete. 2024-04-16T13:06:40.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.505+0000 7effb8a00640 1 Processor -- start 2024-04-16T13:06:40.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.505+0000 7effb8a00640 1 -- start start 2024-04-16T13:06:40.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb406f9d0 0x7effb414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4072050 0x7effb4162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effb4163e80 con 0x7effb406f040 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7effb4163ba0 con 0x7effb406f9d0 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.506+0000 7effb8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7effb4072430 con 0x7effb4072050 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43588/0 (socket says 172.21.15.67:43588) 2024-04-16T13:06:40.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 -- 172.21.15.67:0/3349254322 learned_addr learned my addr 172.21.15.67:0/3349254322 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb3200640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4072050 0x7effb4162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effabe00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb406f9d0 0x7effb414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 -- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4072050 msgr2=0x7effb4162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4072050 0x7effb4162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 -- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb406f9d0 msgr2=0x7effb414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb406f9d0 0x7effb414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.507+0000 7effb2800640 1 -- 172.21.15.67:0/3349254322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40af320 con 0x7effb406f040 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effb2800640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7effa400e870 tx=0x7effa400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4017070 con 0x7effb406f040 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa400c940 con 0x7effb406f040 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa400cd30 con 0x7effb406f040 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb414b420 con 0x7effb406f040 2024-04-16T13:06:40.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.508+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb414b9e0 con 0x7effb406f040 2024-04-16T13:06:40.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.510+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4075bd0 con 0x7effb406f040 2024-04-16T13:06:40.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.511+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effa401a070 con 0x7effb406f040 2024-04-16T13:06:40.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.511+0000 7effaaa00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 0x7eff9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.512+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7effa408bbd0 con 0x7effb406f040 2024-04-16T13:06:40.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.512+0000 7effabe00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 0x7eff9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.513+0000 7effabe00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 0x7eff9006ede0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff9c036000 tx=0x7eff9c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.516+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effa4059e50 con 0x7effb406f040 2024-04-16T13:06:40.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.723+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7effb415e3e0 con 0x7eff9006c920 2024-04-16T13:06:40.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.725+0000 7effaaa00640 1 -- 172.21.15.67:0/3349254322 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7effb415e3e0 con 0x7eff9006c920 2024-04-16T13:06:40.726 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 msgr2=0x7eff9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 0x7eff9006ede0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff9c036000 tx=0x7eff9c03b040 comp rx=0 tx=0).stop 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 msgr2=0x7effb40aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7effa400e870 tx=0x7effa400ed30 comp rx=0 tx=0).stop 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 shutdown_connections 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7eff9006c920 0x7eff9006ede0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7effb4072050 0x7effb4162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effb406f9d0 0x7effb414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 --2- 172.21.15.67:0/3349254322 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb406f040 0x7effb40aede0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.727+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 >> 172.21.15.67:0/3349254322 conn(0x7effb4067d90 msgr2=0x7effb40af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.728+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 shutdown_connections 2024-04-16T13:06:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.728+0000 7effb8a00640 1 -- 172.21.15.67:0/3349254322 wait complete. 2024-04-16T13:06:40.749 INFO:tasks.ceph:Scrubbing osd.7 2024-04-16T13:06:40.749 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-16T13:06:40.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.979+0000 7f7aea400640 1 Processor -- start 2024-04-16T13:06:40.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.979+0000 7f7aea400640 1 -- start start 2024-04-16T13:06:40.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.980+0000 7f7aea400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ae413e880 0x7f7ae415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.980+0000 7f7aea400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae41418d0 0x7f7ae40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.980+0000 7f7aea400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae415c290 con 0x7f7ae40b56e0 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.980+0000 7f7aea400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae40b5b50 con 0x7f7ae413e880 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.980+0000 7f7aea400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae415c570 con 0x7f7ae41418d0 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ae413e880 0x7f7ae415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7ae413e880 0x7f7ae415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43598/0 (socket says 172.21.15.67:43598) 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7ae40b56e0 0x7f7ae40c5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:60476/0 (socket says 172.21.15.67:60476) 2024-04-16T13:06:40.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 -- 172.21.15.67:0/47983276 learned_addr learned my addr 172.21.15.67:0/47983276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae2a00640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae41418d0 0x7f7ae40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 -- 172.21.15.67:0/47983276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae41418d0 msgr2=0x7f7ae40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae41418d0 0x7f7ae40b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 -- 172.21.15.67:0/47983276 >> v1:172.21.15.67:6789/0 conn(0x7f7ae40b56e0 legacy=0x7f7ae40c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae3400640 1 -- 172.21.15.67:0/47983276 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae415c850 con 0x7f7ae413e880 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.981+0000 7f7ae2000640 1 -- 172.21.15.67:0/47983276 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459527802 0 0) 0x7f7ae415c290 con 0x7f7ae40b56e0 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.982+0000 7f7ae3400640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae413e880 0x7f7ae415bc60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009870 tx=0x7f7ad402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ad3db652ac0c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.983+0000 7f7ae2000640 1 -- 172.21.15.67:0/47983276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4034070 con 0x7f7ae413e880 2024-04-16T13:06:40.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.983+0000 7f7ae2000640 1 -- 172.21.15.67:0/47983276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad4030840 con 0x7f7ae413e880 2024-04-16T13:06:40.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.983+0000 7f7ae2000640 1 -- 172.21.15.67:0/47983276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4030c10 con 0x7f7ae413e880 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.983+0000 7f7aea400640 1 -- 172.21.15.67:0/47983276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae413e880 msgr2=0x7f7ae415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.983+0000 7f7aea400640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae413e880 0x7f7ae415bc60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009870 tx=0x7f7ad402b980 comp rx=0 tx=0).stop 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 -- 172.21.15.67:0/47983276 shutdown_connections 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae41418d0 0x7f7ae40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 --2- 172.21.15.67:0/47983276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae413e880 0x7f7ae415bc60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 -- 172.21.15.67:0/47983276 >> 172.21.15.67:0/47983276 conn(0x7f7ae4067d90 msgr2=0x7f7ae406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:40.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 -- 172.21.15.67:0/47983276 shutdown_connections 2024-04-16T13:06:40.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.984+0000 7f7aea400640 1 -- 172.21.15.67:0/47983276 wait complete. 2024-04-16T13:06:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.985+0000 7f7aea400640 1 Processor -- start 2024-04-16T13:06:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.986+0000 7f7aea400640 1 -- start start 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae40b56e0 0x7f7ae4139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae413e880 0x7f7ae413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 0x7f7ae413cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4140370 con 0x7f7ae41418d0 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4141d30 con 0x7f7ae40b56e0 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7aea400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae41404f0 con 0x7f7ae413e880 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 0x7f7ae413cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 0x7f7ae413cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43610/0 (socket says 172.21.15.67:43610) 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 -- 172.21.15.67:0/1010458822 learned_addr learned my addr 172.21.15.67:0/1010458822 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae40b56e0 0x7f7ae4139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 -- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae413e880 msgr2=0x7f7ae413c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f7ae413e880 0x7f7ae413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 -- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae40b56e0 msgr2=0x7f7ae4139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae40b56e0 0x7f7ae4139f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.987+0000 7f7ae3e00640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae413a480 con 0x7f7ae41418d0 2024-04-16T13:06:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7ae3e00640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 0x7f7ae413cb60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00c480 tx=0x7f7adc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc018070 con 0x7f7ae41418d0 2024-04-16T13:06:40.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7adc007500 con 0x7f7ae41418d0 2024-04-16T13:06:40.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc004a20 con 0x7f7ae41418d0 2024-04-16T13:06:40.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae4156f50 con 0x7f7ae41418d0 2024-04-16T13:06:40.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.988+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae4157510 con 0x7f7ae41418d0 2024-04-16T13:06:40.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.989+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ae4068a70 con 0x7f7ae41418d0 2024-04-16T13:06:40.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.990+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7adc01b070 con 0x7f7ae41418d0 2024-04-16T13:06:40.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.991+0000 7f7adb400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7ac406c920 0x7f7ac406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.991+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f7adc08afe0 con 0x7f7ae41418d0 2024-04-16T13:06:40.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.991+0000 7f7adb400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f7ac40751f0 0x7f7ac4077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:40.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.992+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ac4077d20 con 0x7f7ac40751f0 2024-04-16T13:06:40.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.992+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7adc08d5e0 con 0x7f7ae41418d0 2024-04-16T13:06:40.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.992+0000 7f7ae3400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7ac406c920 0x7f7ac406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.992+0000 7f7ae2a00640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f7ac40751f0 0x7f7ac4077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:40.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.993+0000 7f7ae3400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7ac406c920 0x7f7ac406ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4036000 tx=0x7f7ad403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.993+0000 7f7ae2a00640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f7ac40751f0 0x7f7ac4077650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:40.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:40.995+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== osd.7 v2:172.21.15.82:6808/43297624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ac4077d20 con 0x7f7ac40751f0 2024-04-16T13:06:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.010+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 --> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ae40c5710 con 0x7f7ac40751f0 2024-04-16T13:06:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.011+0000 7f7adb400640 1 -- 172.21.15.67:0/1010458822 <== osd.7 v2:172.21.15.82:6808/43297624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ae40c5710 con 0x7f7ac40751f0 2024-04-16T13:06:41.012 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-04-16T13:06:41.013 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T13:06:41.013 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f7ac40751f0 msgr2=0x7f7ac4077650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6808/43297624,v1:172.21.15.82:6809/43297624] conn(0x7f7ac40751f0 0x7f7ac4077650 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7ac406c920 msgr2=0x7f7ac406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f7ac406c920 0x7f7ac406ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4036000 tx=0x7f7ad403b040 comp rx=0 tx=0).stop 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 msgr2=0x7f7ae413cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 --2- 172.21.15.67:0/1010458822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ae41418d0 0x7f7ae413cb60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00c480 tx=0x7f7adc00c940 comp rx=0 tx=0).stop 2024-04-16T13:06:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7ae3e00640 1 -- 172.21.15.67:0/1010458822 reap_dead start 2024-04-16T13:06:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 shutdown_connections 2024-04-16T13:06:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 >> 172.21.15.67:0/1010458822 conn(0x7f7ae4067d90 msgr2=0x7f7ae40c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.012+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 shutdown_connections 2024-04-16T13:06:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.013+0000 7f7aea400640 1 -- 172.21.15.67:0/1010458822 wait complete. 2024-04-16T13:06:41.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-16T13:06:41.132 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-04-16T13:06:41.131+0000 7f2ff1e00640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-04-16T13:06:41.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.250+0000 7f77d9200640 1 Processor -- start 2024-04-16T13:06:41.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.251+0000 7f77d9200640 1 -- start start 2024-04-16T13:06:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d9200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d415eca0 0x7f77d40cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d9200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40b7e70 0x7f77d40d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d9200640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d40d04d0 con 0x7f77d40d4270 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d9200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f77d40b6e10 con 0x7f77d415eca0 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d9200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77d40b6200 con 0x7f77d40b7e70 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.252+0000 7f77d3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d415eca0 0x7f77d40cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d415eca0 0x7f77d40cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43620/0 (socket says 172.21.15.67:43620) 2024-04-16T13:06:41.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 -- 172.21.15.67:0/1911093889 learned_addr learned my addr 172.21.15.67:0/1911093889 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:41.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 -- 172.21.15.67:0/1911093889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40b7e70 msgr2=0x7f77d40d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:41.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 --2- 172.21.15.67:0/1911093889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40b7e70 0x7f77d40d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 -- 172.21.15.67:0/1911093889 >> v1:172.21.15.82:6789/0 conn(0x7f77d40d4270 legacy=0x7f77d40d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:41.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.253+0000 7f77d3400640 1 -- 172.21.15.67:0/1911093889 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d40b64e0 con 0x7f77d415eca0 2024-04-16T13:06:41.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.254+0000 7f77d3400640 1 --2- 172.21.15.67:0/1911093889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d40cedd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f77d40b6f90 tx=0x7f77c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2a678be33f4105 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.254+0000 7f77d2a00640 1 -- 172.21.15.67:0/1911093889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4035020 con 0x7f77d415eca0 2024-04-16T13:06:41.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.254+0000 7f77d2a00640 1 -- 172.21.15.67:0/1911093889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c4031640 con 0x7f77d415eca0 2024-04-16T13:06:41.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.254+0000 7f77d2a00640 1 -- 172.21.15.67:0/1911093889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c402d040 con 0x7f77d415eca0 2024-04-16T13:06:41.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 -- 172.21.15.67:0/1911093889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 msgr2=0x7f77d40cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 --2- 172.21.15.67:0/1911093889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d40cedd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f77d40b6f90 tx=0x7f77c402b8f0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 -- 172.21.15.67:0/1911093889 shutdown_connections 2024-04-16T13:06:41.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 --2- 172.21.15.67:0/1911093889 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40b7e70 0x7f77d40d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 --2- 172.21.15.67:0/1911093889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d40cedd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 -- 172.21.15.67:0/1911093889 >> 172.21.15.67:0/1911093889 conn(0x7f77d406ccc0 msgr2=0x7f77d406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 -- 172.21.15.67:0/1911093889 shutdown_connections 2024-04-16T13:06:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.255+0000 7f77d9200640 1 -- 172.21.15.67:0/1911093889 wait complete. 2024-04-16T13:06:41.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.257+0000 7f77d9200640 1 Processor -- start 2024-04-16T13:06:41.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.257+0000 7f77d9200640 1 -- start start 2024-04-16T13:06:41.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d40b7e70 0x7f77d41502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40d4270 0x7f77d415ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f77d415f080 con 0x7f77d415eca0 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77d40b6aa0 con 0x7f77d40b7e70 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d9200640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f77d415f200 con 0x7f77d40d4270 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43636/0 (socket says 172.21.15.67:43636) 2024-04-16T13:06:41.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.258+0000 7f77d3e00640 1 -- 172.21.15.67:0/401044396 learned_addr learned my addr 172.21.15.67:0/401044396 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77cbe00640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40d4270 0x7f77d415ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 -- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40d4270 msgr2=0x7f77d415ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3400640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d40b7e70 0x7f77d41502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40d4270 0x7f77d415ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 -- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d40b7e70 msgr2=0x7f77d41502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d40b7e70 0x7f77d41502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 -- 172.21.15.67:0/401044396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d415d800 con 0x7f77d415eca0 2024-04-16T13:06:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d3e00640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c780 tx=0x7f77cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc017070 con 0x7f77d415eca0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc003da0 con 0x7f77d415eca0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d415dae0 con 0x7f77d415eca0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.259+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0052b0 con 0x7f77d415eca0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.260+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d415b4f0 con 0x7f77d415eca0 2024-04-16T13:06:41.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.261+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d415b020 con 0x7f77d415eca0 2024-04-16T13:06:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.262+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77cc01a070 con 0x7f77d415eca0 2024-04-16T13:06:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.263+0000 7f77cb400640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 0x7f77b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.263+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f77cc08b330 con 0x7f77d415eca0 2024-04-16T13:06:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.264+0000 7f77d3400640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 0x7f77b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.265+0000 7f77d3400640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 0x7f77b006edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77c4036000 tx=0x7f77c403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.267+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77cc059550 con 0x7f77d415eca0 2024-04-16T13:06:41.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.475+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f77d41523a0 con 0x7f77b006c8f0 2024-04-16T13:06:41.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.476+0000 7f77cb400640 1 -- 172.21.15.67:0/401044396 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77c40317a0 con 0x7f77b006c8f0 2024-04-16T13:06:41.477 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 msgr2=0x7f77b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 0x7f77b006edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77c4036000 tx=0x7f77c403c040 comp rx=0 tx=0).stop 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 msgr2=0x7f77d4159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c780 tx=0x7f77cc00cc40 comp rx=0 tx=0).stop 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 shutdown_connections 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f77b006c8f0 0x7f77b006edb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d415eca0 0x7f77d4159870 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f77d40d4270 0x7f77d415ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.478+0000 7f77d9200640 1 --2- 172.21.15.67:0/401044396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77d40b7e70 0x7f77d41502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.479+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 >> 172.21.15.67:0/401044396 conn(0x7f77d406ccc0 msgr2=0x7f77d40d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:41.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.479+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 shutdown_connections 2024-04-16T13:06:41.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.479+0000 7f77d9200640 1 -- 172.21.15.67:0/401044396 wait complete. 2024-04-16T13:06:41.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:06:41.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.722+0000 7f8a71400640 1 Processor -- start 2024-04-16T13:06:41.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.723+0000 7f8a71400640 1 -- start start 2024-04-16T13:06:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.724+0000 7f8a71400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.724+0000 7f8a71400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 0x7f8a6c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.724+0000 7f8a71400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6c0d0000 con 0x7f8a6c06d8a0 2024-04-16T13:06:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.724+0000 7f8a71400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6c06dd10 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.724+0000 7f8a71400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6c0d0c10 con 0x7f8a6c0d5220 2024-04-16T13:06:41.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43644/0 (socket says 172.21.15.67:43644) 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 -- 172.21.15.67:0/2077709548 learned_addr learned my addr 172.21.15.67:0/2077709548 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6b400640 1 --2- 172.21.15.67:0/2077709548 >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 0x7f8a6c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 -- 172.21.15.67:0/2077709548 >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 msgr2=0x7f8a6c06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 --2- 172.21.15.67:0/2077709548 >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 0x7f8a6c06d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 -- 172.21.15.67:0/2077709548 >> v1:172.21.15.67:6789/0 conn(0x7f8a6c06d8a0 legacy=0x7f8a6c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6aa00640 1 -- 172.21.15.67:0/2077709548 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345349102 0 0) 0x7f8a6c0d0000 con 0x7f8a6c06d8a0 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6be00640 1 -- 172.21.15.67:0/2077709548 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c0d02e0 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.725+0000 7f8a6b400640 1 --2- 172.21.15.67:0/2077709548 >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 0x7f8a6c06d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:06:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.727+0000 7f8a6be00640 1 --2- 172.21.15.67:0/2077709548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0b7130 tx=0x7f8a5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dcdfb056516cae server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.727+0000 7f8a6aa00640 1 -- 172.21.15.67:0/2077709548 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c035020 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.727+0000 7f8a6aa00640 1 -- 172.21.15.67:0/2077709548 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c031870 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.727+0000 7f8a6aa00640 1 -- 172.21.15.67:0/2077709548 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c031c40 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 -- 172.21.15.67:0/2077709548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c15eaa0 msgr2=0x7f8a6c0d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 --2- 172.21.15.67:0/2077709548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0b7130 tx=0x7f8a5c02b910 comp rx=0 tx=0).stop 2024-04-16T13:06:41.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 -- 172.21.15.67:0/2077709548 shutdown_connections 2024-04-16T13:06:41.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 --2- 172.21.15.67:0/2077709548 >> v2:172.21.15.82:3300/0 conn(0x7f8a6c0d5220 0x7f8a6c06d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 --2- 172.21.15.67:0/2077709548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c0d4ce0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 -- 172.21.15.67:0/2077709548 >> 172.21.15.67:0/2077709548 conn(0x7f8a6c08c000 msgr2=0x7f8a6c0d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:41.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 -- 172.21.15.67:0/2077709548 shutdown_connections 2024-04-16T13:06:41.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.728+0000 7f8a71400640 1 -- 172.21.15.67:0/2077709548 wait complete. 2024-04-16T13:06:41.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.730+0000 7f8a71400640 1 Processor -- start 2024-04-16T13:06:41.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.730+0000 7f8a71400640 1 -- start start 2024-04-16T13:06:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a6c06d8a0 0x7f8a6c153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c1602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c15ee80 con 0x7f8a6c0d5220 2024-04-16T13:06:41.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c0d08a0 con 0x7f8a6c15eaa0 2024-04-16T13:06:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a71400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c06ceb0 con 0x7f8a6c06d8a0 2024-04-16T13:06:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a6b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a6b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43650/0 (socket says 172.21.15.67:43650) 2024-04-16T13:06:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.731+0000 7f8a6b400640 1 -- 172.21.15.67:0/2236256848 learned_addr learned my addr 172.21.15.67:0/2236256848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:06:41.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 -- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a6c06d8a0 msgr2=0x7f8a6c153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a6c06d8a0 0x7f8a6c153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 -- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6c15eaa0 msgr2=0x7f8a6c1602a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-16T13:06:41.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c1602a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 -- 172.21.15.67:0/2236256848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c1540a0 con 0x7f8a6c0d5220 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a6b400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400cf60 tx=0x7f8a5400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5401a070 con 0x7f8a6c0d5220 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5400d840 con 0x7f8a6c0d5220 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400dc10 con 0x7f8a6c0d5220 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.732+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c1608b0 con 0x7f8a6c0d5220 2024-04-16T13:06:41.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.733+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c160e70 con 0x7f8a6c0d5220 2024-04-16T13:06:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.734+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6c075bd0 con 0x7f8a6c0d5220 2024-04-16T13:06:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.735+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a5401d070 con 0x7f8a6c0d5220 2024-04-16T13:06:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.736+0000 7f8a63e00640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:06:41.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.736+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f8a5408c540 con 0x7f8a6c0d5220 2024-04-16T13:06:41.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.736+0000 7f8a6be00640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:06:41.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.738+0000 7f8a6be00640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 0x7f8a4806edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:06:41.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.741+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a6c1540a0 con 0x7f8a6c0d5220 2024-04-16T13:06:41.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.949+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a6c15c250 con 0x7f8a4806c8f0 2024-04-16T13:06:41.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.967+0000 7f8a63e00640 1 -- 172.21.15.67:0/2236256848 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250090 (secure 0 0 0) 0x7f8a6c15c250 con 0x7f8a4806c8f0 2024-04-16T13:06:41.972 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:06:41.973 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 msgr2=0x7f8a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 0x7f8a4806edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c036000 tx=0x7f8a5c030000 comp rx=0 tx=0).stop 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 msgr2=0x7f8a6c15fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400cf60 tx=0x7f8a5400cf90 comp rx=0 tx=0).stop 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 shutdown_connections 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6c15eaa0 0x7f8a6c1602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a6c0d5220 0x7f8a6c15fd60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 --2- 172.21.15.67:0/2236256848 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f8a6c06d8a0 0x7f8a6c153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:06:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 >> 172.21.15.67:0/2236256848 conn(0x7f8a6c08c000 msgr2=0x7f8a6c0d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:06:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 shutdown_connections 2024-04-16T13:06:41.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:06:41.972+0000 7f8a71400640 1 -- 172.21.15.67:0/2236256848 wait complete. 2024-04-16T13:06:41.992 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-04-16T13:06:41.127333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221088,"kb_used_data":4936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5054464,"data_stored":2864388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.593534"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607785+0000","last_change":"2024-04-16T13:06:24.314972+0000","last_active":"2024-04-16T13:06:28.607785+0000","last_peered":"2024-04-16T13:06:28.607785+0000","last_clean":"2024-04-16T13:06:28.607785+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:28.607785+0000","last_undegraded":"2024-04-16T13:06:28.607785+0000","last_fullsized":"2024-04-16T13:06:28.607785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607459+0000","last_change":"2024-04-16T13:06:24.311104+0000","last_active":"2024-04-16T13:06:28.607459+0000","last_peered":"2024-04-16T13:06:28.607459+0000","last_clean":"2024-04-16T13:06:28.607459+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:28.607459+0000","last_undegraded":"2024-04-16T13:06:28.607459+0000","last_fullsized":"2024-04-16T13:06:28.607459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332063+0000","last_change":"2024-04-16T13:06:24.311132+0000","last_active":"2024-04-16T13:06:28.332063+0000","last_peered":"2024-04-16T13:06:28.332063+0000","last_clean":"2024-04-16T13:06:28.332063+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:28.332063+0000","last_undegraded":"2024-04-16T13:06:28.332063+0000","last_fullsized":"2024-04-16T13:06:28.332063+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.568740+0000","last_change":"2024-04-16T13:06:24.319270+0000","last_active":"2024-04-16T13:06:30.568740+0000","last_peered":"2024-04-16T13:06:30.568740+0000","last_clean":"2024-04-16T13:06:30.568740+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:30.568740+0000","last_undegraded":"2024-04-16T13:06:30.568740+0000","last_fullsized":"2024-04-16T13:06:30.568740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.568396+0000","last_change":"2024-04-16T13:06:24.321280+0000","last_active":"2024-04-16T13:06:30.568396+0000","last_peered":"2024-04-16T13:06:30.568396+0000","last_clean":"2024-04-16T13:06:30.568396+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:30.568396+0000","last_undegraded":"2024-04-16T13:06:30.568396+0000","last_fullsized":"2024-04-16T13:06:30.568396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324488+0000","last_change":"2024-04-16T13:06:24.312123+0000","last_active":"2024-04-16T13:06:28.324488+0000","last_peered":"2024-04-16T13:06:28.324488+0000","last_clean":"2024-04-16T13:06:28.324488+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:28.324488+0000","last_undegraded":"2024-04-16T13:06:28.324488+0000","last_fullsized":"2024-04-16T13:06:28.324488+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327163+0000","last_change":"2024-04-16T13:06:24.312018+0000","last_active":"2024-04-16T13:06:28.327163+0000","last_peered":"2024-04-16T13:06:28.327163+0000","last_clean":"2024-04-16T13:06:28.327163+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:28.327163+0000","last_undegraded":"2024-04-16T13:06:28.327163+0000","last_fullsized":"2024-04-16T13:06:28.327163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606698+0000","last_change":"2024-04-16T13:06:24.323584+0000","last_active":"2024-04-16T13:06:28.606698+0000","last_peered":"2024-04-16T13:06:28.606698+0000","last_clean":"2024-04-16T13:06:28.606698+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:28.606698+0000","last_undegraded":"2024-04-16T13:06:28.606698+0000","last_fullsized":"2024-04-16T13:06:28.606698+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332040+0000","last_change":"2024-04-16T13:06:24.313635+0000","last_active":"2024-04-16T13:06:28.332040+0000","last_peered":"2024-04-16T13:06:28.332040+0000","last_clean":"2024-04-16T13:06:28.332040+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:28.332040+0000","last_undegraded":"2024-04-16T13:06:28.332040+0000","last_fullsized":"2024-04-16T13:06:28.332040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329152+0000","last_change":"2024-04-16T13:06:24.295106+0000","last_active":"2024-04-16T13:06:28.329152+0000","last_peered":"2024-04-16T13:06:28.329152+0000","last_clean":"2024-04-16T13:06:28.329152+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:28.329152+0000","last_undegraded":"2024-04-16T13:06:28.329152+0000","last_fullsized":"2024-04-16T13:06:28.329152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328808+0000","last_change":"2024-04-16T13:06:24.322086+0000","last_active":"2024-04-16T13:06:28.328808+0000","last_peered":"2024-04-16T13:06:28.328808+0000","last_clean":"2024-04-16T13:06:28.328808+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:28.328808+0000","last_undegraded":"2024-04-16T13:06:28.328808+0000","last_fullsized":"2024-04-16T13:06:28.328808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:07.717593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332481+0000","last_change":"2024-04-16T13:06:24.305245+0000","last_active":"2024-04-16T13:06:28.332481+0000","last_peered":"2024-04-16T13:06:28.332481+0000","last_clean":"2024-04-16T13:06:28.332481+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:28.332481+0000","last_undegraded":"2024-04-16T13:06:28.332481+0000","last_fullsized":"2024-04-16T13:06:28.332481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328023+0000","last_change":"2024-04-16T13:06:24.307536+0000","last_active":"2024-04-16T13:06:28.328023+0000","last_peered":"2024-04-16T13:06:28.328023+0000","last_clean":"2024-04-16T13:06:28.328023+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:28.328023+0000","last_undegraded":"2024-04-16T13:06:28.328023+0000","last_fullsized":"2024-04-16T13:06:28.328023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:04.671108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569399+0000","last_change":"2024-04-16T13:06:24.329602+0000","last_active":"2024-04-16T13:06:30.569399+0000","last_peered":"2024-04-16T13:06:30.569399+0000","last_clean":"2024-04-16T13:06:30.569399+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:30.569399+0000","last_undegraded":"2024-04-16T13:06:30.569399+0000","last_fullsized":"2024-04-16T13:06:30.569399+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327377+0000","last_change":"2024-04-16T13:06:24.302977+0000","last_active":"2024-04-16T13:06:28.327377+0000","last_peered":"2024-04-16T13:06:28.327377+0000","last_clean":"2024-04-16T13:06:28.327377+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:28.327377+0000","last_undegraded":"2024-04-16T13:06:28.327377+0000","last_fullsized":"2024-04-16T13:06:28.327377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329786+0000","last_change":"2024-04-16T13:06:24.294080+0000","last_active":"2024-04-16T13:06:28.329786+0000","last_peered":"2024-04-16T13:06:28.329786+0000","last_clean":"2024-04-16T13:06:28.329786+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:28.329786+0000","last_undegraded":"2024-04-16T13:06:28.329786+0000","last_fullsized":"2024-04-16T13:06:28.329786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:35:47.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331058+0000","last_change":"2024-04-16T13:06:24.302298+0000","last_active":"2024-04-16T13:06:28.331058+0000","last_peered":"2024-04-16T13:06:28.331058+0000","last_clean":"2024-04-16T13:06:28.331058+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:28.331058+0000","last_undegraded":"2024-04-16T13:06:28.331058+0000","last_fullsized":"2024-04-16T13:06:28.331058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:31:06.732378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740260+0000","last_change":"2024-04-16T13:06:24.326699+0000","last_active":"2024-04-16T13:06:28.740260+0000","last_peered":"2024-04-16T13:06:28.740260+0000","last_clean":"2024-04-16T13:06:28.740260+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:28.740260+0000","last_undegraded":"2024-04-16T13:06:28.740260+0000","last_fullsized":"2024-04-16T13:06:28.740260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:11.332995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569078+0000","last_change":"2024-04-16T13:06:24.300564+0000","last_active":"2024-04-16T13:06:30.569078+0000","last_peered":"2024-04-16T13:06:30.569078+0000","last_clean":"2024-04-16T13:06:30.569078+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:30.569078+0000","last_undegraded":"2024-04-16T13:06:30.569078+0000","last_fullsized":"2024-04-16T13:06:30.569078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739999+0000","last_change":"2024-04-16T13:06:24.328277+0000","last_active":"2024-04-16T13:06:28.739999+0000","last_peered":"2024-04-16T13:06:28.739999+0000","last_clean":"2024-04-16T13:06:28.739999+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:28.739999+0000","last_undegraded":"2024-04-16T13:06:28.739999+0000","last_fullsized":"2024-04-16T13:06:28.739999+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:12.879378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328029+0000","last_change":"2024-04-16T13:06:24.303254+0000","last_active":"2024-04-16T13:06:28.328029+0000","last_peered":"2024-04-16T13:06:28.328029+0000","last_clean":"2024-04-16T13:06:28.328029+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:28.328029+0000","last_undegraded":"2024-04-16T13:06:28.328029+0000","last_fullsized":"2024-04-16T13:06:28.328029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:16.577880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569771+0000","last_change":"2024-04-16T13:06:24.329875+0000","last_active":"2024-04-16T13:06:30.569771+0000","last_peered":"2024-04-16T13:06:30.569771+0000","last_clean":"2024-04-16T13:06:30.569771+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:30.569771+0000","last_undegraded":"2024-04-16T13:06:30.569771+0000","last_fullsized":"2024-04-16T13:06:30.569771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330022+0000","last_change":"2024-04-16T13:06:24.293398+0000","last_active":"2024-04-16T13:06:28.330022+0000","last_peered":"2024-04-16T13:06:28.330022+0000","last_clean":"2024-04-16T13:06:28.330022+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:28.330022+0000","last_undegraded":"2024-04-16T13:06:28.330022+0000","last_fullsized":"2024-04-16T13:06:28.330022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:34:14.327446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.568479+0000","last_change":"2024-04-16T13:06:24.294484+0000","last_active":"2024-04-16T13:06:30.568479+0000","last_peered":"2024-04-16T13:06:30.568479+0000","last_clean":"2024-04-16T13:06:30.568479+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:30.568479+0000","last_undegraded":"2024-04-16T13:06:30.568479+0000","last_fullsized":"2024-04-16T13:06:30.568479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740428+0000","last_change":"2024-04-16T13:06:24.312726+0000","last_active":"2024-04-16T13:06:28.740428+0000","last_peered":"2024-04-16T13:06:28.740428+0000","last_clean":"2024-04-16T13:06:28.740428+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:28.740428+0000","last_undegraded":"2024-04-16T13:06:28.740428+0000","last_fullsized":"2024-04-16T13:06:28.740428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:01:17.612550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324926+0000","last_change":"2024-04-16T13:06:24.300601+0000","last_active":"2024-04-16T13:06:28.324926+0000","last_peered":"2024-04-16T13:06:28.324926+0000","last_clean":"2024-04-16T13:06:28.324926+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:28.324926+0000","last_undegraded":"2024-04-16T13:06:28.324926+0000","last_fullsized":"2024-04-16T13:06:28.324926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740255+0000","last_change":"2024-04-16T13:06:24.311699+0000","last_active":"2024-04-16T13:06:28.740255+0000","last_peered":"2024-04-16T13:06:28.740255+0000","last_clean":"2024-04-16T13:06:28.740255+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:28.740255+0000","last_undegraded":"2024-04-16T13:06:28.740255+0000","last_fullsized":"2024-04-16T13:06:28.740255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:59.011752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:29.565287+0000","last_change":"2024-04-16T13:06:28.609312+0000","last_active":"2024-04-16T13:06:29.565287+0000","last_peered":"2024-04-16T13:06:29.565287+0000","last_clean":"2024-04-16T13:06:29.565287+0000","last_became_active":"2024-04-16T13:06:28.608582+0000","last_became_peered":"2024-04-16T13:06:28.608582+0000","last_unstale":"2024-04-16T13:06:29.565287+0000","last_undegraded":"2024-04-16T13:06:29.565287+0000","last_fullsized":"2024-04-16T13:06:29.565287+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739857+0000","last_change":"2024-04-16T13:06:24.316508+0000","last_active":"2024-04-16T13:06:28.739857+0000","last_peered":"2024-04-16T13:06:28.739857+0000","last_clean":"2024-04-16T13:06:28.739857+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:28.739857+0000","last_undegraded":"2024-04-16T13:06:28.739857+0000","last_fullsized":"2024-04-16T13:06:28.739857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:42.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739833+0000","last_change":"2024-04-16T13:06:24.320609+0000","last_active":"2024-04-16T13:06:28.739833+0000","last_peered":"2024-04-16T13:06:28.739833+0000","last_clean":"2024-04-16T13:06:28.739833+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:28.739833+0000","last_undegraded":"2024-04-16T13:06:28.739833+0000","last_fullsized":"2024-04-16T13:06:28.739833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:13.025544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330245+0000","last_change":"2024-04-16T13:06:24.291308+0000","last_active":"2024-04-16T13:06:28.330245+0000","last_peered":"2024-04-16T13:06:28.330245+0000","last_clean":"2024-04-16T13:06:28.330245+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:28.330245+0000","last_undegraded":"2024-04-16T13:06:28.330245+0000","last_fullsized":"2024-04-16T13:06:28.330245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324702+0000","last_change":"2024-04-16T13:06:24.296075+0000","last_active":"2024-04-16T13:06:28.324702+0000","last_peered":"2024-04-16T13:06:28.324702+0000","last_clean":"2024-04-16T13:06:28.324702+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:28.324702+0000","last_undegraded":"2024-04-16T13:06:28.324702+0000","last_fullsized":"2024-04-16T13:06:28.324702+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330380+0000","last_change":"2024-04-16T13:06:24.298898+0000","last_active":"2024-04-16T13:06:28.330380+0000","last_peered":"2024-04-16T13:06:28.330380+0000","last_clean":"2024-04-16T13:06:28.330380+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:28.330380+0000","last_undegraded":"2024-04-16T13:06:28.330380+0000","last_fullsized":"2024-04-16T13:06:28.330380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:10.418319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.740417+0000","last_change":"2024-04-16T13:06:23.278352+0000","last_active":"2024-04-16T13:06:28.740417+0000","last_peered":"2024-04-16T13:06:28.740417+0000","last_clean":"2024-04-16T13:06:28.740417+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:28.740417+0000","last_undegraded":"2024-04-16T13:06:28.740417+0000","last_fullsized":"2024-04-16T13:06:28.740417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.271704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325070+0000","last_change":"2024-04-16T13:06:24.300596+0000","last_active":"2024-04-16T13:06:28.325070+0000","last_peered":"2024-04-16T13:06:28.325070+0000","last_clean":"2024-04-16T13:06:28.325070+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:28.325070+0000","last_undegraded":"2024-04-16T13:06:28.325070+0000","last_fullsized":"2024-04-16T13:06:28.325070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:38.170699+0000","last_change":"2024-04-16T13:06:38.170758+0000","last_active":"2024-04-16T13:06:38.170699+0000","last_peered":"2024-04-16T13:06:38.170699+0000","last_clean":"2024-04-16T13:06:38.170699+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:38.170699+0000","last_undegraded":"2024-04-16T13:06:38.170699+0000","last_fullsized":"2024-04-16T13:06:38.170699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T13:06:38.170499+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T13:06:38.170499+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.170499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:22.657767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.570256+0000","last_change":"2024-04-16T13:06:24.326263+0000","last_active":"2024-04-16T13:06:30.570256+0000","last_peered":"2024-04-16T13:06:30.570256+0000","last_clean":"2024-04-16T13:06:30.570256+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:30.570256+0000","last_undegraded":"2024-04-16T13:06:30.570256+0000","last_fullsized":"2024-04-16T13:06:30.570256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:38.853671+0000","last_change":"2024-04-16T13:06:38.853882+0000","last_active":"2024-04-16T13:06:38.853671+0000","last_peered":"2024-04-16T13:06:38.853671+0000","last_clean":"2024-04-16T13:06:38.853671+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:38.853671+0000","last_undegraded":"2024-04-16T13:06:38.853671+0000","last_fullsized":"2024-04-16T13:06:38.853671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:38.853390+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:38.853390+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.853390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:32.200944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607574+0000","last_change":"2024-04-16T13:06:24.316867+0000","last_active":"2024-04-16T13:06:28.607574+0000","last_peered":"2024-04-16T13:06:28.607574+0000","last_clean":"2024-04-16T13:06:28.607574+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:28.607574+0000","last_undegraded":"2024-04-16T13:06:28.607574+0000","last_fullsized":"2024-04-16T13:06:28.607574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.570306+0000","last_change":"2024-04-16T13:06:23.273158+0000","last_active":"2024-04-16T13:06:30.570306+0000","last_peered":"2024-04-16T13:06:30.570306+0000","last_clean":"2024-04-16T13:06:30.570306+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:30.570306+0000","last_undegraded":"2024-04-16T13:06:30.570306+0000","last_fullsized":"2024-04-16T13:06:30.570306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331501+0000","last_change":"2024-04-16T13:06:24.304643+0000","last_active":"2024-04-16T13:06:28.331501+0000","last_peered":"2024-04-16T13:06:28.331501+0000","last_clean":"2024-04-16T13:06:28.331501+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:28.331501+0000","last_undegraded":"2024-04-16T13:06:28.331501+0000","last_fullsized":"2024-04-16T13:06:28.331501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328319+0000","last_change":"2024-04-16T13:06:23.268041+0000","last_active":"2024-04-16T13:06:28.328319+0000","last_peered":"2024-04-16T13:06:28.328319+0000","last_clean":"2024-04-16T13:06:28.328319+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:28.328319+0000","last_undegraded":"2024-04-16T13:06:28.328319+0000","last_fullsized":"2024-04-16T13:06:28.328319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327481+0000","last_change":"2024-04-16T13:06:24.302292+0000","last_active":"2024-04-16T13:06:28.327481+0000","last_peered":"2024-04-16T13:06:28.327481+0000","last_clean":"2024-04-16T13:06:28.327481+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:28.327481+0000","last_undegraded":"2024-04-16T13:06:28.327481+0000","last_fullsized":"2024-04-16T13:06:28.327481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:21:49.571417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330643+0000","last_change":"2024-04-16T13:06:23.281444+0000","last_active":"2024-04-16T13:06:28.330643+0000","last_peered":"2024-04-16T13:06:28.330643+0000","last_clean":"2024-04-16T13:06:28.330643+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:28.330643+0000","last_undegraded":"2024-04-16T13:06:28.330643+0000","last_fullsized":"2024-04-16T13:06:28.330643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:52.383410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569950+0000","last_change":"2024-04-16T13:06:24.319076+0000","last_active":"2024-04-16T13:06:30.569950+0000","last_peered":"2024-04-16T13:06:30.569950+0000","last_clean":"2024-04-16T13:06:30.569950+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:30.569950+0000","last_undegraded":"2024-04-16T13:06:30.569950+0000","last_fullsized":"2024-04-16T13:06:30.569950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:37.861136+0000","last_change":"2024-04-16T13:06:37.861162+0000","last_active":"2024-04-16T13:06:37.861136+0000","last_peered":"2024-04-16T13:06:37.861136+0000","last_clean":"2024-04-16T13:06:37.861136+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:37.861136+0000","last_undegraded":"2024-04-16T13:06:37.861136+0000","last_fullsized":"2024-04-16T13:06:37.861136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.861053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.861053+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.861053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:53.364809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606940+0000","last_change":"2024-04-16T13:06:24.319004+0000","last_active":"2024-04-16T13:06:28.606940+0000","last_peered":"2024-04-16T13:06:28.606940+0000","last_clean":"2024-04-16T13:06:28.606940+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:28.606940+0000","last_undegraded":"2024-04-16T13:06:28.606940+0000","last_fullsized":"2024-04-16T13:06:28.606940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569365+0000","last_change":"2024-04-16T13:06:23.275350+0000","last_active":"2024-04-16T13:06:30.569365+0000","last_peered":"2024-04-16T13:06:30.569365+0000","last_clean":"2024-04-16T13:06:30.569365+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:30.569365+0000","last_undegraded":"2024-04-16T13:06:30.569365+0000","last_fullsized":"2024-04-16T13:06:30.569365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.568896+0000","last_change":"2024-04-16T13:06:24.321779+0000","last_active":"2024-04-16T13:06:30.568896+0000","last_peered":"2024-04-16T13:06:30.568896+0000","last_clean":"2024-04-16T13:06:30.568896+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:30.568896+0000","last_undegraded":"2024-04-16T13:06:30.568896+0000","last_fullsized":"2024-04-16T13:06:30.568896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607825+0000","last_change":"2024-04-16T13:06:23.262163+0000","last_active":"2024-04-16T13:06:28.607825+0000","last_peered":"2024-04-16T13:06:28.607825+0000","last_clean":"2024-04-16T13:06:28.607825+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:28.607825+0000","last_undegraded":"2024-04-16T13:06:28.607825+0000","last_fullsized":"2024-04-16T13:06:28.607825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330721+0000","last_change":"2024-04-16T13:06:24.307006+0000","last_active":"2024-04-16T13:06:28.330721+0000","last_peered":"2024-04-16T13:06:28.330721+0000","last_clean":"2024-04-16T13:06:28.330721+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:28.330721+0000","last_undegraded":"2024-04-16T13:06:28.330721+0000","last_fullsized":"2024-04-16T13:06:28.330721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:38.734080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329445+0000","last_change":"2024-04-16T13:06:23.275442+0000","last_active":"2024-04-16T13:06:28.329445+0000","last_peered":"2024-04-16T13:06:28.329445+0000","last_clean":"2024-04-16T13:06:28.329445+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:28.329445+0000","last_undegraded":"2024-04-16T13:06:28.329445+0000","last_fullsized":"2024-04-16T13:06:28.329445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:52:41.927614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.332034+0000","last_change":"2024-04-16T13:06:24.309566+0000","last_active":"2024-04-16T13:06:28.332034+0000","last_peered":"2024-04-16T13:06:28.332034+0000","last_clean":"2024-04-16T13:06:28.332034+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:28.332034+0000","last_undegraded":"2024-04-16T13:06:28.332034+0000","last_fullsized":"2024-04-16T13:06:28.332034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328786+0000","last_change":"2024-04-16T13:06:23.268336+0000","last_active":"2024-04-16T13:06:28.328786+0000","last_peered":"2024-04-16T13:06:28.328786+0000","last_clean":"2024-04-16T13:06:28.328786+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:28.328786+0000","last_undegraded":"2024-04-16T13:06:28.328786+0000","last_fullsized":"2024-04-16T13:06:28.328786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:11:58.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.570172+0000","last_change":"2024-04-16T13:06:24.326157+0000","last_active":"2024-04-16T13:06:30.570172+0000","last_peered":"2024-04-16T13:06:30.570172+0000","last_clean":"2024-04-16T13:06:30.570172+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:30.570172+0000","last_undegraded":"2024-04-16T13:06:30.570172+0000","last_fullsized":"2024-04-16T13:06:30.570172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607510+0000","last_change":"2024-04-16T13:06:23.272696+0000","last_active":"2024-04-16T13:06:28.607510+0000","last_peered":"2024-04-16T13:06:28.607510+0000","last_clean":"2024-04-16T13:06:28.607510+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:28.607510+0000","last_undegraded":"2024-04-16T13:06:28.607510+0000","last_fullsized":"2024-04-16T13:06:28.607510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331740+0000","last_change":"2024-04-16T13:06:24.312224+0000","last_active":"2024-04-16T13:06:28.331740+0000","last_peered":"2024-04-16T13:06:28.331740+0000","last_clean":"2024-04-16T13:06:28.331740+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:28.331740+0000","last_undegraded":"2024-04-16T13:06:28.331740+0000","last_fullsized":"2024-04-16T13:06:28.331740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607176+0000","last_change":"2024-04-16T13:06:23.267013+0000","last_active":"2024-04-16T13:06:28.607176+0000","last_peered":"2024-04-16T13:06:28.607176+0000","last_clean":"2024-04-16T13:06:28.607176+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:28.607176+0000","last_undegraded":"2024-04-16T13:06:28.607176+0000","last_fullsized":"2024-04-16T13:06:28.607176+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.606815+0000","last_change":"2024-04-16T13:06:24.325788+0000","last_active":"2024-04-16T13:06:28.606815+0000","last_peered":"2024-04-16T13:06:28.606815+0000","last_clean":"2024-04-16T13:06:28.606815+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:28.606815+0000","last_undegraded":"2024-04-16T13:06:28.606815+0000","last_fullsized":"2024-04-16T13:06:28.606815+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324595+0000","last_change":"2024-04-16T13:06:23.277307+0000","last_active":"2024-04-16T13:06:28.324595+0000","last_peered":"2024-04-16T13:06:28.324595+0000","last_clean":"2024-04-16T13:06:28.324595+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:28.324595+0000","last_undegraded":"2024-04-16T13:06:28.324595+0000","last_fullsized":"2024-04-16T13:06:28.324595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330536+0000","last_change":"2024-04-16T13:06:24.295492+0000","last_active":"2024-04-16T13:06:28.330536+0000","last_peered":"2024-04-16T13:06:28.330536+0000","last_clean":"2024-04-16T13:06:28.330536+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:28.330536+0000","last_undegraded":"2024-04-16T13:06:28.330536+0000","last_fullsized":"2024-04-16T13:06:28.330536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:31.707482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739722+0000","last_change":"2024-04-16T13:06:23.270808+0000","last_active":"2024-04-16T13:06:28.739722+0000","last_peered":"2024-04-16T13:06:28.739722+0000","last_clean":"2024-04-16T13:06:28.739722+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:28.739722+0000","last_undegraded":"2024-04-16T13:06:28.739722+0000","last_fullsized":"2024-04-16T13:06:28.739722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:00.069018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607048+0000","last_change":"2024-04-16T13:06:24.315501+0000","last_active":"2024-04-16T13:06:28.607048+0000","last_peered":"2024-04-16T13:06:28.607048+0000","last_clean":"2024-04-16T13:06:28.607048+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:28.607048+0000","last_undegraded":"2024-04-16T13:06:28.607048+0000","last_fullsized":"2024-04-16T13:06:28.607048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329993+0000","last_change":"2024-04-16T13:06:23.281787+0000","last_active":"2024-04-16T13:06:28.329993+0000","last_peered":"2024-04-16T13:06:28.329993+0000","last_clean":"2024-04-16T13:06:28.329993+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:28.329993+0000","last_undegraded":"2024-04-16T13:06:28.329993+0000","last_fullsized":"2024-04-16T13:06:28.329993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:49.738113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607330+0000","last_change":"2024-04-16T13:06:24.317363+0000","last_active":"2024-04-16T13:06:28.607330+0000","last_peered":"2024-04-16T13:06:28.607330+0000","last_clean":"2024-04-16T13:06:28.607330+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:28.607330+0000","last_undegraded":"2024-04-16T13:06:28.607330+0000","last_fullsized":"2024-04-16T13:06:28.607330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328876+0000","last_change":"2024-04-16T13:06:23.280101+0000","last_active":"2024-04-16T13:06:28.328876+0000","last_peered":"2024-04-16T13:06:28.328876+0000","last_clean":"2024-04-16T13:06:28.328876+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:28.328876+0000","last_undegraded":"2024-04-16T13:06:28.328876+0000","last_fullsized":"2024-04-16T13:06:28.328876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:44:11.874252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328495+0000","last_change":"2024-04-16T13:06:24.303943+0000","last_active":"2024-04-16T13:06:28.328495+0000","last_peered":"2024-04-16T13:06:28.328495+0000","last_clean":"2024-04-16T13:06:28.328495+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:28.328495+0000","last_undegraded":"2024-04-16T13:06:28.328495+0000","last_fullsized":"2024-04-16T13:06:28.328495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:45:23.535263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.570407+0000","last_change":"2024-04-16T13:06:23.278987+0000","last_active":"2024-04-16T13:06:30.570407+0000","last_peered":"2024-04-16T13:06:30.570407+0000","last_clean":"2024-04-16T13:06:30.570407+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:30.570407+0000","last_undegraded":"2024-04-16T13:06:30.570407+0000","last_fullsized":"2024-04-16T13:06:30.570407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.570272+0000","last_change":"2024-04-16T13:06:24.332108+0000","last_active":"2024-04-16T13:06:30.570272+0000","last_peered":"2024-04-16T13:06:30.570272+0000","last_clean":"2024-04-16T13:06:30.570272+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:30.570272+0000","last_undegraded":"2024-04-16T13:06:30.570272+0000","last_fullsized":"2024-04-16T13:06:30.570272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569182+0000","last_change":"2024-04-16T13:06:23.272619+0000","last_active":"2024-04-16T13:06:30.569182+0000","last_peered":"2024-04-16T13:06:30.569182+0000","last_clean":"2024-04-16T13:06:30.569182+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:30.569182+0000","last_undegraded":"2024-04-16T13:06:30.569182+0000","last_fullsized":"2024-04-16T13:06:30.569182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569459+0000","last_change":"2024-04-16T13:06:24.315533+0000","last_active":"2024-04-16T13:06:30.569459+0000","last_peered":"2024-04-16T13:06:30.569459+0000","last_clean":"2024-04-16T13:06:30.569459+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:30.569459+0000","last_undegraded":"2024-04-16T13:06:30.569459+0000","last_fullsized":"2024-04-16T13:06:30.569459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325048+0000","last_change":"2024-04-16T13:06:23.278008+0000","last_active":"2024-04-16T13:06:28.325048+0000","last_peered":"2024-04-16T13:06:28.325048+0000","last_clean":"2024-04-16T13:06:28.325048+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:28.325048+0000","last_undegraded":"2024-04-16T13:06:28.325048+0000","last_fullsized":"2024-04-16T13:06:28.325048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330039+0000","last_change":"2024-04-16T13:06:24.299173+0000","last_active":"2024-04-16T13:06:28.330039+0000","last_peered":"2024-04-16T13:06:28.330039+0000","last_clean":"2024-04-16T13:06:28.330039+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:28.330039+0000","last_undegraded":"2024-04-16T13:06:28.330039+0000","last_fullsized":"2024-04-16T13:06:28.330039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:41:54.087648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:38.870439+0000","last_change":"2024-04-16T13:06:38.870471+0000","last_active":"2024-04-16T13:06:38.870439+0000","last_peered":"2024-04-16T13:06:38.870439+0000","last_clean":"2024-04-16T13:06:38.870439+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:38.870439+0000","last_undegraded":"2024-04-16T13:06:38.870439+0000","last_fullsized":"2024-04-16T13:06:38.870439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:38.870316+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:38.870316+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.870316+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:43.901366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331840+0000","last_change":"2024-04-16T13:06:24.311883+0000","last_active":"2024-04-16T13:06:28.331840+0000","last_peered":"2024-04-16T13:06:28.331840+0000","last_clean":"2024-04-16T13:06:28.331840+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:28.331840+0000","last_undegraded":"2024-04-16T13:06:28.331840+0000","last_fullsized":"2024-04-16T13:06:28.331840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.568740+0000","last_change":"2024-04-16T13:06:23.273174+0000","last_active":"2024-04-16T13:06:30.568740+0000","last_peered":"2024-04-16T13:06:30.568740+0000","last_clean":"2024-04-16T13:06:30.568740+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:30.568740+0000","last_undegraded":"2024-04-16T13:06:30.568740+0000","last_fullsized":"2024-04-16T13:06:30.568740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.327885+0000","last_change":"2024-04-16T13:06:24.312477+0000","last_active":"2024-04-16T13:06:28.327885+0000","last_peered":"2024-04-16T13:06:28.327885+0000","last_clean":"2024-04-16T13:06:28.327885+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:28.327885+0000","last_undegraded":"2024-04-16T13:06:28.327885+0000","last_fullsized":"2024-04-16T13:06:28.327885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:30.807077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330334+0000","last_change":"2024-04-16T13:06:23.279379+0000","last_active":"2024-04-16T13:06:28.330334+0000","last_peered":"2024-04-16T13:06:28.330334+0000","last_clean":"2024-04-16T13:06:28.330334+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:28.330334+0000","last_undegraded":"2024-04-16T13:06:28.330334+0000","last_fullsized":"2024-04-16T13:06:28.330334+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:01:17.186486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607148+0000","last_change":"2024-04-16T13:06:24.315943+0000","last_active":"2024-04-16T13:06:28.607148+0000","last_peered":"2024-04-16T13:06:28.607148+0000","last_clean":"2024-04-16T13:06:28.607148+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:28.607148+0000","last_undegraded":"2024-04-16T13:06:28.607148+0000","last_fullsized":"2024-04-16T13:06:28.607148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:37.840021+0000","last_change":"2024-04-16T13:06:37.840055+0000","last_active":"2024-04-16T13:06:37.840021+0000","last_peered":"2024-04-16T13:06:37.840021+0000","last_clean":"2024-04-16T13:06:37.840021+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:37.840021+0000","last_undegraded":"2024-04-16T13:06:37.840021+0000","last_fullsized":"2024-04-16T13:06:37.840021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.839933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.839933+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.839933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:13.621360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.325030+0000","last_change":"2024-04-16T13:06:24.298879+0000","last_active":"2024-04-16T13:06:28.325030+0000","last_peered":"2024-04-16T13:06:28.325030+0000","last_clean":"2024-04-16T13:06:28.325030+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:28.325030+0000","last_undegraded":"2024-04-16T13:06:28.325030+0000","last_fullsized":"2024-04-16T13:06:28.325030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.329035+0000","last_change":"2024-04-16T13:06:23.267190+0000","last_active":"2024-04-16T13:06:28.329035+0000","last_peered":"2024-04-16T13:06:28.329035+0000","last_clean":"2024-04-16T13:06:28.329035+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:28.329035+0000","last_undegraded":"2024-04-16T13:06:28.329035+0000","last_fullsized":"2024-04-16T13:06:28.329035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:54:10.327869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330966+0000","last_change":"2024-04-16T13:06:24.306218+0000","last_active":"2024-04-16T13:06:28.330966+0000","last_peered":"2024-04-16T13:06:28.330966+0000","last_clean":"2024-04-16T13:06:28.330966+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:28.330966+0000","last_undegraded":"2024-04-16T13:06:28.330966+0000","last_fullsized":"2024-04-16T13:06:28.330966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569340+0000","last_change":"2024-04-16T13:06:23.270407+0000","last_active":"2024-04-16T13:06:30.569340+0000","last_peered":"2024-04-16T13:06:30.569340+0000","last_clean":"2024-04-16T13:06:30.569340+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:30.569340+0000","last_undegraded":"2024-04-16T13:06:30.569340+0000","last_fullsized":"2024-04-16T13:06:30.569340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.607752+0000","last_change":"2024-04-16T13:06:24.322280+0000","last_active":"2024-04-16T13:06:28.607752+0000","last_peered":"2024-04-16T13:06:28.607752+0000","last_clean":"2024-04-16T13:06:28.607752+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:28.607752+0000","last_undegraded":"2024-04-16T13:06:28.607752+0000","last_fullsized":"2024-04-16T13:06:28.607752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:37.159596+0000","last_change":"2024-04-16T13:06:37.159679+0000","last_active":"2024-04-16T13:06:37.159596+0000","last_peered":"2024-04-16T13:06:37.159596+0000","last_clean":"2024-04-16T13:06:37.159596+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:37.159596+0000","last_undegraded":"2024-04-16T13:06:37.159596+0000","last_fullsized":"2024-04-16T13:06:37.159596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.159441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.159441+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.159441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:07:43.128204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331660+0000","last_change":"2024-04-16T13:06:24.317095+0000","last_active":"2024-04-16T13:06:28.331660+0000","last_peered":"2024-04-16T13:06:28.331660+0000","last_clean":"2024-04-16T13:06:28.331660+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:28.331660+0000","last_undegraded":"2024-04-16T13:06:28.331660+0000","last_fullsized":"2024-04-16T13:06:28.331660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:39.187719+0000","last_change":"2024-04-16T13:06:39.187773+0000","last_active":"2024-04-16T13:06:39.187719+0000","last_peered":"2024-04-16T13:06:39.187719+0000","last_clean":"2024-04-16T13:06:39.187719+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:39.187719+0000","last_undegraded":"2024-04-16T13:06:39.187719+0000","last_fullsized":"2024-04-16T13:06:39.187719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:39.187506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:39.187506+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.187506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:09.041423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.324704+0000","last_change":"2024-04-16T13:06:24.314566+0000","last_active":"2024-04-16T13:06:28.324704+0000","last_peered":"2024-04-16T13:06:28.324704+0000","last_clean":"2024-04-16T13:06:28.324704+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:28.324704+0000","last_undegraded":"2024-04-16T13:06:28.324704+0000","last_fullsized":"2024-04-16T13:06:28.324704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.739847+0000","last_change":"2024-04-16T13:06:23.269225+0000","last_active":"2024-04-16T13:06:28.739847+0000","last_peered":"2024-04-16T13:06:28.739847+0000","last_clean":"2024-04-16T13:06:28.739847+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:28.739847+0000","last_undegraded":"2024-04-16T13:06:28.739847+0000","last_fullsized":"2024-04-16T13:06:28.739847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:56.089210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569430+0000","last_change":"2024-04-16T13:06:24.316180+0000","last_active":"2024-04-16T13:06:30.569430+0000","last_peered":"2024-04-16T13:06:30.569430+0000","last_clean":"2024-04-16T13:06:30.569430+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:30.569430+0000","last_undegraded":"2024-04-16T13:06:30.569430+0000","last_fullsized":"2024-04-16T13:06:30.569430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:30.569473+0000","last_change":"2024-04-16T13:06:23.276434+0000","last_active":"2024-04-16T13:06:30.569473+0000","last_peered":"2024-04-16T13:06:30.569473+0000","last_clean":"2024-04-16T13:06:30.569473+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:30.569473+0000","last_undegraded":"2024-04-16T13:06:30.569473+0000","last_fullsized":"2024-04-16T13:06:30.569473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.331197+0000","last_change":"2024-04-16T13:06:24.305378+0000","last_active":"2024-04-16T13:06:28.331197+0000","last_peered":"2024-04-16T13:06:28.331197+0000","last_clean":"2024-04-16T13:06:28.331197+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:28.331197+0000","last_undegraded":"2024-04-16T13:06:28.331197+0000","last_fullsized":"2024-04-16T13:06:28.331197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:05.412636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:38.962180+0000","last_change":"2024-04-16T13:06:38.962235+0000","last_active":"2024-04-16T13:06:38.962180+0000","last_peered":"2024-04-16T13:06:38.962180+0000","last_clean":"2024-04-16T13:06:38.962180+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:38.962180+0000","last_undegraded":"2024-04-16T13:06:38.962180+0000","last_fullsized":"2024-04-16T13:06:38.962180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:38.961966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:38.961966+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.961966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:31:34.786467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.328591+0000","last_change":"2024-04-16T13:06:24.322773+0000","last_active":"2024-04-16T13:06:28.328591+0000","last_peered":"2024-04-16T13:06:28.328591+0000","last_clean":"2024-04-16T13:06:28.328591+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:28.328591+0000","last_undegraded":"2024-04-16T13:06:28.328591+0000","last_fullsized":"2024-04-16T13:06:28.328591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:23.230325+0000","last_clean_scrub_stamp":"2024-04-16T13:06:23.230325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:31.387179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330961+0000","last_change":"2024-04-16T13:06:23.275071+0000","last_active":"2024-04-16T13:06:28.330961+0000","last_peered":"2024-04-16T13:06:28.330961+0000","last_clean":"2024-04-16T13:06:28.330961+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:28.330961+0000","last_undegraded":"2024-04-16T13:06:28.330961+0000","last_fullsized":"2024-04-16T13:06:28.330961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:22.225199+0000","last_clean_scrub_stamp":"2024-04-16T13:06:22.225199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:05:12.020418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-16T13:06:28.330427+0000","last_change":"2024-04-16T13:04:36.036433+0000","last_active":"2024-04-16T13:06:28.330427+0000","last_peered":"2024-04-16T13:06:28.330427+0000","last_clean":"2024-04-16T13:06:28.330427+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:28.330427+0000","last_undegraded":"2024-04-16T13:06:28.330427+0000","last_fullsized":"2024-04-16T13:06:28.330427+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:04:34.846712+0000","last_clean_scrub_stamp":"2024-04-16T13:04:34.846712+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:44.462551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1085440,"data_stored":801904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":210436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":209966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":210458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":211500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":209924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":209944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":800256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:06:41.999 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:41.999 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:41.999 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:41.999 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:41.999 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.000 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.001 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.002 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.003 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.004 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.005 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.006 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.007 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.008 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.009 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.010 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.011 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.012 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.013 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.013 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T13:06:23.230325+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.013 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T13:06:22.225199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.013 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T13:04:34.846712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=4, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=13, tm_min=6, tm_sec=34, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T13:06:42.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T13:06:45.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2024-04-16T13:06:47.218 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-04-16T13:06:47.217+0000 7f2ff6e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-16T13:06:52.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~27s 2024-04-16T13:06:59.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~33s 2024-04-16T13:07:02.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-16T13:07:02.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.247+0000 7f2e56400640 1 Processor -- start 2024-04-16T13:07:02.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.247+0000 7f2e56400640 1 -- start start 2024-04-16T13:07:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.249+0000 7f2e56400640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e5015e560 0x7f2e5015f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.249+0000 7f2e56400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 0x7f2e500c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.249+0000 7f2e56400640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50162300 con 0x7f2e5015e940 2024-04-16T13:07:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.249+0000 7f2e56400640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f2e500c58e0 con 0x7f2e5015e560 2024-04-16T13:07:02.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.249+0000 7f2e56400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2e500c5bc0 con 0x7f2e50162ae0 2024-04-16T13:07:02.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.250+0000 7f2e55a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 0x7f2e500c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.250+0000 7f2e55a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 0x7f2e500c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3301/0 says I am v2:172.21.15.67:42502/0 (socket says 172.21.15.67:42502) 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.250+0000 7f2e55000640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e5015e560 0x7f2e5015f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.250+0000 7f2e55a00640 1 -- 172.21.15.67:0/1341788720 learned_addr learned my addr 172.21.15.67:0/1341788720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.250+0000 7f2e4fe00640 1 --1- 172.21.15.67:0/1341788720 >> v1:172.21.15.82:6789/0 conn(0x7f2e5015e940 0x7f2e500c5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.67:33736/0 (socket says 172.21.15.67:33736) 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.251+0000 7f2e55000640 1 -- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 msgr2=0x7f2e500c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.251+0000 7f2e55000640 1 --2- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 0x7f2e500c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.251+0000 7f2e55000640 1 -- 172.21.15.67:0/1341788720 >> v1:172.21.15.82:6789/0 conn(0x7f2e5015e940 legacy=0x7f2e500c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.251+0000 7f2e55000640 1 -- 172.21.15.67:0/1341788720 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e500c5ea0 con 0x7f2e5015e560 2024-04-16T13:07:02.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.253+0000 7f2e55000640 1 --2- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e5015f840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097a0 tx=0x7f2e4402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ab578ee9558a5bb server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.253+0000 7f2e4f400640 1 -- 172.21.15.67:0/1341788720 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44031780 con 0x7f2e5015e560 2024-04-16T13:07:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.253+0000 7f2e4f400640 1 -- 172.21.15.67:0/1341788720 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44037070 con 0x7f2e5015e560 2024-04-16T13:07:02.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.253+0000 7f2e4f400640 1 -- 172.21.15.67:0/1341788720 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44031b40 con 0x7f2e5015e560 2024-04-16T13:07:02.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 -- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 msgr2=0x7f2e5015f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 --2- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e5015f840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e440097a0 tx=0x7f2e4402b820 comp rx=0 tx=0).stop 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 -- 172.21.15.67:0/1341788720 shutdown_connections 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 --2- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e50162ae0 0x7f2e500c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 --2- 172.21.15.67:0/1341788720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e5015f840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.254+0000 7f2e56400640 1 -- 172.21.15.67:0/1341788720 >> 172.21.15.67:0/1341788720 conn(0x7f2e500b2070 msgr2=0x7f2e500b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.255+0000 7f2e56400640 1 -- 172.21.15.67:0/1341788720 shutdown_connections 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.255+0000 7f2e56400640 1 -- 172.21.15.67:0/1341788720 wait complete. 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.257+0000 7f2e56400640 1 Processor -- start 2024-04-16T13:07:02.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.257+0000 7f2e56400640 1 -- start start 2024-04-16T13:07:02.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e500af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e5015e940 0x7f2e500b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50163110 con 0x7f2e50162ae0 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50162f90 con 0x7f2e5015e560 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.258+0000 7f2e56400640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f2e500c68f0 con 0x7f2e5015e940 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51116/0 (socket says 172.21.15.67:51116) 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 -- 172.21.15.67:0/3825962636 learned_addr learned my addr 172.21.15.67:0/3825962636 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55000640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e500af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e4fe00640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e5015e940 0x7f2e500b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 -- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e5015e940 msgr2=0x7f2e500b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e5015e940 0x7f2e500b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 -- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 msgr2=0x7f2e500af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e500af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.259+0000 7f2e55a00640 1 -- 172.21.15.67:0/3825962636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5006fbc0 con 0x7f2e50162ae0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.260+0000 7f2e55a00640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800efc0 tx=0x7f2e4800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.260+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800ccc0 con 0x7f2e50162ae0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.260+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e48003990 con 0x7f2e50162ae0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.260+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800ce60 con 0x7f2e50162ae0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.260+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e501f7b50 con 0x7f2e50162ae0 2024-04-16T13:07:02.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.261+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e501f8110 con 0x7f2e50162ae0 2024-04-16T13:07:02.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.262+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e50075bd0 con 0x7f2e50162ae0 2024-04-16T13:07:02.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.263+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e48012050 con 0x7f2e50162ae0 2024-04-16T13:07:02.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.264+0000 7f2e4cc00640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.264+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f2e4808c0f0 con 0x7f2e50162ae0 2024-04-16T13:07:02.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.265+0000 7f2e55000640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.266+0000 7f2e55000640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 0x7f2e3006edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e44036000 tx=0x7f2e4403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.269+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e48010040 con 0x7f2e50162ae0 2024-04-16T13:07:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.469+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 --> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e501f82e0 con 0x7f2e3006c8f0 2024-04-16T13:07:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.488+0000 7f2e4cc00640 1 -- 172.21.15.67:0/3825962636 <== mgr.4108 v2:172.21.15.82:6832/482426286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251929 (secure 0 0 0) 0x7f2e501f82e0 con 0x7f2e3006c8f0 2024-04-16T13:07:02.492 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:07:02.493 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-04-16T13:07:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 msgr2=0x7f2e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 0x7f2e3006edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e44036000 tx=0x7f2e4403d040 comp rx=0 tx=0).stop 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 msgr2=0x7f2e5014f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800efc0 tx=0x7f2e4800c490 comp rx=0 tx=0).stop 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 shutdown_connections 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e50162ae0 0x7f2e5014f320 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f2e5015e940 0x7f2e500b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 --2- 172.21.15.67:0/3825962636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5015e560 0x7f2e500af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.494+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 >> 172.21.15.67:0/3825962636 conn(0x7f2e500b2070 msgr2=0x7f2e500cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.495+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 shutdown_connections 2024-04-16T13:07:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.495+0000 7f2e56400640 1 -- 172.21.15.67:0/3825962636 wait complete. 2024-04-16T13:07:02.514 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-04-16T13:07:00.545243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":193,"num_read_kb":180,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":5032,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5152768,"data_stored":2916404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004687"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.883902+0000","last_change":"2024-04-16T13:06:43.883998+0000","last_active":"2024-04-16T13:06:43.883902+0000","last_peered":"2024-04-16T13:06:43.883902+0000","last_clean":"2024-04-16T13:06:43.883902+0000","last_became_active":"2024-04-16T13:06:24.314650+0000","last_became_peered":"2024-04-16T13:06:24.314650+0000","last_unstale":"2024-04-16T13:06:43.883902+0000","last_undegraded":"2024-04-16T13:06:43.883902+0000","last_fullsized":"2024-04-16T13:06:43.883902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.883604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.883604+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.883604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:14.366337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.871160+0000","last_change":"2024-04-16T13:06:42.871219+0000","last_active":"2024-04-16T13:06:42.871160+0000","last_peered":"2024-04-16T13:06:42.871160+0000","last_clean":"2024-04-16T13:06:42.871160+0000","last_became_active":"2024-04-16T13:06:24.310814+0000","last_became_peered":"2024-04-16T13:06:24.310814+0000","last_unstale":"2024-04-16T13:06:42.871160+0000","last_undegraded":"2024-04-16T13:06:42.871160+0000","last_fullsized":"2024-04-16T13:06:42.871160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:42.870986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:42.870986+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.870986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:16.301232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.243086+0000","last_change":"2024-04-16T13:06:43.243139+0000","last_active":"2024-04-16T13:06:43.243086+0000","last_peered":"2024-04-16T13:06:43.243086+0000","last_clean":"2024-04-16T13:06:43.243086+0000","last_became_active":"2024-04-16T13:06:24.310834+0000","last_became_peered":"2024-04-16T13:06:24.310834+0000","last_unstale":"2024-04-16T13:06:43.243086+0000","last_undegraded":"2024-04-16T13:06:43.243086+0000","last_fullsized":"2024-04-16T13:06:43.243086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.242910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.242910+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.242910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:57:25.739913+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.771797+0000","last_change":"2024-04-16T13:06:45.771850+0000","last_active":"2024-04-16T13:06:45.771797+0000","last_peered":"2024-04-16T13:06:45.771797+0000","last_clean":"2024-04-16T13:06:45.771797+0000","last_became_active":"2024-04-16T13:06:24.318938+0000","last_became_peered":"2024-04-16T13:06:24.318938+0000","last_unstale":"2024-04-16T13:06:45.771797+0000","last_undegraded":"2024-04-16T13:06:45.771797+0000","last_fullsized":"2024-04-16T13:06:45.771797+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.771601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.771601+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.771601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:22:12.112693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.777028+0000","last_change":"2024-04-16T13:06:46.777085+0000","last_active":"2024-04-16T13:06:46.777028+0000","last_peered":"2024-04-16T13:06:46.777028+0000","last_clean":"2024-04-16T13:06:46.777028+0000","last_became_active":"2024-04-16T13:06:24.320586+0000","last_became_peered":"2024-04-16T13:06:24.320586+0000","last_unstale":"2024-04-16T13:06:46.777028+0000","last_undegraded":"2024-04-16T13:06:46.777028+0000","last_fullsized":"2024-04-16T13:06:46.777028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.776848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.776848+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.776848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:16.630765+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.882447+0000","last_change":"2024-04-16T13:06:45.882504+0000","last_active":"2024-04-16T13:06:45.882447+0000","last_peered":"2024-04-16T13:06:45.882447+0000","last_clean":"2024-04-16T13:06:45.882447+0000","last_became_active":"2024-04-16T13:06:24.311736+0000","last_became_peered":"2024-04-16T13:06:24.311736+0000","last_unstale":"2024-04-16T13:06:45.882447+0000","last_undegraded":"2024-04-16T13:06:45.882447+0000","last_fullsized":"2024-04-16T13:06:45.882447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.882210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.882210+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.882210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:20.596023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:51.186224+0000","last_change":"2024-04-16T13:06:51.186280+0000","last_active":"2024-04-16T13:06:51.186224+0000","last_peered":"2024-04-16T13:06:51.186224+0000","last_clean":"2024-04-16T13:06:51.186224+0000","last_became_active":"2024-04-16T13:06:24.311703+0000","last_became_peered":"2024-04-16T13:06:24.311703+0000","last_unstale":"2024-04-16T13:06:51.186224+0000","last_undegraded":"2024-04-16T13:06:51.186224+0000","last_fullsized":"2024-04-16T13:06:51.186224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:51.186042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:51.186042+0000","last_clean_scrub_stamp":"2024-04-16T13:06:51.186042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:30.451817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:50.985543+0000","last_change":"2024-04-16T13:06:50.985596+0000","last_active":"2024-04-16T13:06:50.985543+0000","last_peered":"2024-04-16T13:06:50.985543+0000","last_clean":"2024-04-16T13:06:50.985543+0000","last_became_active":"2024-04-16T13:06:24.323333+0000","last_became_peered":"2024-04-16T13:06:24.323333+0000","last_unstale":"2024-04-16T13:06:50.985543+0000","last_undegraded":"2024-04-16T13:06:50.985543+0000","last_fullsized":"2024-04-16T13:06:50.985543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:50.985367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:50.985367+0000","last_clean_scrub_stamp":"2024-04-16T13:06:50.985367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:34:39.724314+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.221582+0000","last_change":"2024-04-16T13:06:46.221692+0000","last_active":"2024-04-16T13:06:46.221582+0000","last_peered":"2024-04-16T13:06:46.221582+0000","last_clean":"2024-04-16T13:06:46.221582+0000","last_became_active":"2024-04-16T13:06:24.312544+0000","last_became_peered":"2024-04-16T13:06:24.312544+0000","last_unstale":"2024-04-16T13:06:46.221582+0000","last_undegraded":"2024-04-16T13:06:46.221582+0000","last_fullsized":"2024-04-16T13:06:46.221582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.221416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.221416+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.221416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:43:21.939424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.243980+0000","last_change":"2024-04-16T13:06:45.244083+0000","last_active":"2024-04-16T13:06:45.243980+0000","last_peered":"2024-04-16T13:06:45.243980+0000","last_clean":"2024-04-16T13:06:45.243980+0000","last_became_active":"2024-04-16T13:06:24.294438+0000","last_became_peered":"2024-04-16T13:06:24.294438+0000","last_unstale":"2024-04-16T13:06:45.243980+0000","last_undegraded":"2024-04-16T13:06:45.243980+0000","last_fullsized":"2024-04-16T13:06:45.243980+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.243780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.243780+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.243780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:05.634373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:53.242133+0000","last_change":"2024-04-16T13:06:53.242195+0000","last_active":"2024-04-16T13:06:53.242133+0000","last_peered":"2024-04-16T13:06:53.242133+0000","last_clean":"2024-04-16T13:06:53.242133+0000","last_became_active":"2024-04-16T13:06:24.321726+0000","last_became_peered":"2024-04-16T13:06:24.321726+0000","last_unstale":"2024-04-16T13:06:53.242133+0000","last_undegraded":"2024-04-16T13:06:53.242133+0000","last_fullsized":"2024-04-16T13:06:53.242133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:53.241956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:53.241956+0000","last_clean_scrub_stamp":"2024-04-16T13:06:53.241956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:36.368982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.221429+0000","last_change":"2024-04-16T13:06:41.221485+0000","last_active":"2024-04-16T13:06:41.221429+0000","last_peered":"2024-04-16T13:06:41.221429+0000","last_clean":"2024-04-16T13:06:41.221429+0000","last_became_active":"2024-04-16T13:06:24.304742+0000","last_became_peered":"2024-04-16T13:06:24.304742+0000","last_unstale":"2024-04-16T13:06:41.221429+0000","last_undegraded":"2024-04-16T13:06:41.221429+0000","last_fullsized":"2024-04-16T13:06:41.221429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:41.221248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:41.221248+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.221248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:26.136506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:50.165254+0000","last_change":"2024-04-16T13:06:50.165361+0000","last_active":"2024-04-16T13:06:50.165254+0000","last_peered":"2024-04-16T13:06:50.165254+0000","last_clean":"2024-04-16T13:06:50.165254+0000","last_became_active":"2024-04-16T13:06:24.307244+0000","last_became_peered":"2024-04-16T13:06:24.307244+0000","last_unstale":"2024-04-16T13:06:50.165254+0000","last_undegraded":"2024-04-16T13:06:50.165254+0000","last_fullsized":"2024-04-16T13:06:50.165254+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:50.164997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:50.164997+0000","last_clean_scrub_stamp":"2024-04-16T13:06:50.164997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:12:02.088493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.649173+0000","last_change":"2024-04-16T13:06:47.649229+0000","last_active":"2024-04-16T13:06:47.649173+0000","last_peered":"2024-04-16T13:06:47.649173+0000","last_clean":"2024-04-16T13:06:47.649173+0000","last_became_active":"2024-04-16T13:06:24.328787+0000","last_became_peered":"2024-04-16T13:06:24.328787+0000","last_unstale":"2024-04-16T13:06:47.649173+0000","last_undegraded":"2024-04-16T13:06:47.649173+0000","last_fullsized":"2024-04-16T13:06:47.649173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.648991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.648991+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.648991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:14.177858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.238937+0000","last_change":"2024-04-16T13:06:47.239032+0000","last_active":"2024-04-16T13:06:47.238937+0000","last_peered":"2024-04-16T13:06:47.238937+0000","last_clean":"2024-04-16T13:06:47.238937+0000","last_became_active":"2024-04-16T13:06:24.302654+0000","last_became_peered":"2024-04-16T13:06:24.302654+0000","last_unstale":"2024-04-16T13:06:47.238937+0000","last_undegraded":"2024-04-16T13:06:47.238937+0000","last_fullsized":"2024-04-16T13:06:47.238937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.238737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.238737+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.238737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:48:10.144719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:49.358471+0000","last_change":"2024-04-16T13:06:49.358568+0000","last_active":"2024-04-16T13:06:49.358471+0000","last_peered":"2024-04-16T13:06:49.358471+0000","last_clean":"2024-04-16T13:06:49.358471+0000","last_became_active":"2024-04-16T13:06:24.293420+0000","last_became_peered":"2024-04-16T13:06:24.293420+0000","last_unstale":"2024-04-16T13:06:49.358471+0000","last_undegraded":"2024-04-16T13:06:49.358471+0000","last_fullsized":"2024-04-16T13:06:49.358471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:49.358269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:49.358269+0000","last_clean_scrub_stamp":"2024-04-16T13:06:49.358269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:43:25.076277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:53.470386+0000","last_change":"2024-04-16T13:06:53.470436+0000","last_active":"2024-04-16T13:06:53.470386+0000","last_peered":"2024-04-16T13:06:53.470386+0000","last_clean":"2024-04-16T13:06:53.470386+0000","last_became_active":"2024-04-16T13:06:24.301924+0000","last_became_peered":"2024-04-16T13:06:24.301924+0000","last_unstale":"2024-04-16T13:06:53.470386+0000","last_undegraded":"2024-04-16T13:06:53.470386+0000","last_fullsized":"2024-04-16T13:06:53.470386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:53.470218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:53.470218+0000","last_clean_scrub_stamp":"2024-04-16T13:06:53.470218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:12:05.393714+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.385932+0000","last_change":"2024-04-16T13:06:48.385997+0000","last_active":"2024-04-16T13:06:48.385932+0000","last_peered":"2024-04-16T13:06:48.385932+0000","last_clean":"2024-04-16T13:06:48.385932+0000","last_became_active":"2024-04-16T13:06:24.326382+0000","last_became_peered":"2024-04-16T13:06:24.326382+0000","last_unstale":"2024-04-16T13:06:48.385932+0000","last_undegraded":"2024-04-16T13:06:48.385932+0000","last_fullsized":"2024-04-16T13:06:48.385932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.385772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.385772+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.385772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:18.239689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.734708+0000","last_change":"2024-04-16T13:06:43.734805+0000","last_active":"2024-04-16T13:06:43.734708+0000","last_peered":"2024-04-16T13:06:43.734708+0000","last_clean":"2024-04-16T13:06:43.734708+0000","last_became_active":"2024-04-16T13:06:24.299918+0000","last_became_peered":"2024-04-16T13:06:24.299918+0000","last_unstale":"2024-04-16T13:06:43.734708+0000","last_undegraded":"2024-04-16T13:06:43.734708+0000","last_fullsized":"2024-04-16T13:06:43.734708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.734494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.734494+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.734494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:59.238249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:49.340471+0000","last_change":"2024-04-16T13:06:49.340523+0000","last_active":"2024-04-16T13:06:49.340471+0000","last_peered":"2024-04-16T13:06:49.340471+0000","last_clean":"2024-04-16T13:06:49.340471+0000","last_became_active":"2024-04-16T13:06:24.326338+0000","last_became_peered":"2024-04-16T13:06:24.326338+0000","last_unstale":"2024-04-16T13:06:49.340471+0000","last_undegraded":"2024-04-16T13:06:49.340471+0000","last_fullsized":"2024-04-16T13:06:49.340471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:49.340306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:49.340306+0000","last_clean_scrub_stamp":"2024-04-16T13:06:49.340306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:49.352414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.233608+0000","last_change":"2024-04-16T13:06:48.233703+0000","last_active":"2024-04-16T13:06:48.233608+0000","last_peered":"2024-04-16T13:06:48.233608+0000","last_clean":"2024-04-16T13:06:48.233608+0000","last_became_active":"2024-04-16T13:06:24.300923+0000","last_became_peered":"2024-04-16T13:06:24.300923+0000","last_unstale":"2024-04-16T13:06:48.233608+0000","last_undegraded":"2024-04-16T13:06:48.233608+0000","last_fullsized":"2024-04-16T13:06:48.233608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.233426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.233426+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.233426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:41:07.810555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.625277+0000","last_change":"2024-04-16T13:06:48.625334+0000","last_active":"2024-04-16T13:06:48.625277+0000","last_peered":"2024-04-16T13:06:48.625277+0000","last_clean":"2024-04-16T13:06:48.625277+0000","last_became_active":"2024-04-16T13:06:24.329174+0000","last_became_peered":"2024-04-16T13:06:24.329174+0000","last_unstale":"2024-04-16T13:06:48.625277+0000","last_undegraded":"2024-04-16T13:06:48.625277+0000","last_fullsized":"2024-04-16T13:06:48.625277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.625110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.625110+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.625110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:31:44.449611+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.389515+0000","last_change":"2024-04-16T13:06:48.389566+0000","last_active":"2024-04-16T13:06:48.389515+0000","last_peered":"2024-04-16T13:06:48.389515+0000","last_clean":"2024-04-16T13:06:48.389515+0000","last_became_active":"2024-04-16T13:06:24.292565+0000","last_became_peered":"2024-04-16T13:06:24.292565+0000","last_unstale":"2024-04-16T13:06:48.389515+0000","last_undegraded":"2024-04-16T13:06:48.389515+0000","last_fullsized":"2024-04-16T13:06:48.389515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.389352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.389352+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.389352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:08.779945+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.760027+0000","last_change":"2024-04-16T13:06:42.760079+0000","last_active":"2024-04-16T13:06:42.760027+0000","last_peered":"2024-04-16T13:06:42.760027+0000","last_clean":"2024-04-16T13:06:42.760027+0000","last_became_active":"2024-04-16T13:06:24.293649+0000","last_became_peered":"2024-04-16T13:06:24.293649+0000","last_unstale":"2024-04-16T13:06:42.760027+0000","last_undegraded":"2024-04-16T13:06:42.760027+0000","last_fullsized":"2024-04-16T13:06:42.760027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:42.759837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:42.759837+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.759837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:29.947830+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.430477+0000","last_change":"2024-04-16T13:06:45.430532+0000","last_active":"2024-04-16T13:06:45.430477+0000","last_peered":"2024-04-16T13:06:45.430477+0000","last_clean":"2024-04-16T13:06:45.430477+0000","last_became_active":"2024-04-16T13:06:24.312427+0000","last_became_peered":"2024-04-16T13:06:24.312427+0000","last_unstale":"2024-04-16T13:06:45.430477+0000","last_undegraded":"2024-04-16T13:06:45.430477+0000","last_fullsized":"2024-04-16T13:06:45.430477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.430286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.430286+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.430286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:23:53.587140+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.862652+0000","last_change":"2024-04-16T13:06:44.862715+0000","last_active":"2024-04-16T13:06:44.862652+0000","last_peered":"2024-04-16T13:06:44.862652+0000","last_clean":"2024-04-16T13:06:44.862652+0000","last_became_active":"2024-04-16T13:06:24.298277+0000","last_became_peered":"2024-04-16T13:06:24.298277+0000","last_unstale":"2024-04-16T13:06:44.862652+0000","last_undegraded":"2024-04-16T13:06:44.862652+0000","last_fullsized":"2024-04-16T13:06:44.862652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.862446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.862446+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.862446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:57:27.359450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.465247+0000","last_change":"2024-04-16T13:06:44.465298+0000","last_active":"2024-04-16T13:06:44.465247+0000","last_peered":"2024-04-16T13:06:44.465247+0000","last_clean":"2024-04-16T13:06:44.465247+0000","last_became_active":"2024-04-16T13:06:24.311353+0000","last_became_peered":"2024-04-16T13:06:24.311353+0000","last_unstale":"2024-04-16T13:06:44.465247+0000","last_undegraded":"2024-04-16T13:06:44.465247+0000","last_fullsized":"2024-04-16T13:06:44.465247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.465075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.465075+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.465075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:59.968831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.149936+0000","last_change":"2024-04-16T13:06:48.150041+0000","last_active":"2024-04-16T13:06:48.149936+0000","last_peered":"2024-04-16T13:06:48.149936+0000","last_clean":"2024-04-16T13:06:48.149936+0000","last_became_active":"2024-04-16T13:06:28.608582+0000","last_became_peered":"2024-04-16T13:06:28.608582+0000","last_unstale":"2024-04-16T13:06:48.149936+0000","last_undegraded":"2024-04-16T13:06:48.149936+0000","last_fullsized":"2024-04-16T13:06:48.149936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.149710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.149710+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.149710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:21.579957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.413279+0000","last_change":"2024-04-16T13:06:46.413332+0000","last_active":"2024-04-16T13:06:46.413279+0000","last_peered":"2024-04-16T13:06:46.413279+0000","last_clean":"2024-04-16T13:06:46.413279+0000","last_became_active":"2024-04-16T13:06:24.316182+0000","last_became_peered":"2024-04-16T13:06:24.316182+0000","last_unstale":"2024-04-16T13:06:46.413279+0000","last_undegraded":"2024-04-16T13:06:46.413279+0000","last_fullsized":"2024-04-16T13:06:46.413279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.413109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.413109+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.413109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:24:27.853892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.379916+0000","last_change":"2024-04-16T13:06:47.379972+0000","last_active":"2024-04-16T13:06:47.379916+0000","last_peered":"2024-04-16T13:06:47.379916+0000","last_clean":"2024-04-16T13:06:47.379916+0000","last_became_active":"2024-04-16T13:06:24.320329+0000","last_became_peered":"2024-04-16T13:06:24.320329+0000","last_unstale":"2024-04-16T13:06:47.379916+0000","last_undegraded":"2024-04-16T13:06:47.379916+0000","last_fullsized":"2024-04-16T13:06:47.379916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.379746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.379746+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.379746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:22:13.720838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.362176+0000","last_change":"2024-04-16T13:06:47.362285+0000","last_active":"2024-04-16T13:06:47.362176+0000","last_peered":"2024-04-16T13:06:47.362176+0000","last_clean":"2024-04-16T13:06:47.362176+0000","last_became_active":"2024-04-16T13:06:24.290178+0000","last_became_peered":"2024-04-16T13:06:24.290178+0000","last_unstale":"2024-04-16T13:06:47.362176+0000","last_undegraded":"2024-04-16T13:06:47.362176+0000","last_fullsized":"2024-04-16T13:06:47.362176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.361977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.361977+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.361977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:31:43.186479+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.886141+0000","last_change":"2024-04-16T13:06:41.886172+0000","last_active":"2024-04-16T13:06:41.886141+0000","last_peered":"2024-04-16T13:06:41.886141+0000","last_clean":"2024-04-16T13:06:41.886141+0000","last_became_active":"2024-04-16T13:06:24.295777+0000","last_became_peered":"2024-04-16T13:06:24.295777+0000","last_unstale":"2024-04-16T13:06:41.886141+0000","last_undegraded":"2024-04-16T13:06:41.886141+0000","last_fullsized":"2024-04-16T13:06:41.886141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:41.886042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:41.886042+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.886042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:37.152267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:51.386847+0000","last_change":"2024-04-16T13:06:51.386903+0000","last_active":"2024-04-16T13:06:51.386847+0000","last_peered":"2024-04-16T13:06:51.386847+0000","last_clean":"2024-04-16T13:06:51.386847+0000","last_became_active":"2024-04-16T13:06:24.298554+0000","last_became_peered":"2024-04-16T13:06:24.298554+0000","last_unstale":"2024-04-16T13:06:51.386847+0000","last_undegraded":"2024-04-16T13:06:51.386847+0000","last_fullsized":"2024-04-16T13:06:51.386847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:51.386600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:51.386600+0000","last_clean_scrub_stamp":"2024-04-16T13:06:51.386600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:24.816847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"42'5","reported_seq":36,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.498385+0000","last_change":"2024-04-16T13:06:43.498385+0000","last_active":"2024-04-16T13:06:43.498385+0000","last_peered":"2024-04-16T13:06:43.498385+0000","last_clean":"2024-04-16T13:06:43.498385+0000","last_became_active":"2024-04-16T13:06:23.278064+0000","last_became_peered":"2024-04-16T13:06:23.278064+0000","last_unstale":"2024-04-16T13:06:43.498385+0000","last_undegraded":"2024-04-16T13:06:43.498385+0000","last_fullsized":"2024-04-16T13:06:43.498385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'5","last_scrub_stamp":"2024-04-16T13:06:43.498140+0000","last_deep_scrub":"42'5","last_deep_scrub_stamp":"2024-04-16T13:06:43.498140+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.498140+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:30.686134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.898190+0000","last_change":"2024-04-16T13:06:43.898245+0000","last_active":"2024-04-16T13:06:43.898190+0000","last_peered":"2024-04-16T13:06:43.898190+0000","last_clean":"2024-04-16T13:06:43.898190+0000","last_became_active":"2024-04-16T13:06:24.299220+0000","last_became_peered":"2024-04-16T13:06:24.299220+0000","last_unstale":"2024-04-16T13:06:43.898190+0000","last_undegraded":"2024-04-16T13:06:43.898190+0000","last_fullsized":"2024-04-16T13:06:43.898190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.898024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.898024+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.898024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:05.395861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"42'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.149943+0000","last_change":"2024-04-16T13:06:38.170758+0000","last_active":"2024-04-16T13:06:41.149943+0000","last_peered":"2024-04-16T13:06:41.149943+0000","last_clean":"2024-04-16T13:06:41.149943+0000","last_became_active":"2024-04-16T13:06:23.273011+0000","last_became_peered":"2024-04-16T13:06:23.273011+0000","last_unstale":"2024-04-16T13:06:41.149943+0000","last_undegraded":"2024-04-16T13:06:41.149943+0000","last_fullsized":"2024-04-16T13:06:41.149943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T13:06:38.170499+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T13:06:38.170499+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.170499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:22.657767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.631835+0000","last_change":"2024-04-16T13:06:46.631886+0000","last_active":"2024-04-16T13:06:46.631835+0000","last_peered":"2024-04-16T13:06:46.631835+0000","last_clean":"2024-04-16T13:06:46.631835+0000","last_became_active":"2024-04-16T13:06:24.325987+0000","last_became_peered":"2024-04-16T13:06:24.325987+0000","last_unstale":"2024-04-16T13:06:46.631835+0000","last_undegraded":"2024-04-16T13:06:46.631835+0000","last_fullsized":"2024-04-16T13:06:46.631835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.631625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.631625+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.631625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:07.328329+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.157320+0000","last_change":"2024-04-16T13:06:38.853882+0000","last_active":"2024-04-16T13:06:44.157320+0000","last_peered":"2024-04-16T13:06:44.157320+0000","last_clean":"2024-04-16T13:06:44.157320+0000","last_became_active":"2024-04-16T13:06:23.272163+0000","last_became_peered":"2024-04-16T13:06:23.272163+0000","last_unstale":"2024-04-16T13:06:44.157320+0000","last_undegraded":"2024-04-16T13:06:44.157320+0000","last_fullsized":"2024-04-16T13:06:44.157320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:38.853390+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:38.853390+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.853390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:32.200944+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.908387+0000","last_change":"2024-04-16T13:06:46.908486+0000","last_active":"2024-04-16T13:06:46.908387+0000","last_peered":"2024-04-16T13:06:46.908387+0000","last_clean":"2024-04-16T13:06:46.908387+0000","last_became_active":"2024-04-16T13:06:24.316569+0000","last_became_peered":"2024-04-16T13:06:24.316569+0000","last_unstale":"2024-04-16T13:06:46.908387+0000","last_undegraded":"2024-04-16T13:06:46.908387+0000","last_fullsized":"2024-04-16T13:06:46.908387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.908183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.908183+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.908183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:34.769004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.160139+0000","last_change":"2024-04-16T13:06:39.587486+0000","last_active":"2024-04-16T13:06:44.160139+0000","last_peered":"2024-04-16T13:06:44.160139+0000","last_clean":"2024-04-16T13:06:44.160139+0000","last_became_active":"2024-04-16T13:06:23.272234+0000","last_became_peered":"2024-04-16T13:06:23.272234+0000","last_unstale":"2024-04-16T13:06:44.160139+0000","last_undegraded":"2024-04-16T13:06:44.160139+0000","last_fullsized":"2024-04-16T13:06:44.160139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:39.587238+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:39.587238+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.587238+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:12:47.163990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.149218+0000","last_change":"2024-04-16T13:06:40.200232+0000","last_active":"2024-04-16T13:06:41.149218+0000","last_peered":"2024-04-16T13:06:41.149218+0000","last_clean":"2024-04-16T13:06:41.149218+0000","last_became_active":"2024-04-16T13:06:24.304309+0000","last_became_peered":"2024-04-16T13:06:24.304309+0000","last_unstale":"2024-04-16T13:06:41.149218+0000","last_undegraded":"2024-04-16T13:06:41.149218+0000","last_fullsized":"2024-04-16T13:06:41.149218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:40.200083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:40.200083+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.200083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:35.466308+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"42'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.314290+0000","last_change":"2024-04-16T13:06:41.314357+0000","last_active":"2024-04-16T13:06:41.314290+0000","last_peered":"2024-04-16T13:06:41.314290+0000","last_clean":"2024-04-16T13:06:41.314290+0000","last_became_active":"2024-04-16T13:06:23.267447+0000","last_became_peered":"2024-04-16T13:06:23.267447+0000","last_unstale":"2024-04-16T13:06:41.314290+0000","last_undegraded":"2024-04-16T13:06:41.314290+0000","last_fullsized":"2024-04-16T13:06:41.314290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2024-04-16T13:06:41.314109+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2024-04-16T13:06:41.314109+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.314109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:29.428888+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.247806+0000","last_change":"2024-04-16T13:06:46.247903+0000","last_active":"2024-04-16T13:06:46.247806+0000","last_peered":"2024-04-16T13:06:46.247806+0000","last_clean":"2024-04-16T13:06:46.247806+0000","last_became_active":"2024-04-16T13:06:24.301865+0000","last_became_peered":"2024-04-16T13:06:24.301865+0000","last_unstale":"2024-04-16T13:06:46.247806+0000","last_undegraded":"2024-04-16T13:06:46.247806+0000","last_fullsized":"2024-04-16T13:06:46.247806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.247574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.247574+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.247574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:43:21.965583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"42'2","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.320626+0000","last_change":"2024-04-16T13:06:45.320722+0000","last_active":"2024-04-16T13:06:45.320626+0000","last_peered":"2024-04-16T13:06:45.320626+0000","last_clean":"2024-04-16T13:06:45.320626+0000","last_became_active":"2024-04-16T13:06:23.280475+0000","last_became_peered":"2024-04-16T13:06:23.280475+0000","last_unstale":"2024-04-16T13:06:45.320626+0000","last_undegraded":"2024-04-16T13:06:45.320626+0000","last_fullsized":"2024-04-16T13:06:45.320626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2","last_scrub_stamp":"2024-04-16T13:06:45.320381+0000","last_deep_scrub":"42'2","last_deep_scrub_stamp":"2024-04-16T13:06:45.320381+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.320381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:06.017085+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.627726+0000","last_change":"2024-04-16T13:06:44.627778+0000","last_active":"2024-04-16T13:06:44.627726+0000","last_peered":"2024-04-16T13:06:44.627726+0000","last_clean":"2024-04-16T13:06:44.627726+0000","last_became_active":"2024-04-16T13:06:24.318751+0000","last_became_peered":"2024-04-16T13:06:24.318751+0000","last_unstale":"2024-04-16T13:06:44.627726+0000","last_undegraded":"2024-04-16T13:06:44.627726+0000","last_fullsized":"2024-04-16T13:06:44.627726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.627521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.627521+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.627521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:46.422922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.543191+0000","last_change":"2024-04-16T13:06:37.861162+0000","last_active":"2024-04-16T13:06:41.543191+0000","last_peered":"2024-04-16T13:06:41.543191+0000","last_clean":"2024-04-16T13:06:41.543191+0000","last_became_active":"2024-04-16T13:06:23.268039+0000","last_became_peered":"2024-04-16T13:06:23.268039+0000","last_unstale":"2024-04-16T13:06:41.543191+0000","last_undegraded":"2024-04-16T13:06:41.543191+0000","last_fullsized":"2024-04-16T13:06:41.543191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.861053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.861053+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.861053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:55:53.364809+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:48.897300+0000","last_change":"2024-04-16T13:06:48.897358+0000","last_active":"2024-04-16T13:06:48.897300+0000","last_peered":"2024-04-16T13:06:48.897300+0000","last_clean":"2024-04-16T13:06:48.897300+0000","last_became_active":"2024-04-16T13:06:24.318717+0000","last_became_peered":"2024-04-16T13:06:24.318717+0000","last_unstale":"2024-04-16T13:06:48.897300+0000","last_undegraded":"2024-04-16T13:06:48.897300+0000","last_fullsized":"2024-04-16T13:06:48.897300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:48.897123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:48.897123+0000","last_clean_scrub_stamp":"2024-04-16T13:06:48.897123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:36:59.103491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.142270+0000","last_change":"2024-04-16T13:06:40.632404+0000","last_active":"2024-04-16T13:06:41.142270+0000","last_peered":"2024-04-16T13:06:41.142270+0000","last_clean":"2024-04-16T13:06:41.142270+0000","last_became_active":"2024-04-16T13:06:23.275050+0000","last_became_peered":"2024-04-16T13:06:23.275050+0000","last_unstale":"2024-04-16T13:06:41.142270+0000","last_undegraded":"2024-04-16T13:06:41.142270+0000","last_fullsized":"2024-04-16T13:06:41.142270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:40.632177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:40.632177+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.632177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:33.979732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.728006+0000","last_change":"2024-04-16T13:06:47.728065+0000","last_active":"2024-04-16T13:06:47.728006+0000","last_peered":"2024-04-16T13:06:47.728006+0000","last_clean":"2024-04-16T13:06:47.728006+0000","last_became_active":"2024-04-16T13:06:24.320522+0000","last_became_peered":"2024-04-16T13:06:24.320522+0000","last_unstale":"2024-04-16T13:06:47.728006+0000","last_undegraded":"2024-04-16T13:06:47.728006+0000","last_fullsized":"2024-04-16T13:06:47.728006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.727831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.727831+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.727831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:47.739940+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.131285+0000","last_change":"2024-04-16T13:06:39.936919+0000","last_active":"2024-04-16T13:06:41.131285+0000","last_peered":"2024-04-16T13:06:41.131285+0000","last_clean":"2024-04-16T13:06:41.131285+0000","last_became_active":"2024-04-16T13:06:23.260665+0000","last_became_peered":"2024-04-16T13:06:23.260665+0000","last_unstale":"2024-04-16T13:06:41.131285+0000","last_undegraded":"2024-04-16T13:06:41.131285+0000","last_fullsized":"2024-04-16T13:06:41.131285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:39.936696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:39.936696+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.936696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:18:07.177527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:56.552002+0000","last_change":"2024-04-16T13:06:56.552058+0000","last_active":"2024-04-16T13:06:56.552002+0000","last_peered":"2024-04-16T13:06:56.552002+0000","last_clean":"2024-04-16T13:06:56.552002+0000","last_became_active":"2024-04-16T13:06:24.305842+0000","last_became_peered":"2024-04-16T13:06:24.305842+0000","last_unstale":"2024-04-16T13:06:56.552002+0000","last_undegraded":"2024-04-16T13:06:56.552002+0000","last_fullsized":"2024-04-16T13:06:56.552002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:56.551837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:56.551837+0000","last_clean_scrub_stamp":"2024-04-16T13:06:56.551837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:39.678863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.267775+0000","last_change":"2024-04-16T13:06:43.267832+0000","last_active":"2024-04-16T13:06:43.267775+0000","last_peered":"2024-04-16T13:06:43.267775+0000","last_clean":"2024-04-16T13:06:43.267775+0000","last_became_active":"2024-04-16T13:06:23.275157+0000","last_became_peered":"2024-04-16T13:06:23.275157+0000","last_unstale":"2024-04-16T13:06:43.267775+0000","last_undegraded":"2024-04-16T13:06:43.267775+0000","last_fullsized":"2024-04-16T13:06:43.267775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.267576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.267576+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.267576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:09.796443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.264126+0000","last_change":"2024-04-16T13:06:42.264183+0000","last_active":"2024-04-16T13:06:42.264126+0000","last_peered":"2024-04-16T13:06:42.264126+0000","last_clean":"2024-04-16T13:06:42.264126+0000","last_became_active":"2024-04-16T13:06:24.308897+0000","last_became_peered":"2024-04-16T13:06:24.308897+0000","last_unstale":"2024-04-16T13:06:42.264126+0000","last_undegraded":"2024-04-16T13:06:42.264126+0000","last_fullsized":"2024-04-16T13:06:42.264126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:42.263945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:42.263945+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.263945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:03.761782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.154286+0000","last_change":"2024-04-16T13:06:42.314153+0000","last_active":"2024-04-16T13:06:44.154286+0000","last_peered":"2024-04-16T13:06:44.154286+0000","last_clean":"2024-04-16T13:06:44.154286+0000","last_became_active":"2024-04-16T13:06:23.267932+0000","last_became_peered":"2024-04-16T13:06:23.267932+0000","last_unstale":"2024-04-16T13:06:44.154286+0000","last_undegraded":"2024-04-16T13:06:44.154286+0000","last_fullsized":"2024-04-16T13:06:44.154286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-16T13:06:42.314007+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-16T13:06:42.314007+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.314007+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:03.010711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.612218+0000","last_change":"2024-04-16T13:06:45.612274+0000","last_active":"2024-04-16T13:06:45.612218+0000","last_peered":"2024-04-16T13:06:45.612218+0000","last_clean":"2024-04-16T13:06:45.612218+0000","last_became_active":"2024-04-16T13:06:24.325830+0000","last_became_peered":"2024-04-16T13:06:24.325830+0000","last_unstale":"2024-04-16T13:06:45.612218+0000","last_undegraded":"2024-04-16T13:06:45.612218+0000","last_fullsized":"2024-04-16T13:06:45.612218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.612038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.612038+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.612038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:33.726816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"42'7","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.158482+0000","last_change":"2024-04-16T13:06:41.892588+0000","last_active":"2024-04-16T13:06:44.158482+0000","last_peered":"2024-04-16T13:06:44.158482+0000","last_clean":"2024-04-16T13:06:44.158482+0000","last_became_active":"2024-04-16T13:06:23.272366+0000","last_became_peered":"2024-04-16T13:06:23.272366+0000","last_unstale":"2024-04-16T13:06:44.158482+0000","last_undegraded":"2024-04-16T13:06:44.158482+0000","last_fullsized":"2024-04-16T13:06:44.158482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'7","last_scrub_stamp":"2024-04-16T13:06:41.892434+0000","last_deep_scrub":"42'7","last_deep_scrub_stamp":"2024-04-16T13:06:41.892434+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.892434+0000","objects_scrubbed":4,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:51:45.965807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.249400+0000","last_change":"2024-04-16T13:06:45.249453+0000","last_active":"2024-04-16T13:06:45.249400+0000","last_peered":"2024-04-16T13:06:45.249400+0000","last_clean":"2024-04-16T13:06:45.249400+0000","last_became_active":"2024-04-16T13:06:24.310322+0000","last_became_peered":"2024-04-16T13:06:24.310322+0000","last_unstale":"2024-04-16T13:06:45.249400+0000","last_undegraded":"2024-04-16T13:06:45.249400+0000","last_fullsized":"2024-04-16T13:06:45.249400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.249223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.249223+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.249223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:18:12.490054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.132246+0000","last_change":"2024-04-16T13:06:40.920668+0000","last_active":"2024-04-16T13:06:41.132246+0000","last_peered":"2024-04-16T13:06:41.132246+0000","last_clean":"2024-04-16T13:06:41.132246+0000","last_became_active":"2024-04-16T13:06:23.266001+0000","last_became_peered":"2024-04-16T13:06:23.266001+0000","last_unstale":"2024-04-16T13:06:41.132246+0000","last_undegraded":"2024-04-16T13:06:41.132246+0000","last_fullsized":"2024-04-16T13:06:41.132246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:40.920505+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:40.920505+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.920505+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:43:16.638513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:51.993045+0000","last_change":"2024-04-16T13:06:51.993109+0000","last_active":"2024-04-16T13:06:51.993045+0000","last_peered":"2024-04-16T13:06:51.993045+0000","last_clean":"2024-04-16T13:06:51.993045+0000","last_became_active":"2024-04-16T13:06:24.324907+0000","last_became_peered":"2024-04-16T13:06:24.324907+0000","last_unstale":"2024-04-16T13:06:51.993045+0000","last_undegraded":"2024-04-16T13:06:51.993045+0000","last_fullsized":"2024-04-16T13:06:51.993045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:51.992860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:51.992860+0000","last_clean_scrub_stamp":"2024-04-16T13:06:51.992860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:21:50.225911+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.543179+0000","last_change":"2024-04-16T13:06:39.860515+0000","last_active":"2024-04-16T13:06:41.543179+0000","last_peered":"2024-04-16T13:06:41.543179+0000","last_clean":"2024-04-16T13:06:41.543179+0000","last_became_active":"2024-04-16T13:06:23.276676+0000","last_became_peered":"2024-04-16T13:06:23.276676+0000","last_unstale":"2024-04-16T13:06:41.543179+0000","last_undegraded":"2024-04-16T13:06:41.543179+0000","last_fullsized":"2024-04-16T13:06:41.543179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:39.860277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:39.860277+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.860277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:22:06.201369+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:50.383382+0000","last_change":"2024-04-16T13:06:50.383435+0000","last_active":"2024-04-16T13:06:50.383382+0000","last_peered":"2024-04-16T13:06:50.383382+0000","last_clean":"2024-04-16T13:06:50.383382+0000","last_became_active":"2024-04-16T13:06:24.295043+0000","last_became_peered":"2024-04-16T13:06:24.295043+0000","last_unstale":"2024-04-16T13:06:50.383382+0000","last_undegraded":"2024-04-16T13:06:50.383382+0000","last_fullsized":"2024-04-16T13:06:50.383382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:50.383196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:50.383196+0000","last_clean_scrub_stamp":"2024-04-16T13:06:50.383196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:51:54.456569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.483361+0000","last_change":"2024-04-16T13:06:42.483412+0000","last_active":"2024-04-16T13:06:42.483361+0000","last_peered":"2024-04-16T13:06:42.483361+0000","last_clean":"2024-04-16T13:06:42.483361+0000","last_became_active":"2024-04-16T13:06:23.270541+0000","last_became_peered":"2024-04-16T13:06:23.270541+0000","last_unstale":"2024-04-16T13:06:42.483361+0000","last_undegraded":"2024-04-16T13:06:42.483361+0000","last_fullsized":"2024-04-16T13:06:42.483361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:42.483201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:42.483201+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.483201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:42:13.340523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.914892+0000","last_change":"2024-04-16T13:06:44.914946+0000","last_active":"2024-04-16T13:06:44.914892+0000","last_peered":"2024-04-16T13:06:44.914892+0000","last_clean":"2024-04-16T13:06:44.914892+0000","last_became_active":"2024-04-16T13:06:24.315211+0000","last_became_peered":"2024-04-16T13:06:24.315211+0000","last_unstale":"2024-04-16T13:06:44.914892+0000","last_undegraded":"2024-04-16T13:06:44.914892+0000","last_fullsized":"2024-04-16T13:06:44.914892+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.914733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.914733+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.914733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:25:57.839416+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.339820+0000","last_change":"2024-04-16T13:06:46.339885+0000","last_active":"2024-04-16T13:06:46.339820+0000","last_peered":"2024-04-16T13:06:46.339820+0000","last_clean":"2024-04-16T13:06:46.339820+0000","last_became_active":"2024-04-16T13:06:23.280483+0000","last_became_peered":"2024-04-16T13:06:23.280483+0000","last_unstale":"2024-04-16T13:06:46.339820+0000","last_undegraded":"2024-04-16T13:06:46.339820+0000","last_fullsized":"2024-04-16T13:06:46.339820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-16T13:06:46.339619+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-16T13:06:46.339619+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.339619+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:28:12.868486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.863491+0000","last_change":"2024-04-16T13:06:47.863588+0000","last_active":"2024-04-16T13:06:47.863491+0000","last_peered":"2024-04-16T13:06:47.863491+0000","last_clean":"2024-04-16T13:06:47.863491+0000","last_became_active":"2024-04-16T13:06:24.317068+0000","last_became_peered":"2024-04-16T13:06:24.317068+0000","last_unstale":"2024-04-16T13:06:47.863491+0000","last_undegraded":"2024-04-16T13:06:47.863491+0000","last_fullsized":"2024-04-16T13:06:47.863491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.863236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.863236+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.863236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:59:56.274203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.280319+0000","last_change":"2024-04-16T13:06:44.280380+0000","last_active":"2024-04-16T13:06:44.280319+0000","last_peered":"2024-04-16T13:06:44.280319+0000","last_clean":"2024-04-16T13:06:44.280319+0000","last_became_active":"2024-04-16T13:06:23.278787+0000","last_became_peered":"2024-04-16T13:06:23.278787+0000","last_unstale":"2024-04-16T13:06:44.280319+0000","last_undegraded":"2024-04-16T13:06:44.280319+0000","last_fullsized":"2024-04-16T13:06:44.280319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T13:06:44.280138+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T13:06:44.280138+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.280138+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:13.754337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:49.202871+0000","last_change":"2024-04-16T13:06:49.202928+0000","last_active":"2024-04-16T13:06:49.202871+0000","last_peered":"2024-04-16T13:06:49.202871+0000","last_clean":"2024-04-16T13:06:49.202871+0000","last_became_active":"2024-04-16T13:06:24.303635+0000","last_became_peered":"2024-04-16T13:06:24.303635+0000","last_unstale":"2024-04-16T13:06:49.202871+0000","last_undegraded":"2024-04-16T13:06:49.202871+0000","last_fullsized":"2024-04-16T13:06:49.202871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:49.202700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:49.202700+0000","last_clean_scrub_stamp":"2024-04-16T13:06:49.202700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:51:30.789800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.161799+0000","last_change":"2024-04-16T13:06:42.617750+0000","last_active":"2024-04-16T13:06:44.161799+0000","last_peered":"2024-04-16T13:06:44.161799+0000","last_clean":"2024-04-16T13:06:44.161799+0000","last_became_active":"2024-04-16T13:06:23.278103+0000","last_became_peered":"2024-04-16T13:06:23.278103+0000","last_unstale":"2024-04-16T13:06:44.161799+0000","last_undegraded":"2024-04-16T13:06:44.161799+0000","last_fullsized":"2024-04-16T13:06:44.161799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:42.617410+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:42.617410+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.617410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:16:27.104678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:49.606328+0000","last_change":"2024-04-16T13:06:49.606428+0000","last_active":"2024-04-16T13:06:49.606328+0000","last_peered":"2024-04-16T13:06:49.606328+0000","last_clean":"2024-04-16T13:06:49.606328+0000","last_became_active":"2024-04-16T13:06:24.331204+0000","last_became_peered":"2024-04-16T13:06:24.331204+0000","last_unstale":"2024-04-16T13:06:49.606328+0000","last_undegraded":"2024-04-16T13:06:49.606328+0000","last_fullsized":"2024-04-16T13:06:49.606328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:49.606131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:49.606131+0000","last_clean_scrub_stamp":"2024-04-16T13:06:49.606131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:01:09.996724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.128999+0000","last_change":"2024-04-16T13:06:40.826383+0000","last_active":"2024-04-16T13:06:41.128999+0000","last_peered":"2024-04-16T13:06:41.128999+0000","last_clean":"2024-04-16T13:06:41.128999+0000","last_became_active":"2024-04-16T13:06:23.272281+0000","last_became_peered":"2024-04-16T13:06:23.272281+0000","last_unstale":"2024-04-16T13:06:41.128999+0000","last_undegraded":"2024-04-16T13:06:41.128999+0000","last_fullsized":"2024-04-16T13:06:41.128999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-16T13:06:40.826200+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-16T13:06:40.826200+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.826200+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:36:05.392312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.729790+0000","last_change":"2024-04-16T13:06:44.729857+0000","last_active":"2024-04-16T13:06:44.729790+0000","last_peered":"2024-04-16T13:06:44.729790+0000","last_clean":"2024-04-16T13:06:44.729790+0000","last_became_active":"2024-04-16T13:06:24.315262+0000","last_became_peered":"2024-04-16T13:06:24.315262+0000","last_unstale":"2024-04-16T13:06:44.729790+0000","last_undegraded":"2024-04-16T13:06:44.729790+0000","last_fullsized":"2024-04-16T13:06:44.729790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.729594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.729594+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.729594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:51:38.077148+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.543290+0000","last_change":"2024-04-16T13:06:40.857869+0000","last_active":"2024-04-16T13:06:41.543290+0000","last_peered":"2024-04-16T13:06:41.543290+0000","last_clean":"2024-04-16T13:06:41.543290+0000","last_became_active":"2024-04-16T13:06:23.277722+0000","last_became_peered":"2024-04-16T13:06:23.277722+0000","last_unstale":"2024-04-16T13:06:41.543290+0000","last_undegraded":"2024-04-16T13:06:41.543290+0000","last_fullsized":"2024-04-16T13:06:41.543290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:40.857700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:40.857700+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.857700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:10.711617+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:52.433320+0000","last_change":"2024-04-16T13:06:52.433373+0000","last_active":"2024-04-16T13:06:52.433320+0000","last_peered":"2024-04-16T13:06:52.433320+0000","last_clean":"2024-04-16T13:06:52.433320+0000","last_became_active":"2024-04-16T13:06:24.295211+0000","last_became_peered":"2024-04-16T13:06:24.295211+0000","last_unstale":"2024-04-16T13:06:52.433320+0000","last_undegraded":"2024-04-16T13:06:52.433320+0000","last_fullsized":"2024-04-16T13:06:52.433320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:52.433142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:52.433142+0000","last_clean_scrub_stamp":"2024-04-16T13:06:52.433142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:22.915875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"42'3","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.132157+0000","last_change":"2024-04-16T13:06:38.870471+0000","last_active":"2024-04-16T13:06:41.132157+0000","last_peered":"2024-04-16T13:06:41.132157+0000","last_clean":"2024-04-16T13:06:41.132157+0000","last_became_active":"2024-04-16T13:06:23.268092+0000","last_became_peered":"2024-04-16T13:06:23.268092+0000","last_unstale":"2024-04-16T13:06:41.132157+0000","last_undegraded":"2024-04-16T13:06:41.132157+0000","last_fullsized":"2024-04-16T13:06:41.132157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:38.870316+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:38.870316+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.870316+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:04:43.901366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.239669+0000","last_change":"2024-04-16T13:06:44.239760+0000","last_active":"2024-04-16T13:06:44.239669+0000","last_peered":"2024-04-16T13:06:44.239669+0000","last_clean":"2024-04-16T13:06:44.239669+0000","last_became_active":"2024-04-16T13:06:24.308514+0000","last_became_peered":"2024-04-16T13:06:24.308514+0000","last_unstale":"2024-04-16T13:06:44.239669+0000","last_undegraded":"2024-04-16T13:06:44.239669+0000","last_fullsized":"2024-04-16T13:06:44.239669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.239380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.239380+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.239380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:18.953192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.795677+0000","last_change":"2024-04-16T13:06:41.795717+0000","last_active":"2024-04-16T13:06:41.795677+0000","last_peered":"2024-04-16T13:06:41.795677+0000","last_clean":"2024-04-16T13:06:41.795677+0000","last_became_active":"2024-04-16T13:06:23.272573+0000","last_became_peered":"2024-04-16T13:06:23.272573+0000","last_unstale":"2024-04-16T13:06:41.795677+0000","last_undegraded":"2024-04-16T13:06:41.795677+0000","last_fullsized":"2024-04-16T13:06:41.795677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:41.795545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:41.795545+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.795545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:50.272702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:52.223730+0000","last_change":"2024-04-16T13:06:52.223784+0000","last_active":"2024-04-16T13:06:52.223730+0000","last_peered":"2024-04-16T13:06:52.223730+0000","last_clean":"2024-04-16T13:06:52.223730+0000","last_became_active":"2024-04-16T13:06:24.312208+0000","last_became_peered":"2024-04-16T13:06:24.312208+0000","last_unstale":"2024-04-16T13:06:52.223730+0000","last_undegraded":"2024-04-16T13:06:52.223730+0000","last_fullsized":"2024-04-16T13:06:52.223730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:52.223531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:52.223531+0000","last_clean_scrub_stamp":"2024-04-16T13:06:52.223531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:31:40.084353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.335346+0000","last_change":"2024-04-16T13:06:44.335396+0000","last_active":"2024-04-16T13:06:44.335346+0000","last_peered":"2024-04-16T13:06:44.335346+0000","last_clean":"2024-04-16T13:06:44.335346+0000","last_became_active":"2024-04-16T13:06:23.278451+0000","last_became_peered":"2024-04-16T13:06:23.278451+0000","last_unstale":"2024-04-16T13:06:44.335346+0000","last_undegraded":"2024-04-16T13:06:44.335346+0000","last_fullsized":"2024-04-16T13:06:44.335346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:44.335171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:44.335171+0000","last_clean_scrub_stamp":"2024-04-16T13:06:44.335171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:02:32.449950+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:45.955372+0000","last_change":"2024-04-16T13:06:45.955428+0000","last_active":"2024-04-16T13:06:45.955372+0000","last_peered":"2024-04-16T13:06:45.955372+0000","last_clean":"2024-04-16T13:06:45.955372+0000","last_became_active":"2024-04-16T13:06:24.315547+0000","last_became_peered":"2024-04-16T13:06:24.315547+0000","last_unstale":"2024-04-16T13:06:45.955372+0000","last_undegraded":"2024-04-16T13:06:45.955372+0000","last_fullsized":"2024-04-16T13:06:45.955372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:45.955208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:45.955208+0000","last_clean_scrub_stamp":"2024-04-16T13:06:45.955208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:25.220983+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.129202+0000","last_change":"2024-04-16T13:06:37.840055+0000","last_active":"2024-04-16T13:06:41.129202+0000","last_peered":"2024-04-16T13:06:41.129202+0000","last_clean":"2024-04-16T13:06:41.129202+0000","last_became_active":"2024-04-16T13:06:23.262851+0000","last_became_peered":"2024-04-16T13:06:23.262851+0000","last_unstale":"2024-04-16T13:06:41.129202+0000","last_undegraded":"2024-04-16T13:06:41.129202+0000","last_fullsized":"2024-04-16T13:06:41.129202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.839933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.839933+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.839933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:12:13.621360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.937142+0000","last_change":"2024-04-16T13:06:42.937194+0000","last_active":"2024-04-16T13:06:42.937142+0000","last_peered":"2024-04-16T13:06:42.937142+0000","last_clean":"2024-04-16T13:06:42.937142+0000","last_became_active":"2024-04-16T13:06:24.298430+0000","last_became_peered":"2024-04-16T13:06:24.298430+0000","last_unstale":"2024-04-16T13:06:42.937142+0000","last_undegraded":"2024-04-16T13:06:42.937142+0000","last_fullsized":"2024-04-16T13:06:42.937142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:42.936974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:42.936974+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.936974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:18:27.852232+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:44.163524+0000","last_change":"2024-04-16T13:06:40.355835+0000","last_active":"2024-04-16T13:06:44.163524+0000","last_peered":"2024-04-16T13:06:44.163524+0000","last_clean":"2024-04-16T13:06:44.163524+0000","last_became_active":"2024-04-16T13:06:23.266904+0000","last_became_peered":"2024-04-16T13:06:23.266904+0000","last_unstale":"2024-04-16T13:06:44.163524+0000","last_undegraded":"2024-04-16T13:06:44.163524+0000","last_fullsized":"2024-04-16T13:06:44.163524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-16T13:06:40.355563+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-16T13:06:40.355563+0000","last_clean_scrub_stamp":"2024-04-16T13:06:40.355563+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:42.150964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:55.532546+0000","last_change":"2024-04-16T13:06:55.532627+0000","last_active":"2024-04-16T13:06:55.532546+0000","last_peered":"2024-04-16T13:06:55.532546+0000","last_clean":"2024-04-16T13:06:55.532546+0000","last_became_active":"2024-04-16T13:06:24.305507+0000","last_became_peered":"2024-04-16T13:06:24.305507+0000","last_unstale":"2024-04-16T13:06:55.532546+0000","last_undegraded":"2024-04-16T13:06:55.532546+0000","last_fullsized":"2024-04-16T13:06:55.532546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:55.532370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:55.532370+0000","last_clean_scrub_stamp":"2024-04-16T13:06:55.532370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T15:04:04.652042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"42'1","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.128936+0000","last_change":"2024-04-16T13:06:39.870501+0000","last_active":"2024-04-16T13:06:41.128936+0000","last_peered":"2024-04-16T13:06:41.128936+0000","last_clean":"2024-04-16T13:06:41.128936+0000","last_became_active":"2024-04-16T13:06:23.270168+0000","last_became_peered":"2024-04-16T13:06:23.270168+0000","last_unstale":"2024-04-16T13:06:41.128936+0000","last_undegraded":"2024-04-16T13:06:41.128936+0000","last_fullsized":"2024-04-16T13:06:41.128936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:39.870359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:39.870359+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.870359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:42.815692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:49.943436+0000","last_change":"2024-04-16T13:06:49.943489+0000","last_active":"2024-04-16T13:06:49.943436+0000","last_peered":"2024-04-16T13:06:49.943436+0000","last_clean":"2024-04-16T13:06:49.943436+0000","last_became_active":"2024-04-16T13:06:24.321971+0000","last_became_peered":"2024-04-16T13:06:24.321971+0000","last_unstale":"2024-04-16T13:06:49.943436+0000","last_undegraded":"2024-04-16T13:06:49.943436+0000","last_fullsized":"2024-04-16T13:06:49.943436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:49.943258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:49.943258+0000","last_clean_scrub_stamp":"2024-04-16T13:06:49.943258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:07:47.189798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.149737+0000","last_change":"2024-04-16T13:06:37.159679+0000","last_active":"2024-04-16T13:06:41.149737+0000","last_peered":"2024-04-16T13:06:41.149737+0000","last_clean":"2024-04-16T13:06:41.149737+0000","last_became_active":"2024-04-16T13:06:23.265426+0000","last_became_peered":"2024-04-16T13:06:23.265426+0000","last_unstale":"2024-04-16T13:06:41.149737+0000","last_undegraded":"2024-04-16T13:06:41.149737+0000","last_fullsized":"2024-04-16T13:06:41.149737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:37.159441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:37.159441+0000","last_clean_scrub_stamp":"2024-04-16T13:06:37.159441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:07:43.128204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:47.181903+0000","last_change":"2024-04-16T13:06:47.181960+0000","last_active":"2024-04-16T13:06:47.181903+0000","last_peered":"2024-04-16T13:06:47.181903+0000","last_clean":"2024-04-16T13:06:47.181903+0000","last_became_active":"2024-04-16T13:06:24.316782+0000","last_became_peered":"2024-04-16T13:06:24.316782+0000","last_unstale":"2024-04-16T13:06:47.181903+0000","last_undegraded":"2024-04-16T13:06:47.181903+0000","last_fullsized":"2024-04-16T13:06:47.181903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:47.181723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:47.181723+0000","last_clean_scrub_stamp":"2024-04-16T13:06:47.181723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:51:51.255096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.149713+0000","last_change":"2024-04-16T13:06:39.187773+0000","last_active":"2024-04-16T13:06:41.149713+0000","last_peered":"2024-04-16T13:06:41.149713+0000","last_clean":"2024-04-16T13:06:41.149713+0000","last_became_active":"2024-04-16T13:06:23.278028+0000","last_became_peered":"2024-04-16T13:06:23.278028+0000","last_unstale":"2024-04-16T13:06:41.149713+0000","last_undegraded":"2024-04-16T13:06:41.149713+0000","last_fullsized":"2024-04-16T13:06:41.149713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:39.187506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:39.187506+0000","last_clean_scrub_stamp":"2024-04-16T13:06:39.187506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:09.041423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:46.865365+0000","last_change":"2024-04-16T13:06:46.865468+0000","last_active":"2024-04-16T13:06:46.865365+0000","last_peered":"2024-04-16T13:06:46.865365+0000","last_clean":"2024-04-16T13:06:46.865365+0000","last_became_active":"2024-04-16T13:06:24.314148+0000","last_became_peered":"2024-04-16T13:06:24.314148+0000","last_unstale":"2024-04-16T13:06:46.865365+0000","last_undegraded":"2024-04-16T13:06:46.865365+0000","last_fullsized":"2024-04-16T13:06:46.865365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:46.865144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:46.865144+0000","last_clean_scrub_stamp":"2024-04-16T13:06:46.865144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:18:14.105975+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.454593+0000","last_change":"2024-04-16T13:06:41.454650+0000","last_active":"2024-04-16T13:06:41.454593+0000","last_peered":"2024-04-16T13:06:41.454593+0000","last_clean":"2024-04-16T13:06:41.454593+0000","last_became_active":"2024-04-16T13:06:23.268854+0000","last_became_peered":"2024-04-16T13:06:23.268854+0000","last_unstale":"2024-04-16T13:06:41.454593+0000","last_undegraded":"2024-04-16T13:06:41.454593+0000","last_fullsized":"2024-04-16T13:06:41.454593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:41.454418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:41.454418+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.454418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:36:06.020530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.649269+0000","last_change":"2024-04-16T13:06:43.649321+0000","last_active":"2024-04-16T13:06:43.649269+0000","last_peered":"2024-04-16T13:06:43.649269+0000","last_clean":"2024-04-16T13:06:43.649269+0000","last_became_active":"2024-04-16T13:06:24.315882+0000","last_became_peered":"2024-04-16T13:06:24.315882+0000","last_unstale":"2024-04-16T13:06:43.649269+0000","last_undegraded":"2024-04-16T13:06:43.649269+0000","last_fullsized":"2024-04-16T13:06:43.649269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.649099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.649099+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.649099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:38.915324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.627714+0000","last_change":"2024-04-16T13:06:41.627810+0000","last_active":"2024-04-16T13:06:41.627714+0000","last_peered":"2024-04-16T13:06:41.627714+0000","last_clean":"2024-04-16T13:06:41.627714+0000","last_became_active":"2024-04-16T13:06:23.276148+0000","last_became_peered":"2024-04-16T13:06:23.276148+0000","last_unstale":"2024-04-16T13:06:41.627714+0000","last_undegraded":"2024-04-16T13:06:41.627714+0000","last_fullsized":"2024-04-16T13:06:41.627714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:41.627482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:41.627482+0000","last_clean_scrub_stamp":"2024-04-16T13:06:41.627482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:07:47.596245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:54.510840+0000","last_change":"2024-04-16T13:06:54.510893+0000","last_active":"2024-04-16T13:06:54.510840+0000","last_peered":"2024-04-16T13:06:54.510840+0000","last_clean":"2024-04-16T13:06:54.510840+0000","last_became_active":"2024-04-16T13:06:24.305016+0000","last_became_peered":"2024-04-16T13:06:24.305016+0000","last_unstale":"2024-04-16T13:06:54.510840+0000","last_undegraded":"2024-04-16T13:06:54.510840+0000","last_fullsized":"2024-04-16T13:06:54.510840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:54.510654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:54.510654+0000","last_clean_scrub_stamp":"2024-04-16T13:06:54.510654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:41:33.776429+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:41.130137+0000","last_change":"2024-04-16T13:06:38.962235+0000","last_active":"2024-04-16T13:06:41.130137+0000","last_peered":"2024-04-16T13:06:41.130137+0000","last_clean":"2024-04-16T13:06:41.130137+0000","last_became_active":"2024-04-16T13:06:23.261159+0000","last_became_peered":"2024-04-16T13:06:23.261159+0000","last_unstale":"2024-04-16T13:06:41.130137+0000","last_undegraded":"2024-04-16T13:06:41.130137+0000","last_fullsized":"2024-04-16T13:06:41.130137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:38.961966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:38.961966+0000","last_clean_scrub_stamp":"2024-04-16T13:06:38.961966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T16:31:34.786467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":27,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:54.209899+0000","last_change":"2024-04-16T13:06:54.209954+0000","last_active":"2024-04-16T13:06:54.209899+0000","last_peered":"2024-04-16T13:06:54.209899+0000","last_clean":"2024-04-16T13:06:54.209899+0000","last_became_active":"2024-04-16T13:06:24.322458+0000","last_became_peered":"2024-04-16T13:06:24.322458+0000","last_unstale":"2024-04-16T13:06:54.209899+0000","last_undegraded":"2024-04-16T13:06:54.209899+0000","last_fullsized":"2024-04-16T13:06:54.209899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:54.209721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:54.209721+0000","last_clean_scrub_stamp":"2024-04-16T13:06:54.209721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:37:04.416089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:43.339996+0000","last_change":"2024-04-16T13:06:43.340052+0000","last_active":"2024-04-16T13:06:43.339996+0000","last_peered":"2024-04-16T13:06:43.339996+0000","last_clean":"2024-04-16T13:06:43.339996+0000","last_became_active":"2024-04-16T13:06:23.274770+0000","last_became_peered":"2024-04-16T13:06:23.274770+0000","last_unstale":"2024-04-16T13:06:43.339996+0000","last_undegraded":"2024-04-16T13:06:43.339996+0000","last_fullsized":"2024-04-16T13:06:43.339996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T13:06:43.339819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T13:06:43.339819+0000","last_clean_scrub_stamp":"2024-04-16T13:06:43.339819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T14:43:45.135220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"42'119","reported_seq":224,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-16T13:06:42.325981+0000","last_change":"2024-04-16T13:06:42.326055+0000","last_active":"2024-04-16T13:06:42.325981+0000","last_peered":"2024-04-16T13:06:42.325981+0000","last_clean":"2024-04-16T13:06:42.325981+0000","last_became_active":"2024-04-16T13:04:36.029871+0000","last_became_peered":"2024-04-16T13:04:36.029871+0000","last_unstale":"2024-04-16T13:06:42.325981+0000","last_undegraded":"2024-04-16T13:06:42.325981+0000","last_fullsized":"2024-04-16T13:06:42.325981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'119","last_scrub_stamp":"2024-04-16T13:06:42.325816+0000","last_deep_scrub":"42'119","last_deep_scrub_stamp":"2024-04-16T13:06:42.325816+0000","last_clean_scrub_stamp":"2024-04-16T13:06:42.325816+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T13:44:54.325998+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":77,"num_read_kb":80,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1097728,"data_stored":808406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":216938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":216468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":495616,"data_stored":216960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":218002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":216426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":491520,"data_stored":216446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1085440,"data_stored":806758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T13:07:02.521 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-16T13:07:02.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.775+0000 7fbe5ac00640 1 Processor -- start 2024-04-16T13:07:02.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.776+0000 7fbe5ac00640 1 -- start start 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5ac00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe5415e650 0x7fbe540cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5ac00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe540d21c0 0x7fbe540d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5ac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540d2650 con 0x7fbe540d0490 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5ac00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 -- 0x7fbe540d2930 con 0x7fbe540d21c0 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5ac00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7fbe540d2c10 con 0x7fbe5415e650 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe58e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe540d21c0 0x7fbe540d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe58e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe540d21c0 0x7fbe540d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51124/0 (socket says 172.21.15.67:51124) 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe58e00640 1 -- 172.21.15.67:0/1106427305 learned_addr learned my addr 172.21.15.67:0/1106427305 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.777+0000 7fbe5a200640 1 --1- 172.21.15.67:0/1106427305 >> v1:172.21.15.67:6789/0 conn(0x7fbe540d0490 0x7fbe54162360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49096/0 (socket says 172.21.15.67:49096) 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.778+0000 7fbe59800640 1 --2- 172.21.15.67:0/1106427305 >> v2:172.21.15.82:3300/0 conn(0x7fbe5415e650 0x7fbe540cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.778+0000 7fbe58e00640 1 -- 172.21.15.67:0/1106427305 >> v2:172.21.15.82:3300/0 conn(0x7fbe5415e650 msgr2=0x7fbe540cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.778+0000 7fbe58e00640 1 --2- 172.21.15.67:0/1106427305 >> v2:172.21.15.82:3300/0 conn(0x7fbe5415e650 0x7fbe540cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.778+0000 7fbe58e00640 1 -- 172.21.15.67:0/1106427305 >> v1:172.21.15.67:6789/0 conn(0x7fbe540d0490 legacy=0x7fbe54162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.778+0000 7fbe58e00640 1 -- 172.21.15.67:0/1106427305 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe540d2ef0 con 0x7fbe540d21c0 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.779+0000 7fbe58e00640 1 --2- 172.21.15.67:0/1106427305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe540d21c0 0x7fbe540d0f70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbe5408d300 tx=0x7fbe4002bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ed1cc2f8446c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.779+0000 7fbe53e00640 1 -- 172.21.15.67:0/1106427305 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4002cb60 con 0x7fbe540d21c0 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.779+0000 7fbe53e00640 1 -- 172.21.15.67:0/1106427305 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4002cd00 con 0x7fbe540d21c0 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.779+0000 7fbe53e00640 1 -- 172.21.15.67:0/1106427305 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40034610 con 0x7fbe540d21c0 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1106427305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe540d21c0 msgr2=0x7fbe540d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1106427305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe540d21c0 0x7fbe540d0f70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbe5408d300 tx=0x7fbe4002bfc0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1106427305 shutdown_connections 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1106427305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe540d21c0 0x7fbe540d0f70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1106427305 >> v2:172.21.15.82:3300/0 conn(0x7fbe5415e650 0x7fbe540cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1106427305 >> 172.21.15.67:0/1106427305 conn(0x7fbe5408c000 msgr2=0x7fbe540d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1106427305 shutdown_connections 2024-04-16T13:07:02.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.780+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1106427305 wait complete. 2024-04-16T13:07:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.782+0000 7fbe5ac00640 1 Processor -- start 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.782+0000 7fbe5ac00640 1 -- start start 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe540b1bb0 0x7fbe540b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe541f41f0 0x7fbe541f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5415ea30 con 0x7fbe5415e650 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe540d36f0 con 0x7fbe541f41f0 2024-04-16T13:07:02.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe5ac00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5415ebb0 con 0x7fbe540b1bb0 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe59800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe59800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51134/0 (socket says 172.21.15.67:51134) 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.783+0000 7fbe59800640 1 -- 172.21.15.67:0/1650763503 learned_addr learned my addr 172.21.15.67:0/1650763503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 -- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe540b1bb0 msgr2=0x7fbe540b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe540b1bb0 0x7fbe540b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 -- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe541f41f0 msgr2=0x7fbe541f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe541f41f0 0x7fbe541f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 -- 172.21.15.67:0/1650763503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe541f4f00 con 0x7fbe5415e650 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe59800640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400d800 tx=0x7fbe4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400b6c0 con 0x7fbe5415e650 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe44019070 con 0x7fbe5415e650 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400ba80 con 0x7fbe5415e650 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe540c9120 con 0x7fbe5415e650 2024-04-16T13:07:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.784+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe540c96e0 con 0x7fbe5415e650 2024-04-16T13:07:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.786+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe54075bd0 con 0x7fbe5415e650 2024-04-16T13:07:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.787+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe4400bc20 con 0x7fbe5415e650 2024-04-16T13:07:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.787+0000 7fbe51600640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 0x7fbe3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.788+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7fbe4408c1f0 con 0x7fbe5415e650 2024-04-16T13:07:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.788+0000 7fbe58e00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 0x7fbe3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.789+0000 7fbe58e00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 0x7fbe3406ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbe40035000 tx=0x7fbe4002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:02.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.793+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe4401c360 con 0x7fbe5415e650 2024-04-16T13:07:03.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:02.999+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbe540b4920 con 0x7fbe5415e650 2024-04-16T13:07:03.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.004+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7fbe4405a410 con 0x7fbe5415e650 2024-04-16T13:07:03.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.004+0000 7fbe51600640 1 -- 172.21.15.67:0/1650763503 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbe44059d10 con 0x7fbe5415e650 2024-04-16T13:07:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 msgr2=0x7fbe3406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 0x7fbe3406ede0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbe40035000 tx=0x7fbe4002e000 comp rx=0 tx=0).stop 2024-04-16T13:07:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 msgr2=0x7fbe54158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400d800 tx=0x7fbe4400dcc0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 shutdown_connections 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7fbe3406c920 0x7fbe3406ede0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe541f41f0 0x7fbe541f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7fbe540b1bb0 0x7fbe540b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 --2- 172.21.15.67:0/1650763503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe5415e650 0x7fbe54158cf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 >> 172.21.15.67:0/1650763503 conn(0x7fbe5408c000 msgr2=0x7fbe540d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 shutdown_connections 2024-04-16T13:07:03.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.007+0000 7fbe5ac00640 1 -- 172.21.15.67:0/1650763503 wait complete. 2024-04-16T13:07:03.026 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-16T13:07:03.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T13:07:03.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.238+0000 7f15b8a00640 1 Processor -- start 2024-04-16T13:07:03.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.238+0000 7f15b8a00640 1 -- start start 2024-04-16T13:07:03.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.239+0000 7f15b8a00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15b406d7c0 0x7f15b40d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.239+0000 7f15b8a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b40d0000 con 0x7f15b415eaa0 2024-04-16T13:07:03.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.239+0000 7f15b8a00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b40d02e0 con 0x7f15b406d360 2024-04-16T13:07:03.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.239+0000 7f15b8a00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 -- 0x7f15b40d0c10 con 0x7f15b406d7c0 2024-04-16T13:07:03.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.240+0000 7f15b2800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f15b415eaa0 0x7f15b40d4ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:49100/0 (socket says 172.21.15.67:49100) 2024-04-16T13:07:03.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.240+0000 7f15b2800640 1 -- 172.21.15.67:0/1105720258 learned_addr learned my addr 172.21.15.67:0/1105720258 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-04-16T13:07:03.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.240+0000 7f15b3200640 1 --2- 172.21.15.67:0/1105720258 >> v2:172.21.15.82:3300/0 conn(0x7f15b406d7c0 0x7f15b40d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.240+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778344276 0 0) 0x7f15b40d0000 con 0x7f15b415eaa0 2024-04-16T13:07:03.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.240+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1598003520 con 0x7f15b415eaa0 2024-04-16T13:07:03.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 108840645 0 0) 0x7f1598003520 con 0x7f15b415eaa0 2024-04-16T13:07:03.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 >> v2:172.21.15.82:3300/0 conn(0x7f15b406d7c0 msgr2=0x7f15b40d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 --2- 172.21.15.67:0/1105720258 >> v2:172.21.15.82:3300/0 conn(0x7f15b406d7c0 0x7f15b40d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 >> v1:172.21.15.82:6789/0 conn(0x7f15b406d360 legacy=0x7f15b40d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b40d05c0 con 0x7f15b415eaa0 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2357543151 0 0) 0x7f15a40019f0 con 0x7f15b415eaa0 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 >> v1:172.21.15.67:6789/0 conn(0x7f15b415eaa0 legacy=0x7f15b40d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 0x7f1598003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1598005210 0x7f159800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f15b40d0c10 con 0x7f1598003a00 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f159800c160 con 0x7f1598005210 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f159800c360 con 0x7f1598004800 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15b2800640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 0x7f1598003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.241+0000 7f15a9e00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b3200640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1598005210 0x7f159800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b2800640 1 -- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598004800 msgr2=0x7f1598004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b2800640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b2800640 1 -- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1598005210 msgr2=0x7f159800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-16T13:07:03.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b2800640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1598005210 0x7f159800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b2800640 1 -- 172.21.15.67:0/1105720258 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598003520 con 0x7f1598003a00 2024-04-16T13:07:03.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15b3200640 1 -- 172.21.15.67:0/1105720258 reap_dead start 2024-04-16T13:07:03.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.242+0000 7f15a9e00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T13:07:03.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b2800640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 0x7f1598003e20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f15a400a740 tx=0x7f1598005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f16740e99fde0a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400a390 con 0x7f1598003a00 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f15a4034650 con 0x7f1598003a00 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b1e00640 1 -- 172.21.15.67:0/1105720258 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4034ae0 con 0x7f1598003a00 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b8a00640 1 -- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 msgr2=0x7f1598003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.243+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 0x7f1598003e20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f15a400a740 tx=0x7f1598005830 comp rx=0 tx=0).stop 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.244+0000 7f15b8a00640 1 -- 172.21.15.67:0/1105720258 shutdown_connections 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.244+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1105720258 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1598003a00 0x7f1598003e20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.244+0000 7f15b8a00640 1 -- 172.21.15.67:0/1105720258 >> 172.21.15.67:0/1105720258 conn(0x7f15b408c000 msgr2=0x7f15b40d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.244+0000 7f15b8a00640 1 -- 172.21.15.67:0/1105720258 shutdown_connections 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.244+0000 7f15b8a00640 1 -- 172.21.15.67:0/1105720258 wait complete. 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.246+0000 7f15b8a00640 1 Processor -- start 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.246+0000 7f15b8a00640 1 -- start start 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 --2- >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598003a00 0x7f15b40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15b4161450 0x7f15b415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f15b415ee80 con 0x7f15b415a2a0 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15b406dc50 con 0x7f15b4161450 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15b8a00640 1 -- --> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] -- mon_getmap magic: 0 -- 0x7f15b406ceb0 con 0x7f1598003a00 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15a9e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51150/0 (socket says 172.21.15.67:51150) 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.247+0000 7f15a9e00640 1 -- 172.21.15.67:0/1152875095 learned_addr learned my addr 172.21.15.67:0/1152875095 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 -- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598003a00 msgr2=0x7f15b40ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598003a00 0x7f15b40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 -- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15b4161450 msgr2=0x7f15b415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15b3200640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15b4161450 0x7f15b415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15b4161450 0x7f15b415f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 -- 172.21.15.67:0/1152875095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b40cd010 con 0x7f15b415a2a0 2024-04-16T13:07:03.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15a9e00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d480 tx=0x7f159c00d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:03.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c005480 con 0x7f15b415a2a0 2024-04-16T13:07:03.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f159c017070 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c003850 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b40cc490 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.248+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b40cca50 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.250+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b4075bd0 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.251+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f159c0039f0 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.251+0000 7f15ab400640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 0x7f159006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.252+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f159c08bbd0 con 0x7f15b415a2a0 2024-04-16T13:07:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.252+0000 7f15b2800640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 0x7f159006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T13:07:03.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.253+0000 7f15b2800640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 0x7f159006ede0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15a4034000 tx=0x7f15a4007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T13:07:03.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.256+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f159c059e20 con 0x7f15b415a2a0 2024-04-16T13:07:03.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.507+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15b4161830 con 0x7f15b415a2a0 2024-04-16T13:07:03.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.508+0000 7f15ab400640 1 -- 172.21.15.67:0/1152875095 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+4358 (secure 0 0 0) 0x7f159c059720 con 0x7f15b415a2a0 2024-04-16T13:07:03.509 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-04-16T13:07:03.509 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4703,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2013697614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2013697614},{"type":"v1","addr":"172.21.15.82:6835","nonce":2013697614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/2223402768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2223402768},{"type":"v1","addr":"172.21.15.67:6834","nonce":2223402768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T13:06:23.736265+0000","modified":"2024-04-16T13:06:44.138657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.67:6835/1074117415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1074117415},{"type":"v1","addr":"172.21.15.67:6835","nonce":1074117415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":2}]} 2024-04-16T13:07:03.509 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 21 2024-04-16T13:07:03.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 msgr2=0x7f159006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 0x7f159006ede0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15a4034000 tx=0x7f15a4007000 comp rx=0 tx=0).stop 2024-04-16T13:07:03.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 msgr2=0x7f15b4160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T13:07:03.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d480 tx=0x7f159c00d940 comp rx=0 tx=0).stop 2024-04-16T13:07:03.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 shutdown_connections 2024-04-16T13:07:03.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:6832/482426286,v1:172.21.15.82:6833/482426286] conn(0x7f159006c920 0x7f159006ede0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15b4161450 0x7f15b415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15b415a2a0 0x7f15b4160f10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 --2- 172.21.15.67:0/1152875095 >> [v2:172.21.15.82:3301/0,v1:172.21.15.82:6790/0] conn(0x7f1598003a00 0x7f15b40ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 >> 172.21.15.67:0/1152875095 conn(0x7f15b408c000 msgr2=0x7f15b40d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 shutdown_connections 2024-04-16T13:07:03.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-04-16T13:07:03.511+0000 7f15b8a00640 1 -- 172.21.15.67:0/1152875095 wait complete. 2024-04-16T13:07:03.532 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-16T13:07:03.532 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T13:07:03.533 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-16T13:07:03.533 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.556 INFO:tasks.ceph.mds.a:Stopped 2024-04-16T13:07:03.556 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-16T13:07:03.556 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.618 INFO:tasks.ceph.mds.c:Stopped 2024-04-16T13:07:03.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-16T13:07:03.619 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.644 INFO:tasks.ceph.mds.b:Stopped 2024-04-16T13:07:03.644 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-16T13:07:03.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:03.644 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-04-16T13:07:03.653 INFO:tasks.ceph.mds.d:Stopped 2024-04-16T13:07:03.653 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T13:07:03.653 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-16T13:07:03.654 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.711 INFO:tasks.ceph.osd.0:Stopped 2024-04-16T13:07:03.712 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-16T13:07:03.712 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.768 INFO:tasks.ceph.osd.1:Stopped 2024-04-16T13:07:03.769 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-16T13:07:03.769 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.851 INFO:tasks.ceph.osd.2:Stopped 2024-04-16T13:07:03.852 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-16T13:07:03.852 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.919 INFO:tasks.ceph.osd.3:Stopped 2024-04-16T13:07:03.919 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-16T13:07:03.920 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:03.974 INFO:tasks.ceph.osd.4:Stopped 2024-04-16T13:07:03.975 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-16T13:07:03.975 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.037 INFO:tasks.ceph.osd.5:Stopped 2024-04-16T13:07:04.037 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-16T13:07:04.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.098 INFO:tasks.ceph.osd.6:Stopped 2024-04-16T13:07:04.098 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-16T13:07:04.098 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.158 INFO:tasks.ceph.osd.7:Stopped 2024-04-16T13:07:04.158 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T13:07:04.159 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-16T13:07:04.159 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.260 INFO:tasks.ceph.mgr.y:Stopped 2024-04-16T13:07:04.260 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-16T13:07:04.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.345 INFO:tasks.ceph.mgr.x:Stopped 2024-04-16T13:07:04.346 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T13:07:04.346 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-16T13:07:04.346 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.397 INFO:tasks.ceph.mon.a:Stopped 2024-04-16T13:07:04.398 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-16T13:07:04.398 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.430 INFO:tasks.ceph.mon.b:Stopped 2024-04-16T13:07:04.430 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-16T13:07:04.430 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T13:07:04.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-16T13:07:04.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-16T13:07:04.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-16T13:07:04.505 INFO:tasks.ceph.mon.c:Stopped 2024-04-16T13:07:04.506 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T13:07:04.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-16T13:07:04.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:07:04.619 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-16T13:07:04.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:07:04.926 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-16T13:07:05.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:07:05.131 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-16T13:07:05.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:07:05.297 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-16T13:07:05.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:07:05.432 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-16T13:07:05.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:07:05.723 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-16T13:07:05.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:07:05.862 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-16T13:07:05.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:07:05.995 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-16T13:07:06.170 INFO:tasks.ceph:Archiving mon data... 2024-04-16T13:07:06.171 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/data/mon.a.tgz 2024-04-16T13:07:06.171 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-04-16T13:07:06.226 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.M8jCG2WWqJ 2024-04-16T13:07:06.226 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.M8jCG2WWqJ 2024-04-16T13:07:06.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.M8jCG2WWqJ 2024-04-16T13:07:06.542 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.M8jCG2WWqJ is 314KB 2024-04-16T13:07:06.637 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.M8jCG2WWqJ 2024-04-16T13:07:06.691 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/data/mon.b.tgz 2024-04-16T13:07:06.691 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-16T13:07:06.751 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.ZRZm7CSIAM 2024-04-16T13:07:06.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZRZm7CSIAM 2024-04-16T13:07:06.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.ZRZm7CSIAM 2024-04-16T13:07:07.107 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.ZRZm7CSIAM is 420KB 2024-04-16T13:07:07.215 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.ZRZm7CSIAM 2024-04-16T13:07:07.270 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/data/mon.c.tgz 2024-04-16T13:07:07.271 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-16T13:07:07.324 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.99OKCrpipf 2024-04-16T13:07:07.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.99OKCrpipf 2024-04-16T13:07:07.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:07.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:07.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.99OKCrpipf 2024-04-16T13:07:07.733 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.99OKCrpipf is 420KB 2024-04-16T13:07:07.843 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.99OKCrpipf 2024-04-16T13:07:07.899 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T13:07:07.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T13:07:07.908 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T13:07:08.068 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T13:07:08.124 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T13:07:08.125 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T13:07:08.126 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi067/crash 2024-04-16T13:07:08.127 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T13:07:08.229 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi082/crash 2024-04-16T13:07:08.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T13:07:08.335 INFO:tasks.ceph:Shutting down logrotate 2024-04-16T13:07:08.336 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:08.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:08.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:08.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-16T13:07:08.683 INFO:tasks.ceph:Compressing logs... 2024-04-16T13:07:08.683 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T13:07:08.691 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T13:07:08.783 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-16T13:07:08.784 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37391.log 2024-04-16T13:07:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-04-16T13:07:08.785 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43373.log 2024-04-16T13:07:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-04-16T13:07:08.787 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37231.log 2024-04-16T13:07:08.787 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37391.log.gz 2024-04-16T13:07:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-04-16T13:07:08.788 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-04-16T13:07:08.789 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.3.43373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43373.log.gz 2024-04-16T13:07:08.789 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43369.log 2024-04-16T13:07:08.789 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2024-04-16T13:07:08.789 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37231.log.gz 2024-04-16T13:07:08.791 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2024-04-16T13:07:08.791 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-04-16T13:07:08.791 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51516.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-16T13:07:08.791 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-04-16T13:07:08.792 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.3.43369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43369.log.gz 2024-04-16T13:07:08.792 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T13:07:08.792 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37511.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-16T13:07:08.792 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gz 2024-04-16T13:07:08.792 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-16T13:07:08.794 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2024-04-16T13:07:08.794 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2024-04-16T13:07:08.794 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48352.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T13:07:08.795 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-16T13:07:08.797 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-04-16T13:07:08.797 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-04-16T13:07:08.797 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47440.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2024-04-16T13:07:08.797 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.45399.log 2024-04-16T13:07:08.798 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37351.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-16T13:07:08.798 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-04-16T13:07:08.798 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37471.log 2024-04-16T13:07:08.798 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2024-04-16T13:07:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37311.log 2024-04-16T13:07:08.800 INFO:teuthology.orchestra.run.smithi082.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37471.log.gz 2024-04-16T13:07:08.800 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-04-16T13:07:08.800 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-04-16T13:07:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-04-16T13:07:08.801 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45399.log.gz 2024-04-16T13:07:08.801 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52084.log 2024-04-16T13:07:08.801 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-04-16T13:07:08.802 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2024-04-16T13:07:08.802 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-04-16T13:07:08.803 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37271.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-16T13:07:08.803 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2024-04-16T13:07:08.803 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42945.log 2024-04-16T13:07:08.803 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37311.log.gz 2024-04-16T13:07:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37431.log 2024-04-16T13:07:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52312.log 2024-04-16T13:07:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43904.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52084.log.gz 2024-04-16T13:07:08.805 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2024-04-16T13:07:08.805 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-04-16T13:07:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.1.42945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42926.log 2024-04-16T13:07:08.807 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42945.log.gz 2024-04-16T13:07:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37431.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T13:07:08.807 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37431.log.gz 2024-04-16T13:07:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50552.log 2024-04-16T13:07:08.808 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52312.log.gz 2024-04-16T13:07:08.808 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-04-16T13:07:08.808 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.1.42926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42926.log.gz 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44234.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-04-16T13:07:08.810 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2024-04-16T13:07:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47303.log 2024-04-16T13:07:08.812 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-04-16T13:07:08.813 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45944.log 2024-04-16T13:07:08.813 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2024-04-16T13:07:08.813 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T13:07:08.814 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-16T13:07:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.47303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47303.log.gz 2024-04-16T13:07:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2024-04-16T13:07:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48134.log 2024-04-16T13:07:08.815 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45944.log.gz 2024-04-16T13:07:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-04-16T13:07:08.816 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2024-04-16T13:07:08.817 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43862.log 2024-04-16T13:07:08.817 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48134.log.gz 2024-04-16T13:07:08.818 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2024-04-16T13:07:08.818 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-04-16T13:07:08.819 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48394.log 2024-04-16T13:07:08.819 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43862.log.gz 2024-04-16T13:07:08.820 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.c.log: 89.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-16T13:07:08.821 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2024-04-16T13:07:08.821 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2024-04-16T13:07:08.822 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2024-04-16T13:07:08.822 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48394.log.gz 2024-04-16T13:07:08.823 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2024-04-16T13:07:08.823 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gz 2024-04-16T13:07:08.824 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-04-16T13:07:08.824 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2024-04-16T13:07:08.825 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37435.log 2024-04-16T13:07:08.825 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2024-04-16T13:07:08.826 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46528.log 2024-04-16T13:07:08.827 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-04-16T13:07:08.828 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2024-04-16T13:07:08.828 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37435.log.gz 2024-04-16T13:07:08.829 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-04-16T13:07:08.829 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-04-16T13:07:08.830 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-04-16T13:07:08.830 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2024-04-16T13:07:08.831 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52564.log 2024-04-16T13:07:08.831 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-04-16T13:07:08.832 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2024-04-16T13:07:08.833 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-04-16T13:07:08.834 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-04-16T13:07:08.834 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52564.log.gz 2024-04-16T13:07:08.835 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48310.log 2024-04-16T13:07:08.835 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2024-04-16T13:07:08.836 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51958.log 2024-04-16T13:07:08.836 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-04-16T13:07:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51874.log 2024-04-16T13:07:08.837 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48310.log.gz 2024-04-16T13:07:08.839 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-04-16T13:07:08.839 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51958.log.gz 2024-04-16T13:07:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51874.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51874.log.gz 2024-04-16T13:07:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52829.log 2024-04-16T13:07:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 87.5% 2024-04-16T13:07:08.841 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-04-16T13:07:08.843 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49387.log 2024-04-16T13:07:08.843 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52829.log.gz 2024-04-16T13:07:08.844 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2024-04-16T13:07:08.844 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-04-16T13:07:08.845 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51474.log 2024-04-16T13:07:08.845 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49387.log.gz 2024-04-16T13:07:08.846 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-04-16T13:07:08.846 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2024-04-16T13:07:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2024-04-16T13:07:08.848 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51474.log.gz 2024-04-16T13:07:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52042.log 2024-04-16T13:07:08.849 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-04-16T13:07:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-04-16T13:07:08.850 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2024-04-16T13:07:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47752.log 2024-04-16T13:07:08.851 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52042.log.gz 2024-04-16T13:07:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46070.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-04-16T13:07:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2024-04-16T13:07:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-04-16T13:07:08.854 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47752.log.gz 2024-04-16T13:07:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2024-04-16T13:07:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2024-04-16T13:07:08.856 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2024-04-16T13:07:08.856 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-04-16T13:07:08.857 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2024-04-16T13:07:08.857 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-16T13:07:08.858 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2024-04-16T13:07:08.858 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42918.log 2024-04-16T13:07:08.859 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2024-04-16T13:07:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2024-04-16T13:07:08.860 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2024-04-16T13:07:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2024-04-16T13:07:08.861 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42918.log.gz 2024-04-16T13:07:08.862 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49345.log 2024-04-16T13:07:08.862 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2024-04-16T13:07:08.863 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49429.log 2024-04-16T13:07:08.864 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2024-04-16T13:07:08.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49345.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49345.log.gz 2024-04-16T13:07:08.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-04-16T13:07:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2024-04-16T13:07:08.866 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49429.log.gz 2024-04-16T13:07:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44760.log 2024-04-16T13:07:08.867 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-04-16T13:07:08.868 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45435.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz /var/log/ceph/ceph-client.admin.42439.log 2024-04-16T13:07:08.868 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-16T13:07:08.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52396.log 2024-04-16T13:07:08.869 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44760.log.gz 2024-04-16T13:07:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52522.log 2024-04-16T13:07:08.871 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2024-04-16T13:07:08.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-04-16T13:07:08.872 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52396.log.gz 2024-04-16T13:07:08.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-04-16T13:07:08.873 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52522.log.gz 2024-04-16T13:07:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48604.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-04-16T13:07:08.874 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2024-04-16T13:07:08.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-16T13:07:08.875 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-04-16T13:07:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49717.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2024-04-16T13:07:08.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49555.log 2024-04-16T13:07:08.878 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-04-16T13:07:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50924.log 2024-04-16T13:07:08.879 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49555.log.gz 2024-04-16T13:07:08.880 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-16T13:07:08.880 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51306.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-04-16T13:07:08.880 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2024-04-16T13:07:08.881 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2024-04-16T13:07:08.882 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50924.log.gz 2024-04-16T13:07:08.883 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51558.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2024-04-16T13:07:08.883 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49801.log 2024-04-16T13:07:08.884 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49843.log 2024-04-16T13:07:08.885 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2024-04-16T13:07:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49801.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49801.log.gz 2024-04-16T13:07:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42580.log 2024-04-16T13:07:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49843.log.gz 2024-04-16T13:07:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2024-04-16T13:07:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2024-04-16T13:07:08.888 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42580.log.gz 2024-04-16T13:07:08.889 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2024-04-16T13:07:08.890 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2024-04-16T13:07:08.891 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2024-04-16T13:07:08.891 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2024-04-16T13:07:08.892 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2024-04-16T13:07:08.892 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49471.log 2024-04-16T13:07:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47794.log 2024-04-16T13:07:08.893 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2024-04-16T13:07:08.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44546.log 2024-04-16T13:07:08.895 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49471.log.gz 2024-04-16T13:07:08.896 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48799.log 2024-04-16T13:07:08.896 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47794.log.gz 2024-04-16T13:07:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44546.log.gz 2024-04-16T13:07:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52658.log 2024-04-16T13:07:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48757.log 2024-04-16T13:07:08.899 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48799.log.gz 2024-04-16T13:07:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50071.log 2024-04-16T13:07:08.900 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52658.log.gz 2024-04-16T13:07:08.901 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52787.log 2024-04-16T13:07:08.901 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48757.log.gz 2024-04-16T13:07:08.902 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50071.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50071.log.gz 2024-04-16T13:07:08.902 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2024-04-16T13:07:08.903 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-04-16T13:07:08.903 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52787.log.gz 2024-04-16T13:07:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42395.log 2024-04-16T13:07:08.905 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2024-04-16T13:07:08.906 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.41908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-04-16T13:07:08.906 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-04-16T13:07:08.907 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42395.log.gz 2024-04-16T13:07:08.908 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49759.log 2024-04-16T13:07:08.909 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47878.log 2024-04-16T13:07:08.909 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-04-16T13:07:08.910 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2024-04-16T13:07:08.910 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49759.log.gz 2024-04-16T13:07:08.911 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47626.log 2024-04-16T13:07:08.911 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47878.log.gz 2024-04-16T13:07:08.912 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48046.log 2024-04-16T13:07:08.913 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2024-04-16T13:07:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47626.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47626.log.gz 2024-04-16T13:07:08.914 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48925.log 2024-04-16T13:07:08.915 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48046.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-16T13:07:08.915 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48046.log.gz 2024-04-16T13:07:08.916 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44588.log 2024-04-16T13:07:08.916 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48925.log.gz 2024-04-16T13:07:08.917 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2024-04-16T13:07:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44588.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.44588.log.gz 2024-04-16T13:07:08.919 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.44765.log 2024-04-16T13:07:08.920 INFO:teuthology.orchestra.run.smithi082.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-16T13:07:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49927.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2024-04-16T13:07:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42311.log 2024-04-16T13:07:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48520.log 2024-04-16T13:07:08.922 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-04-16T13:07:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42311.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42311.log.gz 2024-04-16T13:07:08.923 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-16T13:07:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48520.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48520.log.gz 2024-04-16T13:07:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-04-16T13:07:08.926 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2024-04-16T13:07:08.926 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-04-16T13:07:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44754.log 2024-04-16T13:07:08.927 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-04-16T13:07:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-04-16T13:07:08.928 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2024-04-16T13:07:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2024-04-16T13:07:08.930 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gz 2024-04-16T13:07:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45775.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-04-16T13:07:08.931 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-04-16T13:07:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-04-16T13:07:08.932 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2024-04-16T13:07:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-04-16T13:07:08.933 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-04-16T13:07:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2024-04-16T13:07:08.935 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-04-16T13:07:08.936 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2024-04-16T13:07:08.936 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-04-16T13:07:08.937 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50468.log 2024-04-16T13:07:08.937 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2024-04-16T13:07:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42984.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz -5 2024-04-16T13:07:08.938 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-04-16T13:07:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-04-16T13:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50468.log.gz 2024-04-16T13:07:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50239.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.43678.log -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-04-16T13:07:08.941 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-16T13:07:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49255.log 2024-04-16T13:07:08.942 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-04-16T13:07:08.943 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-16T13:07:08.944 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42007.log 2024-04-16T13:07:08.944 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-04-16T13:07:08.945 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52000.log 2024-04-16T13:07:08.945 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49255.log.gz 2024-04-16T13:07:08.947 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43421.log 2024-04-16T13:07:08.947 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42007.log.gz 2024-04-16T13:07:08.948 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52126.log 2024-04-16T13:07:08.948 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52000.log.gz 2024-04-16T13:07:08.949 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2024-04-16T13:07:08.951 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2024-04-16T13:07:08.951 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52126.log.gz 2024-04-16T13:07:08.951 INFO:teuthology.orchestra.run.smithi067.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2024-04-16T13:07:08.952 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51134.log 2024-04-16T13:07:08.952 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2024-04-16T13:07:08.953 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44072.log 2024-04-16T13:07:08.953 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2024-04-16T13:07:08.954 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51134.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-16T13:07:08.955 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51134.log.gz 2024-04-16T13:07:08.956 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2024-04-16T13:07:08.956 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44072.log.gz 2024-04-16T13:07:08.957 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2024-04-16T13:07:08.959 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2024-04-16T13:07:08.959 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2024-04-16T13:07:08.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-04-16T13:07:08.960 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-04-16T13:07:08.961 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-04-16T13:07:08.962 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47668.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2024-04-16T13:07:08.963 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47836.log 2024-04-16T13:07:08.963 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-04-16T13:07:08.964 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-04-16T13:07:08.964 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-04-16T13:07:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50423.log 2024-04-16T13:07:08.966 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47836.log.gz 2024-04-16T13:07:08.967 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51050.log 2024-04-16T13:07:08.968 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-04-16T13:07:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42483.log 2024-04-16T13:07:08.969 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50423.log.gz 2024-04-16T13:07:08.970 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2024-04-16T13:07:08.970 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51050.log.gz 2024-04-16T13:07:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-04-16T13:07:08.972 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2024-04-16T13:07:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42624.log 2024-04-16T13:07:08.973 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2024-04-16T13:07:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2024-04-16T13:07:08.975 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-04-16T13:07:08.976 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2024-04-16T13:07:08.976 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42624.log.gz 2024-04-16T13:07:08.978 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-04-16T13:07:08.978 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2024-04-16T13:07:08.979 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-04-16T13:07:08.979 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz 2024-04-16T13:07:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45106.log 2024-04-16T13:07:08.981 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-04-16T13:07:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51832.log 2024-04-16T13:07:08.982 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-04-16T13:07:08.983 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48883.log 2024-04-16T13:07:08.983 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45106.log.gz 2024-04-16T13:07:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45095.log 2024-04-16T13:07:08.985 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51832.log.gz 2024-04-16T13:07:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48883.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31166.log 2024-04-16T13:07:08.986 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48883.log.gz 2024-04-16T13:07:08.987 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42226.log 2024-04-16T13:07:08.988 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45095.log.gz 2024-04-16T13:07:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.tmp-client.admin.31166.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31166.log.gz 2024-04-16T13:07:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-04-16T13:07:08.990 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-16T13:07:08.990 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42226.log.gz 2024-04-16T13:07:08.991 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-04-16T13:07:08.992 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-04-16T13:07:08.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2024-04-16T13:07:08.993 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-16T13:07:08.994 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44294.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-16T13:07:08.995 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-04-16T13:07:08.996 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-04-16T13:07:08.996 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz 2024-04-16T13:07:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2024-04-16T13:07:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-04-16T13:07:08.999 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-04-16T13:07:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 2024-04-16T13:07:09.000 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2024-04-16T13:07:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-04-16T13:07:09.002 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-04-16T13:07:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50113.log: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-16T13:07:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-04-16T13:07:09.007 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46847.log 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46028.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42538.log 2024-04-16T13:07:09.008 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46847.log.gz 2024-04-16T13:07:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2024-04-16T13:07:09.009 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2024-04-16T13:07:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2024-04-16T13:07:09.010 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42538.log.gz 2024-04-16T13:07:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-04-16T13:07:09.011 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2024-04-16T13:07:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2024-04-16T13:07:09.012 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2024-04-16T13:07:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45431.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-04-16T13:07:09.013 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2024-04-16T13:07:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47920.log 2024-04-16T13:07:09.014 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2024-04-16T13:07:09.015 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-16T13:07:09.015 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2024-04-16T13:07:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47482.log 2024-04-16T13:07:09.017 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47920.log.gz 2024-04-16T13:07:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2024-04-16T13:07:09.019 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-04-16T13:07:09.019 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47482.log.gz 2024-04-16T13:07:09.019 INFO:teuthology.orchestra.run.smithi067.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-16T13:07:09.020 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52747.log 2024-04-16T13:07:09.021 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2024-04-16T13:07:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50323.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-04-16T13:07:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46364.log 2024-04-16T13:07:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52438.log 2024-04-16T13:07:09.023 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52747.log.gz 2024-04-16T13:07:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52480.log 2024-04-16T13:07:09.024 INFO:teuthology.orchestra.run.smithi067.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46364.log.gz 2024-04-16T13:07:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48004.log 2024-04-16T13:07:09.025 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52438.log.gz 2024-04-16T13:07:09.026 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52480.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-16T13:07:09.027 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52480.log.gz 2024-04-16T13:07:09.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48004.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48004.log.gz 2024-04-16T13:07:09.028 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47307.log 2024-04-16T13:07:09.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-16T13:07:09.031 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.47307.log: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-16T13:07:09.031 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47307.log.gz 2024-04-16T13:07:09.031 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-04-16T13:07:09.031 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-04-16T13:07:09.033 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-16T13:07:09.033 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-04-16T13:07:09.034 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45437.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz 2024-04-16T13:07:09.034 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-04-16T13:07:09.035 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-04-16T13:07:09.037 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49675.log 2024-04-16T13:07:09.037 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-04-16T13:07:09.038 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-04-16T13:07:09.038 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-04-16T13:07:09.039 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49675.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-04-16T13:07:09.040 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49675.log.gz 2024-04-16T13:07:09.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2024-04-16T13:07:09.041 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-04-16T13:07:09.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2024-04-16T13:07:09.043 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-04-16T13:07:09.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45902.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2024-04-16T13:07:09.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45093.log 2024-04-16T13:07:09.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51916.log 2024-04-16T13:07:09.046 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2024-04-16T13:07:09.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37548.log 2024-04-16T13:07:09.047 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45093.log.gz 2024-04-16T13:07:09.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47710.log 2024-04-16T13:07:09.048 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51916.log.gz 2024-04-16T13:07:09.050 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37548.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37548.log.gz 2024-04-16T13:07:09.050 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.42708.log 2024-04-16T13:07:09.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47710.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47710.log.gz 2024-04-16T13:07:09.051 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51092.log 2024-04-16T13:07:09.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52354.log 2024-04-16T13:07:09.053 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42708.log.gz 2024-04-16T13:07:09.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51092.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50755.log 2024-04-16T13:07:09.054 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51092.log.gz 2024-04-16T13:07:09.055 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-04-16T13:07:09.055 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52354.log.gz 2024-04-16T13:07:09.057 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-04-16T13:07:09.057 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50755.log.gz 2024-04-16T13:07:09.058 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.42834.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2024-04-16T13:07:09.058 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50011.log 2024-04-16T13:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45100.log 2024-04-16T13:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-04-16T13:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46322.log 2024-04-16T13:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50011.log.gz 2024-04-16T13:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2024-04-16T13:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45100.log.gz 2024-04-16T13:07:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46866.log 2024-04-16T13:07:09.064 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2024-04-16T13:07:09.064 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50966.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2024-04-16T13:07:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.46866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46866.log.gz 2024-04-16T13:07:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-04-16T13:07:09.067 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-04-16T13:07:09.069 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.45442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-04-16T13:07:09.069 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-04-16T13:07:09.070 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52606.log 2024-04-16T13:07:09.070 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-04-16T13:07:09.071 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37180.log 2024-04-16T13:07:09.072 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-04-16T13:07:09.073 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-04-16T13:07:09.073 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52606.log.gz 2024-04-16T13:07:09.075 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.37180.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-16T13:07:09.075 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37180.log.gz 2024-04-16T13:07:09.075 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46154.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-04-16T13:07:09.077 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-04-16T13:07:09.079 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2024-04-16T13:07:09.080 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50281.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-04-16T13:07:09.081 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-04-16T13:07:09.082 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.44030.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2024-04-16T13:07:09.083 INFO:teuthology.orchestra.run.smithi067.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-16T13:07:09.083 INFO:teuthology.orchestra.run.smithi067.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-16T13:07:09.083 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46112.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-04-16T13:07:09.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-16T13:07:09.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-16T13:07:09.480 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-16T13:07:09.492 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-16T13:07:09.497 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-16T13:07:09.563 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-16T13:07:09.566 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-04-16T13:07:09.566 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m0.822s 2024-04-16T13:07:09.566 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m2.964s 2024-04-16T13:07:09.567 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m0.345s 2024-04-16T13:07:09.649 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-16T13:07:09.711 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-16T13:07:09.722 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-16T13:07:09.762 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-16T13:07:09.765 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-04-16T13:07:09.765 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m1.025s 2024-04-16T13:07:09.766 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m3.076s 2024-04-16T13:07:09.766 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.935s 2024-04-16T13:07:09.767 INFO:tasks.ceph:Archiving logs... 2024-04-16T13:07:09.767 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi067/log 2024-04-16T13:07:09.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T13:07:10.450 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi082/log 2024-04-16T13:07:10.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T13:07:10.968 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T13:07:10.978 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T13:07:10.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T13:07:10.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T13:07:11.137 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T13:07:11.148 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T13:07:11.148 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T13:07:11.156 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T13:07:11.206 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-04-16T13:07:11.209 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-04-16T13:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T13:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-04-16T13:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +591us[ +601us] +/- 47ms 2024-04-16T13:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -677us[ -667us] +/- 54ms 2024-04-16T13:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +132us[ +142us] +/- 67ms 2024-04-16T13:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:07:11.219 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T13:07:11.219 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-16T13:07:11.220 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +590us[ +600us] +/- 47ms 2024-04-16T13:07:11.220 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -667us[ -657us] +/- 54ms 2024-04-16T13:07:11.220 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 +63us[ +73us] +/- 67ms 2024-04-16T13:07:11.220 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T13:07:11.221 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T13:07:11.278 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T13:07:11.278 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T13:07:11.338 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T13:07:11.579 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T13:07:11.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T13:07:11.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:11.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T13:07:12.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:12.005 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T13:07:12.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T13:07:12.025 INFO:teuthology.task.internal:Duration was 795.343907 seconds 2024-04-16T13:07:12.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T13:07:12.035 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T13:07:12.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T13:07:12.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T13:07:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T13:07:12.203 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T13:07:12.673 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T13:07:12.673 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-04-16T13:07:12.673 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T13:07:12.745 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-16T13:07:12.745 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T13:07:12.823 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T13:07:12.823 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T13:07:12.831 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T13:07:12.929 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T13:07:12.930 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T13:07:12.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T13:07:13.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T13:07:13.202 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T13:07:13.202 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T13:07:13.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T13:07:13.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T13:07:13.424 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T13:07:13.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T13:07:13.539 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-16T13:07:13.541 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-04-16T13:07:13.602 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T13:07:13.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:13.652 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T13:07:13.705 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi082.front.sepia.ceph.com, flagging run as failed 2024-04-16T13:07:13.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T13:07:13.715 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T13:07:13.716 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi067 2024-04-16T13:07:13.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T13:07:13.828 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi082 2024-04-16T13:07:13.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T13:07:22.545 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-16T13:07:22.558 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149/remote/smithi082/coredump/1713272785.43746.core.gz: gzip compressed data, was "1713272785.43746.core", last modified: Tue Apr 16 13:07:13 2024, max compression, original size modulo 2^32 266956800 2024-04-16T13:07:22.559 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-04-16T13:07:23.662 INFO:teuthology.task.internal: core looks like: /tmp/tmpx0jpn5oj: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-04-16T13:07:23.691 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i d 2024-04-16T13:07:23.692 DEBUG:teuthology.orchestra.run.smithi082:> which 'ceph-mds -f --cluster ceph -i d' 2024-04-16T13:07:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:/usr/bin/which: invalid option -- 'f' 2024-04-16T13:07:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-04-16T13:07:23.752 INFO:teuthology.orchestra.run.smithi082.stderr:/usr/bin/which: no d in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-16T13:07:23.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:23.753 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-mds 2024-04-16T13:07:23.754 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph 2024-04-16T13:07:23.754 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: "which 'ceph-mds -f --cluster ceph -i d'" 2024-04-16T13:07:23.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T13:07:23.782 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T13:07:23.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T13:07:23.793 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T13:07:23.794 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T13:07:23.806 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T13:07:23.859 INFO:teuthology.orchestra.run.smithi067.stdout: 393936 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 393937 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 393950 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive/syslog 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 393396 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 393404 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:53 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 393405 192 -rw-r--r-- 1 ubuntu ubuntu 195330 Apr 16 13:07 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 526095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive/audit 2024-04-16T13:07:23.860 INFO:teuthology.orchestra.run.smithi067.stdout: 526378 152 -rw------- 1 ubuntu ubuntu 152878 Apr 16 13:07 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T13:07:23.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T13:07:23.862 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T13:07:23.863 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: "which 'ceph-mds -f --cluster ceph -i d'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T13:07:23.875 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T13:07:23.887 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T13:07:23.898 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi082 with status 1: "which 'ceph-mds -f --cluster ceph -i d'" 2024-04-16T13:07:23.899 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T13:07:23.906 INFO:teuthology.orchestra.run.smithi082.stdout: 395174 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 395175 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 395177 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive/syslog 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 395166 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 395167 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 16 12:53 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 395169 184 -rw-r--r-- 1 ubuntu ubuntu 186630 Apr 16 13:07 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T13:07:23.907 INFO:teuthology.orchestra.run.smithi082.stdout: 655363 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 13:07 /home/ubuntu/cephtest/archive/audit 2024-04-16T13:07:23.908 INFO:teuthology.orchestra.run.smithi082.stdout: 655646 128 -rw------- 1 ubuntu ubuntu 129714 Apr 16 13:07 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-16T13:07:23.908 INFO:teuthology.orchestra.run.smithi082.stdout: 395176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 13:06 /home/ubuntu/cephtest/archive/coredump 2024-04-16T13:07:23.908 INFO:teuthology.orchestra.run.smithi082.stdout: 395168 18188 -rw------- 1 root root 266956800 Apr 16 13:06 /home/ubuntu/cephtest/archive/coredump/1713272785.43746.core 2024-04-16T13:07:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T13:07:23.932 DEBUG:teuthology.nuke:shortname: smithi067 2024-04-16T13:07:23.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T13:07:23.953 DEBUG:teuthology.nuke:shortname: smithi082 2024-04-16T13:07:23.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T13:07:23.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:59.424791', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtca6e1dodxY/L0I7XQ5fFK8sZMH3qsYD4wbgQfPYFRr2+Rwqx99pj26svM2NknK6Hd7/LT8w2+vX1gzuP/hZw='} 2024-04-16T13:07:23.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 12:38:59.426149', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLI73+JI8kvs0vsDCgI+UPQh+ABXeZ64+J33eiEFv6wO5JJV2808YLTlAmPm4iKRLV8AQXiryDQCzCuiYhr0m0o='} 2024-04-16T13:07:23.995 INFO:teuthology.orchestra.console.smithi067:Power off 2024-04-16T13:07:23.995 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T13:07:24.018 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-04-16T13:07:24.018 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:24.032 INFO:teuthology.orchestra.console.smithi082:Power off 2024-04-16T13:07:24.033 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T13:07:24.043 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-16T13:07:24.056 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-04-16T13:07:24.056 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:24.087 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-16T13:07:28.044 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:28.089 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:28.154 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-16T13:07:28.200 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-16T13:07:32.155 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:32.200 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:32.266 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-04-16T13:07:32.311 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-04-16T13:07:36.269 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:36.312 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T13:07:36.379 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-04-16T13:07:36.421 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-04-16T13:07:36.480 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-04-16T13:07:36.522 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-04-16T13:07:36.628 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 client.1-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 795.3439066410065 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4a7e23708b3445f59aa9d6ffe779af91 status: fail success: false 2024-04-16T13:07:36.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T13:07:36.711 INFO:teuthology.run:FAIL